2024-09-11T05:10:46.868 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T05:10:46.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T05:10:46.975 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900547' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: rbd cache: true rbd cache policy: writearound global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: daaf78de334647fc0c800f4ac495cc9475a26bae owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6175 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 88/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: daaf78de334647fc0c800f4ac495cc9475a26bae targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVvtnpbNXFXYvY5DTYIQkcQ2Jp8iZgWWI4jBWYZI4QYIYqcaaatmFTojX8jcFs+96h+S7WBioMHFYYN+CD94yI= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF77cX9JEY8PNTTmn8xT5W8l7+qXGMSuOJm6TAX/XbwP/rB7YhqS1ZGk1mUERLneISohDax3Wdf4zpo/MLfGcPM= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_21:16:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T05:10:46.976 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa; will attempt to use it 2024-09-11T05:10:46.976 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa/tasks 2024-09-11T05:10:46.977 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T05:10:46.978 INFO:teuthology.task.internal:Checking packages... 2024-09-11T05:10:46.999 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T05:10:46.999 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T05:10:46.999 INFO:teuthology.packaging:ref: None 2024-09-11T05:10:47.000 INFO:teuthology.packaging:tag: None 2024-09-11T05:10:47.000 INFO:teuthology.packaging:branch: squid 2024-09-11T05:10:47.000 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:10:47.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T05:10:47.217 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-308.gdaaf78de 2024-09-11T05:10:47.219 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T05:10:47.229 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T05:10:47.229 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T05:10:47.280 INFO:teuthology.task.internal:Saving configuration 2024-09-11T05:10:47.292 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T05:10:47.306 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T05:10:47.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 05:05:49.269126', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVvtnpbNXFXYvY5DTYIQkcQ2Jp8iZgWWI4jBWYZI4QYIYqcaaatmFTojX8jcFs+96h+S7WBioMHFYYN+CD94yI='} 2024-09-11T05:10:47.352 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 05:05:49.270523', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF77cX9JEY8PNTTmn8xT5W8l7+qXGMSuOJm6TAX/XbwP/rB7YhqS1ZGk1mUERLneISohDax3Wdf4zpo/MLfGcPM='} 2024-09-11T05:10:47.352 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T05:10:47.367 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T05:10:47.367 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T05:10:47.367 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T05:10:47.445 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fda8a51f400>, signals=[15]) 2024-09-11T05:10:47.446 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T05:10:47.469 INFO:teuthology.task.internal:Opening connections... 2024-09-11T05:10:47.469 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:10:47.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:10:47.550 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:10:47.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:10:47.626 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T05:10:47.637 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-11T05:10:47.656 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-11T05:10:47.656 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-11T05:10:47.713 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-09-11T05:10:47.713 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-09-11T05:10:47.713 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-09-11T05:10:47.713 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-09-11T05:10:47.713 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-09-11T05:10:47.713 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-09-11T05:10:47.713 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T05:10:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-09-11T05:10:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-09-11T05:10:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T05:10:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-09-11T05:10:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T05:10:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T05:10:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T05:10:47.715 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-11T05:10:47.733 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-11T05:10:47.752 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-11T05:10:47.752 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-11T05:10:47.810 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-09-11T05:10:47.810 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-09-11T05:10:47.810 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-09-11T05:10:47.810 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T05:10:47.811 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T05:10:47.812 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-11T05:10:47.833 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T05:10:47.843 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T05:10:47.868 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T05:10:47.868 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-11T05:10:47.871 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-11T05:10:47.888 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T05:10:47.926 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T05:10:47.926 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-11T05:10:47.929 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-11T05:10:48.033 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T05:10:48.087 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T05:10:48.106 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T05:10:48.106 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T05:10:48.106 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T05:10:48.107 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T05:10:48.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:10:48.123 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-11T05:10:48.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:10:48.124 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-11T05:10:48.181 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-503.el9.x86_64 2024-09-11T05:10:48.181 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-503.el9.x86_64 2024-09-11T05:10:48.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2024-09-11T05:10:48.182 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-503.el9.x86_64 2024-09-11T05:10:48.182 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.14.0-503.el9.x86_64 2024-09-11T05:10:48.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2024-09-11T05:10:50.405 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T05:10:50.746 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-11T05:10:59.712 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-11T05:11:04.029 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-11T05:11:05.630 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-11T05:11:06.451 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-11T05:11:07.469 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 20 MB 00:15 2024-09-11T05:11:11.865 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T05:11:13.871 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T05:11:13.872 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T05:11:13.944 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-11T05:11:13.957 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:11:13.966 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:11:13.966 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-11T05:11:13.966 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:11:13.966 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout:Install 4 Packages 2024-09-11T05:11:13.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:11:13.968 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 79 M 2024-09-11T05:11:13.968 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 126 M 2024-09-11T05:11:13.968 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:11:14.116 INFO:teuthology.orchestra.run.smithi153.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 179 kB/s | 23 kB 00:00 2024-09-11T05:11:15.478 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-11T05:11:15.725 INFO:teuthology.orchestra.run.smithi153.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-09-11T05:11:16.391 INFO:teuthology.orchestra.run.smithi153.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-11T05:11:16.457 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-11T05:11:16.683 INFO:teuthology.orchestra.run.smithi153.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 13 MB/s | 35 MB 00:02 2024-09-11T05:11:16.684 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:11:16.684 INFO:teuthology.orchestra.run.smithi153.stdout:Total 29 MB/s | 79 MB 00:02 2024-09-11T05:11:17.364 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:11:17.700 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:11:17.700 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:11:18.668 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:11:18.668 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:11:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:11:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:11:21.936 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:11:22.121 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-11T05:11:24.277 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T05:11:24.278 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T05:11:24.366 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T05:11:24.378 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 79 M 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 126 M 2024-09-11T05:11:24.379 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:11:24.731 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 267 kB/s | 23 kB 00:00 2024-09-11T05:11:24.763 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:11:24.904 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:11:28.881 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-11T05:11:29.716 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:11:29.821 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:11:32.521 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.7 MB/s | 29 MB 00:07 2024-09-11T05:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-11T05:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout:Total 8.6 MB/s | 79 MB 00:09 2024-09-11T05:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:11:34.660 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:11:35.592 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:11:35.592 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:11:38.160 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:11:38.856 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:11:38.930 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:11:41.751 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:11:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:11:47.001 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:11:47.043 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:11:52.188 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:12.896 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:12.936 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:13.226 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:13.226 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:12:13.226 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:12:13.226 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:12:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:12:14.075 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:12:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T05:12:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T05:12:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T05:12:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T05:12:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:12:14.076 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:12:14.422 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:12:14.510 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:12:14.511 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:12:14.511 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T05:12:14.511 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T05:12:14.511 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T05:12:14.511 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T05:12:14.511 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T05:12:14.512 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:12:14.570 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:12:14.570 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:12:14.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-09-11T05:12:14.604 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 82.el9 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8274670 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T05:12:14.605 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T05:12:14.606 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T05:12:14.607 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-09-11T05:12:14.607 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:12:14.607 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T05:12:14.607 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T05:12:14.608 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 5.14.0-505.el9.x86_64 2024-09-11T05:12:14.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T05:12:15.211 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-11T05:12:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T05:12:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-11T05:12:16.540 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-11T05:12:16.556 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.oO3S2LsyJV 2024-09-11T05:12:16.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oO3S2LsyJV 2024-09-11T05:12:16.622 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.oO3S2LsyJV 2024-09-11T05:12:16.765 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.oO3S2LsyJV is 6KB 2024-09-11T05:12:16.814 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.oO3S2LsyJV 2024-09-11T05:12:16.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T05:12:16.901 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T05:12:16.902 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T05:12:16.902 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T05:12:16.902 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T05:12:16.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T05:12:17.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-11T05:12:30.995 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:31.037 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:31.413 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:31.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:12:31.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:12:31.413 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:12:32.269 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:12:32.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:12:32.270 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:12:32.270 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T05:12:32.270 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T05:12:32.270 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T05:12:32.270 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T05:12:32.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:12:32.271 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:12:32.612 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:12:32.699 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:12:32.700 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:12:32.700 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T05:12:32.700 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T05:12:32.700 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T05:12:32.700 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T05:12:32.700 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T05:12:32.700 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:12:32.759 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:12:32.759 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:12:32.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2024-09-11T05:12:32.797 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2024-09-11T05:12:32.797 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2024-09-11T05:12:32.797 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2024-09-11T05:12:32.797 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 82.el9 2024-09-11T05:12:32.797 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2024-09-11T05:12:32.797 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8274670 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:12:32.798 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T05:12:32.799 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T05:12:32.799 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T05:12:32.799 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2024-09-11T05:12:32.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:12:32.799 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T05:12:32.800 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T05:12:32.800 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 5.14.0-505.el9.x86_64 2024-09-11T05:12:32.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T05:12:33.419 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-11T05:12:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T05:12:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-11T05:12:34.744 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-11T05:12:34.760 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.hCLQmiobxA 2024-09-11T05:12:34.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hCLQmiobxA 2024-09-11T05:12:34.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.hCLQmiobxA 2024-09-11T05:12:34.963 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.hCLQmiobxA is 6KB 2024-09-11T05:12:35.012 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.hCLQmiobxA 2024-09-11T05:12:35.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T05:12:35.099 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T05:12:35.099 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T05:12:35.099 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T05:12:35.099 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T05:12:35.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T05:12:35.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-11T05:12:47.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T05:12:47.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-11T05:12:47.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:13:05.277 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T05:13:05.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T05:13:05.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:13:05.597 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-11T05:13:14.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-11T05:13:14.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:13:17.665 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-11T05:13:23.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-11T05:13:29.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-11T05:13:29.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:13:32.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T05:13:32.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:13:48.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-11T05:13:51.165 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-11T05:14:03.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-11T05:14:03.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:14:03.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T05:14:03.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:14:03.468 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-11T05:14:03.777 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-11T05:14:03.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T05:14:03.820 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T05:14:03.821 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-11T05:14:03.837 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-505.el9.x86_64 2024-09-11T05:14:03.838 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T05:14:03.838 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T05:14:03.838 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T05:14:04.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-11T05:14:04.146 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T05:14:04.146 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-11T05:14:04.161 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-505.el9.x86_64 2024-09-11T05:14:04.161 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T05:14:04.161 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T05:14:04.161 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T05:14:04.839 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T05:14:04.839 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T05:14:04.922 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2024-09-11T05:14:04.966 DEBUG:teuthology.parallel:result is None 2024-09-11T05:14:05.162 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T05:14:05.162 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T05:14:05.229 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-09-11T05:14:05.249 DEBUG:teuthology.parallel:result is None 2024-09-11T05:14:05.249 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T05:14:05.260 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T05:14:05.261 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T05:14:05.263 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T05:14:05.280 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T05:14:05.327 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T05:14:05.334 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T05:14:05.334 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T05:14:05.336 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T05:14:05.370 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T05:14:05.375 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T05:14:05.376 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T05:14:05.409 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T05:14:05.448 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:14:05.453 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:14:05.461 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:14:05.463 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:14:05.465 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T05:14:05.472 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T05:14:05.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T05:14:05.504 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T05:14:05.530 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T05:14:05.539 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T05:14:05.539 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T05:14:05.572 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T05:14:05.587 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:14:05.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:14:05.717 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:14:05.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:14:05.841 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:14:05.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T05:14:05.947 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:14:05.988 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:14:06.040 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:14:06.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:14:06.162 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:14:06.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T05:14:06.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-11T05:14:06.237 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-11T05:14:06.281 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:14:06.321 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:14:06.801 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T05:14:06.807 INFO:teuthology.task.internal:Starting timer... 2024-09-11T05:14:06.808 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T05:14:06.818 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T05:14:06.826 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T05:14:06.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-09-11T05:14:06.922 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-09-11T05:14:06.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-09-11T05:14:06.981 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-09-11T05:14:06.983 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T05:14:06.983 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-09-11T05:14:07.007 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-09-11T05:14:07.007 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-09-11T05:14:07.029 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-09-11T05:14:07.030 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-09-11T05:14:07.030 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:14:07.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:14:07.073 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:14:07.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:14:07.098 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T05:14:07.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-09-11T05:14:07.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-09-11T05:14:07.183 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T05:14:07.191 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T05:14:07.194 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T05:14:07.308 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T05:14:07.319 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T05:14:07.320 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T05:17:54.073 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-09-11T05:17:54.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T05:17:54.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:17:54.197 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-11T05:17:54.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T05:17:54.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-11T05:17:54.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:17:54.397 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-11T05:17:54.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-11T05:17:54.486 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T05:17:54.499 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T05:17:54.499 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T05:17:54.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:17:54.502 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T05:17:54.503 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:17:54.533 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T05:17:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T05:17:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T05:17:54.573 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T05:17:54.577 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-09-11T05:17:54.589 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-09-11T05:17:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-09-11T05:17:54.604 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T05:17:54.611 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-09-11T05:17:54.619 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T05:17:54.625 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T05:17:54.640 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T05:17:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:17:54.682 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:17:54.683 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-11T05:17:54.683 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.683 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.683 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.683 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.700 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:17:54.704 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:17:54.704 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-11T05:17:54.704 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.704 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.704 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.704 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:17:54.704 INFO:teuthology.run_tasks:Running task install... 2024-09-11T05:17:54.713 DEBUG:teuthology.task.install:project ceph 2024-09-11T05:17:54.713 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T05:17:54.713 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T05:17:54.713 INFO:teuthology.task.install:Using flavor: default 2024-09-11T05:17:54.718 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T05:17:54.718 INFO:teuthology.task.install:extra packages: [] 2024-09-11T05:17:54.718 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T05:17:54.719 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:17:54.721 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T05:17:54.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:17:54.864 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T05:17:54.865 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T05:17:54.869 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T05:17:54.869 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T05:17:54.978 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T05:17:54.978 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:17:54.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T05:17:54.984 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T05:17:54.984 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:17:54.984 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T05:17:55.005 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T05:17:55.005 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T05:17:55.010 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T05:17:55.010 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T05:17:55.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T05:17:55.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T05:17:55.149 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T05:17:55.152 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T05:17:55.214 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-09-11T05:17:55.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-09-11T05:17:55.216 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-09-11T05:17:55.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-09-11T05:17:55.449 INFO:teuthology.orchestra.run.smithi012.stdout:45 files removed 2024-09-11T05:17:55.451 INFO:teuthology.orchestra.run.smithi153.stdout:45 files removed 2024-09-11T05:17:55.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw 2024-09-11T05:17:55.478 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw 2024-09-11T05:17:56.019 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 324 kB/s | 84 kB 00:00 2024-09-11T05:17:56.059 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 295 kB/s | 84 kB 00:00 2024-09-11T05:17:56.294 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-11T05:17:56.343 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T05:17:56.561 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-11T05:17:56.627 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-11T05:17:57.093 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-11T05:17:57.094 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T05:17:58.804 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-11T05:18:01.752 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 20 MB 00:03 2024-09-11T05:18:03.896 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-11T05:18:05.430 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-11T05:18:06.401 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-11T05:18:07.494 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-11T05:18:09.220 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-11T05:18:10.449 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-11T05:18:11.824 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-11T05:18:14.200 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:18:14.214 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:14.214 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:18:14.214 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:14.214 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:18:14.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T05:18:14.215 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T05:18:14.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:18:14.217 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:14.218 INFO:teuthology.orchestra.run.smithi153.stdout:Install 30 Packages 2024-09-11T05:18:14.218 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 2 Packages 2024-09-11T05:18:14.218 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:14.218 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 60 M 2024-09-11T05:18:14.218 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:18:14.933 INFO:teuthology.orchestra.run.smithi153.stdout:(1/32): ceph-base-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-11T05:18:15.017 INFO:teuthology.orchestra.run.smithi153.stdout:(2/32): ceph-selinux-19.1.1-298.gb53b6d3e.el9.x 303 kB/s | 25 kB 00:00 2024-09-11T05:18:15.117 INFO:teuthology.orchestra.run.smithi153.stdout:(3/32): libcephfs2-19.1.1-298.gb53b6d3e.el9.x86 7.4 MB/s | 752 kB 00:00 2024-09-11T05:18:15.192 INFO:teuthology.orchestra.run.smithi153.stdout:(4/32): libradosstriper1-19.1.1-298.gb53b6d3e.e 6.6 MB/s | 506 kB 00:00 2024-09-11T05:18:15.301 INFO:teuthology.orchestra.run.smithi153.stdout:(5/32): ceph-radosgw-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 11 MB 00:00 2024-09-11T05:18:15.359 INFO:teuthology.orchestra.run.smithi153.stdout:(6/32): python3-ceph-argparse-19.1.1-298.gb53b6 778 kB/s | 45 kB 00:00 2024-09-11T05:18:15.418 INFO:teuthology.orchestra.run.smithi153.stdout:(7/32): python3-ceph-common-19.1.1-298.gb53b6d3 2.3 MB/s | 136 kB 00:00 2024-09-11T05:18:15.610 INFO:teuthology.orchestra.run.smithi153.stdout:(8/32): ceph-common-19.1.1-298.gb53b6d3e.el9.x8 17 MB/s | 21 MB 00:01 2024-09-11T05:18:15.635 INFO:teuthology.orchestra.run.smithi153.stdout:(9/32): python3-cephfs-19.1.1-298.gb53b6d3e.el9 747 kB/s | 162 kB 00:00 2024-09-11T05:18:15.660 INFO:teuthology.orchestra.run.smithi153.stdout:(10/32): python3-rados-19.1.1-298.gb53b6d3e.el9 6.3 MB/s | 321 kB 00:00 2024-09-11T05:18:15.686 INFO:teuthology.orchestra.run.smithi153.stdout:(11/32): python3-rbd-19.1.1-298.gb53b6d3e.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-11T05:18:15.711 INFO:teuthology.orchestra.run.smithi153.stdout:(12/32): python3-rgw-19.1.1-298.gb53b6d3e.el9.x 1.9 MB/s | 100 kB 00:00 2024-09-11T05:18:15.786 INFO:teuthology.orchestra.run.smithi153.stdout:(13/32): librgw2-19.1.1-298.gb53b6d3e.el9.x86_6 9.0 MB/s | 5.3 MB 00:00 2024-09-11T05:18:15.870 INFO:teuthology.orchestra.run.smithi153.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 582 kB/s | 107 kB 00:00 2024-09-11T05:18:15.895 INFO:teuthology.orchestra.run.smithi153.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-09-11T05:18:15.920 INFO:teuthology.orchestra.run.smithi153.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 767 kB/s | 160 kB 00:00 2024-09-11T05:18:15.962 INFO:teuthology.orchestra.run.smithi153.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-11T05:18:15.987 INFO:teuthology.orchestra.run.smithi153.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 631 kB/s | 42 kB 00:00 2024-09-11T05:18:16.013 INFO:teuthology.orchestra.run.smithi153.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-11T05:18:16.021 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-09-11T05:18:16.038 INFO:teuthology.orchestra.run.smithi153.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-11T05:18:16.063 INFO:teuthology.orchestra.run.smithi153.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-09-11T05:18:16.088 INFO:teuthology.orchestra.run.smithi153.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-11T05:18:16.147 INFO:teuthology.orchestra.run.smithi153.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T05:18:16.172 INFO:teuthology.orchestra.run.smithi153.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T05:18:16.198 INFO:teuthology.orchestra.run.smithi153.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 274 kB/s | 26 kB 00:00 2024-09-11T05:18:16.223 INFO:teuthology.orchestra.run.smithi153.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T05:18:16.257 INFO:teuthology.orchestra.run.smithi153.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T05:18:16.299 INFO:teuthology.orchestra.run.smithi153.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-11T05:18:16.340 INFO:teuthology.orchestra.run.smithi153.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-11T05:18:16.424 INFO:teuthology.orchestra.run.smithi153.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T05:18:16.541 INFO:teuthology.orchestra.run.smithi153.stdout:(31/32): librados2-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 3.4 MB 00:00 2024-09-11T05:18:16.599 INFO:teuthology.orchestra.run.smithi153.stdout:(32/32): librbd1-19.1.1-298.gb53b6d3e.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-11T05:18:16.604 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:18:16.604 INFO:teuthology.orchestra.run.smithi153.stdout:Total 25 MB/s | 60 MB 00:02 2024-09-11T05:18:16.701 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:18:16.736 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:18:16.737 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:18:17.429 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:18:17.429 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:18:18.518 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:18:18.534 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:18:18.534 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:18.534 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T05:18:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T05:18:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:Install 30 Packages 2024-09-11T05:18:18.538 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 2 Packages 2024-09-11T05:18:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:18.538 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 60 M 2024-09-11T05:18:18.538 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:18:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:18:19.001 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-11T05:18:19.030 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-11T05:18:19.054 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-11T05:18:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:18:19.104 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:18:19.296 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:18:19.349 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:18:19.580 INFO:teuthology.orchestra.run.smithi012.stdout:(1/32): ceph-base-19.1.1-298.gb53b6d3e.el9.x86_ 9.3 MB/s | 5.4 MB 00:00 2024-09-11T05:18:19.647 INFO:teuthology.orchestra.run.smithi012.stdout:(2/32): ceph-selinux-19.1.1-298.gb53b6d3e.el9.x 379 kB/s | 25 kB 00:00 2024-09-11T05:18:19.721 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-11T05:18:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:(3/32): ceph-radosgw-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 11 MB 00:00 2024-09-11T05:18:19.798 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:18:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:(4/32): libcephfs2-19.1.1-298.gb53b6d3e.el9.x86 4.9 MB/s | 752 kB 00:00 2024-09-11T05:18:19.831 INFO:teuthology.orchestra.run.smithi012.stdout:(5/32): libradosstriper1-19.1.1-298.gb53b6d3e.e 7.4 MB/s | 506 kB 00:00 2024-09-11T05:18:19.874 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:18:19.890 INFO:teuthology.orchestra.run.smithi012.stdout:(6/32): python3-ceph-argparse-19.1.1-298.gb53b6 773 kB/s | 45 kB 00:00 2024-09-11T05:18:19.964 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/34 2024-09-11T05:18:19.990 INFO:teuthology.orchestra.run.smithi012.stdout:(7/32): python3-ceph-common-19.1.1-298.gb53b6d3 1.3 MB/s | 136 kB 00:00 2024-09-11T05:18:19.991 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:18:20.055 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:18:20.074 INFO:teuthology.orchestra.run.smithi012.stdout:(8/32): librgw2-19.1.1-298.gb53b6d3e.el9.x86_64 19 MB/s | 5.3 MB 00:00 2024-09-11T05:18:20.091 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-11T05:18:20.099 INFO:teuthology.orchestra.run.smithi012.stdout:(9/32): python3-cephfs-19.1.1-298.gb53b6d3e.el9 1.5 MB/s | 162 kB 00:00 2024-09-11T05:18:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 11/34 2024-09-11T05:18:20.133 INFO:teuthology.orchestra.run.smithi012.stdout:(10/32): python3-rados-19.1.1-298.gb53b6d3e.el9 5.4 MB/s | 321 kB 00:00 2024-09-11T05:18:20.158 INFO:teuthology.orchestra.run.smithi012.stdout:(11/32): python3-rbd-19.1.1-298.gb53b6d3e.el9.x 5.0 MB/s | 301 kB 00:00 2024-09-11T05:18:20.183 INFO:teuthology.orchestra.run.smithi012.stdout:(12/32): python3-rgw-19.1.1-298.gb53b6d3e.el9.x 1.9 MB/s | 100 kB 00:00 2024-09-11T05:18:20.196 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:18:20.226 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:18:20.290 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:18:20.325 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-11T05:18:20.392 INFO:teuthology.orchestra.run.smithi012.stdout:(13/32): ceph-common-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 21 MB 00:01 2024-09-11T05:18:20.434 INFO:teuthology.orchestra.run.smithi012.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 388 kB/s | 107 kB 00:00 2024-09-11T05:18:20.435 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-11T05:18:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-11T05:18:20.476 INFO:teuthology.orchestra.run.smithi012.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 543 kB/s | 45 kB 00:00 2024-09-11T05:18:20.501 INFO:teuthology.orchestra.run.smithi012.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 504 kB/s | 160 kB 00:00 2024-09-11T05:18:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-11T05:18:20.543 INFO:teuthology.orchestra.run.smithi012.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-11T05:18:20.548 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-11T05:18:20.560 INFO:teuthology.orchestra.run.smithi012.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 721 kB/s | 42 kB 00:00 2024-09-11T05:18:20.578 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-11T05:18:20.594 INFO:teuthology.orchestra.run.smithi012.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T05:18:20.610 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-11T05:18:20.611 INFO:teuthology.orchestra.run.smithi012.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 715 kB/s | 36 kB 00:00 2024-09-11T05:18:20.628 INFO:teuthology.orchestra.run.smithi012.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-11T05:18:20.653 INFO:teuthology.orchestra.run.smithi012.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-11T05:18:20.720 INFO:teuthology.orchestra.run.smithi012.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T05:18:20.737 INFO:teuthology.orchestra.run.smithi012.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 3.3 MB/s | 49 kB 00:00 2024-09-11T05:18:20.754 INFO:teuthology.orchestra.run.smithi012.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 306 kB/s | 26 kB 00:00 2024-09-11T05:18:20.779 INFO:teuthology.orchestra.run.smithi012.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T05:18:20.813 INFO:teuthology.orchestra.run.smithi012.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T05:18:20.863 INFO:teuthology.orchestra.run.smithi012.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-11T05:18:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T05:18:20.958 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-11T05:18:21.007 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:18:21.041 INFO:teuthology.orchestra.run.smithi012.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T05:18:21.081 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:18:21.114 INFO:teuthology.orchestra.run.smithi012.stdout:(31/32): librados2-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 3.4 MB 00:00 2024-09-11T05:18:21.119 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/34 2024-09-11T05:18:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-11T05:18:21.180 INFO:teuthology.orchestra.run.smithi012.stdout:(32/32): librbd1-19.1.1-298.gb53b6d3e.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-11T05:18:21.186 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:18:21.186 INFO:teuthology.orchestra.run.smithi012.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-11T05:18:21.292 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:18:21.332 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:18:21.332 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:18:21.641 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-11T05:18:21.667 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:18:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:18:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/34 2024-09-11T05:18:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 28/34 2024-09-11T05:18:22.029 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:18:22.030 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:18:23.549 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:18:23.647 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-11T05:18:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-11T05:18:23.719 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-11T05:18:23.742 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:18:23.770 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:18:23.925 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:18:23.999 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:18:24.190 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:18:24.232 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:18:24.379 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-11T05:18:24.479 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:18:24.573 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:18:24.671 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/34 2024-09-11T05:18:24.697 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:18:24.761 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:18:24.798 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-11T05:18:24.803 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:18:24.842 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 11/34 2024-09-11T05:18:24.844 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:18:24.911 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:18:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:18:24.938 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T05:18:24.938 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T05:18:24.938 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:24.941 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:18:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:18:25.006 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:18:25.049 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-11T05:18:25.159 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-11T05:18:25.191 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-11T05:18:25.232 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-11T05:18:25.264 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-11T05:18:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-11T05:18:25.334 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-11T05:18:25.662 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-11T05:18:25.706 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:18:25.797 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:18:25.832 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/34 2024-09-11T05:18:25.872 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-11T05:18:26.378 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-11T05:18:26.408 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:18:26.480 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:18:26.561 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/34 2024-09-11T05:18:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 28/34 2024-09-11T05:18:28.937 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:18:28.973 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:18:29.600 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:18:29.635 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:18:29.785 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:18:29.785 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T05:18:29.785 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T05:18:29.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:29.820 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:18:34.879 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-09-11T05:18:34.880 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:35.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:18:35.903 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:18:35.904 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:18:35.904 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T05:18:35.904 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:18:35.904 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:18:35.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:35.905 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:18:36.005 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:18:36.005 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:18:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:18:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/34 2024-09-11T05:18:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/34 2024-09-11T05:18:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/34 2024-09-11T05:18:37.179 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 8/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 9/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:18:37.180 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-11T05:18:37.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-11T05:18:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-11T05:18:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-11T05:18:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-11T05:18:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-11T05:18:37.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-11T05:18:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-11T05:18:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:18:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-11T05:18:37.183 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/34 2024-09-11T05:18:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:18:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:38.138 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T05:18:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:38.141 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:18:38.514 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-test 2024-09-11T05:18:39.073 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:18:39.204 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:18:39.205 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:18:39.205 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:39.205 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:18:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T05:18:39.205 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:18:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T05:18:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T05:18:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T05:18:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:39.206 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:18:39.206 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:39.206 INFO:teuthology.orchestra.run.smithi153.stdout:Install 4 Packages 2024-09-11T05:18:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:39.207 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 49 M 2024-09-11T05:18:39.207 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 209 M 2024-09-11T05:18:39.207 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:18:39.501 INFO:teuthology.orchestra.run.smithi153.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-11T05:18:39.526 INFO:teuthology.orchestra.run.smithi153.stdout:(2/4): libcephsqlite-19.1.1-298.gb53b6d3e.el9.x 743 kB/s | 163 kB 00:00 2024-09-11T05:18:39.551 INFO:teuthology.orchestra.run.smithi153.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-09-11T05:18:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:(4/4): ceph-test-19.1.1-298.gb53b6d3e.el9.x86_6 33 MB/s | 49 MB 00:01 2024-09-11T05:18:40.803 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:18:40.804 INFO:teuthology.orchestra.run.smithi153.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-11T05:18:40.830 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:18:40.849 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:18:40.849 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:18:41.202 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:18:41.227 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:18:41.228 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:18:41.229 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:18:41.229 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:18:41.229 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T05:18:41.229 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:18:41.229 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:18:41.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:41.231 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:18:41.321 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:18:41.321 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:18:41.761 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:18:41.837 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T05:18:41.875 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T05:18:41.903 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:18:42.513 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:18:42.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 8/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 9/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/34 2024-09-11T05:18:42.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-11T05:18:42.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-11T05:18:42.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:18:42.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-11T05:18:42.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/34 2024-09-11T05:18:43.430 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:18:43.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:43.430 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-09-11T05:18:43.430 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.430 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T05:18:43.431 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T05:18:43.432 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T05:18:43.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:43.434 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:18:43.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-test 2024-09-11T05:18:44.401 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:29 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:18:44.538 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T05:18:44.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:44.540 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:18:44.540 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:44.540 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2024-09-11T05:18:44.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:44.540 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 49 M 2024-09-11T05:18:44.541 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 209 M 2024-09-11T05:18:44.541 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:18:44.752 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-11T05:18:44.819 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 958 kB/s | 64 kB 00:00 2024-09-11T05:18:44.844 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): libcephsqlite-19.1.1-298.gb53b6d3e.el9.x 638 kB/s | 163 kB 00:00 2024-09-11T05:18:46.161 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): ceph-test-19.1.1-298.gb53b6d3e.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-11T05:18:46.163 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:18:46.163 INFO:teuthology.orchestra.run.smithi012.stdout:Total 30 MB/s | 49 MB 00:01 2024-09-11T05:18:46.191 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:18:46.214 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:18:46.214 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:18:46.564 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:18:46.615 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:18:46.616 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:18:46.650 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:18:47.172 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:18:47.272 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T05:18:47.318 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T05:18:47.345 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:18:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:18:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/4 2024-09-11T05:18:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/4 2024-09-11T05:18:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T05:18:49.326 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T05:18:49.326 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:49.326 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:18:49.326 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:49.326 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:49.327 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T05:18:49.327 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T05:18:49.327 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:49.327 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:18:49.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph 2024-09-11T05:18:50.176 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:39 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:18:50.327 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:18:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:50.330 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:18:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:18:50.330 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T05:18:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:18:50.330 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T05:18:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T05:18:50.332 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:18:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:Install 37 Packages 2024-09-11T05:18:50.334 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 30 M 2024-09-11T05:18:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 108 M 2024-09-11T05:18:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:18:50.626 INFO:teuthology.orchestra.run.smithi153.stdout:(1/37): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.rp 54 kB/s | 6.5 kB 00:00 2024-09-11T05:18:50.793 INFO:teuthology.orchestra.run.smithi153.stdout:(2/37): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_6 5.3 MB/s | 1.5 MB 00:00 2024-09-11T05:18:50.860 INFO:teuthology.orchestra.run.smithi153.stdout:(3/37): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_6 6.7 MB/s | 2.4 MB 00:00 2024-09-11T05:18:50.960 INFO:teuthology.orchestra.run.smithi153.stdout:(4/37): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_6 14 MB/s | 4.7 MB 00:00 2024-09-11T05:18:50.985 INFO:teuthology.orchestra.run.smithi153.stdout:(5/37): ceph-mgr-modules-core-19.1.1-298.gb53b6 1.9 MB/s | 249 kB 00:00 2024-09-11T05:18:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-11T05:18:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:(7/37): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-11T05:18:51.378 INFO:teuthology.orchestra.run.smithi153.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 511 kB/s | 106 kB 00:00 2024-09-11T05:18:51.428 INFO:teuthology.orchestra.run.smithi153.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-11T05:18:51.470 INFO:teuthology.orchestra.run.smithi153.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-11T05:18:51.496 INFO:teuthology.orchestra.run.smithi153.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-11T05:18:51.546 INFO:teuthology.orchestra.run.smithi153.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 701 kB/s | 135 kB 00:00 2024-09-11T05:18:51.646 INFO:teuthology.orchestra.run.smithi153.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 348 kB/s | 35 kB 00:00 2024-09-11T05:18:51.671 INFO:teuthology.orchestra.run.smithi153.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 980 kB/s | 172 kB 00:00 2024-09-11T05:18:51.697 INFO:teuthology.orchestra.run.smithi153.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 832 kB/s | 188 kB 00:00 2024-09-11T05:18:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-11T05:18:51.739 INFO:teuthology.orchestra.run.smithi153.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 834 kB/s | 77 kB 00:00 2024-09-11T05:18:51.756 INFO:teuthology.orchestra.run.smithi153.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-11T05:18:51.798 INFO:teuthology.orchestra.run.smithi153.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-11T05:18:51.823 INFO:teuthology.orchestra.run.smithi153.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 7.3 MB/s | 172 kB 00:00 2024-09-11T05:18:51.848 INFO:teuthology.orchestra.run.smithi153.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-11T05:18:51.874 INFO:teuthology.orchestra.run.smithi153.stdout:(22/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 371 kB/s | 43 kB 00:00 2024-09-11T05:18:51.907 INFO:teuthology.orchestra.run.smithi153.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 323 kB/s | 11 kB 00:00 2024-09-11T05:18:51.932 INFO:teuthology.orchestra.run.smithi153.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 998 kB/s | 23 kB 00:00 2024-09-11T05:18:51.958 INFO:teuthology.orchestra.run.smithi153.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 211 kB/s | 18 kB 00:00 2024-09-11T05:18:51.983 INFO:teuthology.orchestra.run.smithi153.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-11T05:18:52.008 INFO:teuthology.orchestra.run.smithi153.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-11T05:18:52.033 INFO:teuthology.orchestra.run.smithi153.stdout:(28/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-09-11T05:18:52.059 INFO:teuthology.orchestra.run.smithi153.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-09-11T05:18:52.084 INFO:teuthology.orchestra.run.smithi153.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-11T05:18:52.109 INFO:teuthology.orchestra.run.smithi153.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-11T05:18:52.134 INFO:teuthology.orchestra.run.smithi153.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-11T05:18:52.160 INFO:teuthology.orchestra.run.smithi153.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2024-09-11T05:18:52.185 INFO:teuthology.orchestra.run.smithi153.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-11T05:18:52.210 INFO:teuthology.orchestra.run.smithi153.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-11T05:18:52.235 INFO:teuthology.orchestra.run.smithi153.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T05:18:52.261 INFO:teuthology.orchestra.run.smithi153.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-11T05:18:52.261 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:18:52.264 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:18:52.264 INFO:teuthology.orchestra.run.smithi153.stdout:Total 16 MB/s | 30 MB 00:01 2024-09-11T05:18:52.346 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:18:52.413 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:18:52.452 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:18:52.452 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:18:52.933 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:18:52.934 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:18:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:18:54.347 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T05:18:54.380 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T05:18:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T05:18:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T05:18:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T05:18:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T05:18:54.651 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T05:18:54.730 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T05:18:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:18:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/4 2024-09-11T05:18:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/4 2024-09-11T05:18:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T05:18:54.770 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T05:18:54.805 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T05:18:54.835 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T05:18:54.878 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T05:18:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T05:18:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T05:18:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T05:18:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T05:18:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:55.046 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:18:55.069 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T05:18:55.102 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T05:18:55.174 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T05:18:55.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph 2024-09-11T05:18:55.312 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T05:18:55.393 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T05:18:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T05:18:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T05:18:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T05:18:55.589 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T05:18:55.773 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T05:18:55.821 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T05:18:55.897 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:40 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:18:55.899 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T05:18:55.989 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T05:18:56.029 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T05:18:56.050 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:18:56.053 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:18:56.053 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:56.053 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:18:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T05:18:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T05:18:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout:Install 37 Packages 2024-09-11T05:18:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:18:56.057 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 30 M 2024-09-11T05:18:56.057 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 108 M 2024-09-11T05:18:56.057 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:18:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T05:18:56.319 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 32/37 2024-09-11T05:18:56.348 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:18:56.374 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:18:56.374 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:18:56.374 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T05:18:56.374 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:18:56.374 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:18:56.374 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:56.401 INFO:teuthology.orchestra.run.smithi012.stdout:(1/37): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.rp 46 kB/s | 6.5 kB 00:00 2024-09-11T05:18:56.593 INFO:teuthology.orchestra.run.smithi012.stdout:(2/37): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_6 7.1 MB/s | 2.4 MB 00:00 2024-09-11T05:18:56.635 INFO:teuthology.orchestra.run.smithi012.stdout:(3/37): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_6 4.0 MB/s | 1.5 MB 00:00 2024-09-11T05:18:56.719 INFO:teuthology.orchestra.run.smithi012.stdout:(4/37): ceph-mgr-modules-core-19.1.1-298.gb53b6 2.9 MB/s | 249 kB 00:00 2024-09-11T05:18:56.919 INFO:teuthology.orchestra.run.smithi012.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-11T05:18:57.120 INFO:teuthology.orchestra.run.smithi012.stdout:(6/37): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_6 32 MB/s | 17 MB 00:00 2024-09-11T05:18:57.195 INFO:teuthology.orchestra.run.smithi012.stdout:(7/37): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_6 5.9 MB/s | 4.7 MB 00:00 2024-09-11T05:18:57.237 INFO:teuthology.orchestra.run.smithi012.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 3.9 MB/s | 1.2 MB 00:00 2024-09-11T05:18:57.287 INFO:teuthology.orchestra.run.smithi012.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-11T05:18:57.329 INFO:teuthology.orchestra.run.smithi012.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 510 kB/s | 106 kB 00:00 2024-09-11T05:18:57.355 INFO:teuthology.orchestra.run.smithi012.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-11T05:18:57.380 INFO:teuthology.orchestra.run.smithi012.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 734 kB/s | 135 kB 00:00 2024-09-11T05:18:57.413 INFO:teuthology.orchestra.run.smithi012.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T05:18:57.438 INFO:teuthology.orchestra.run.smithi012.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 594 kB/s | 35 kB 00:00 2024-09-11T05:18:57.464 INFO:teuthology.orchestra.run.smithi012.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-11T05:18:57.498 INFO:teuthology.orchestra.run.smithi012.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 916 kB/s | 77 kB 00:00 2024-09-11T05:18:57.523 INFO:teuthology.orchestra.run.smithi012.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-11T05:18:57.548 INFO:teuthology.orchestra.run.smithi012.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 466 kB/s | 51 kB 00:00 2024-09-11T05:18:57.590 INFO:teuthology.orchestra.run.smithi012.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T05:18:57.615 INFO:teuthology.orchestra.run.smithi012.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 649 kB/s | 43 kB 00:00 2024-09-11T05:18:57.649 INFO:teuthology.orchestra.run.smithi012.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.0 MB/s | 172 kB 00:00 2024-09-11T05:18:57.674 INFO:teuthology.orchestra.run.smithi012.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 426 kB/s | 11 kB 00:00 2024-09-11T05:18:57.700 INFO:teuthology.orchestra.run.smithi012.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-11T05:18:57.725 INFO:teuthology.orchestra.run.smithi012.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 930 kB/s | 23 kB 00:00 2024-09-11T05:18:57.750 INFO:teuthology.orchestra.run.smithi012.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.6 MB/s | 358 kB 00:00 2024-09-11T05:18:57.784 INFO:teuthology.orchestra.run.smithi012.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 332 kB/s | 19 kB 00:00 2024-09-11T05:18:57.809 INFO:teuthology.orchestra.run.smithi012.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 383 kB/s | 20 kB 00:00 2024-09-11T05:18:57.831 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:18:57.834 INFO:teuthology.orchestra.run.smithi012.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-11T05:18:57.859 INFO:teuthology.orchestra.run.smithi012.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T05:18:57.860 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:18:57.860 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:18:57.860 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T05:18:57.860 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:18:57.860 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:18:57.860 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:57.885 INFO:teuthology.orchestra.run.smithi012.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 663 kB/s | 16 kB 00:00 2024-09-11T05:18:57.910 INFO:teuthology.orchestra.run.smithi012.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-09-11T05:18:57.943 INFO:teuthology.orchestra.run.smithi012.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-11T05:18:57.969 INFO:teuthology.orchestra.run.smithi012.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2024-09-11T05:18:57.994 INFO:teuthology.orchestra.run.smithi012.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T05:18:58.019 INFO:teuthology.orchestra.run.smithi012.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-11T05:18:58.045 INFO:teuthology.orchestra.run.smithi012.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-11T05:18:58.078 INFO:teuthology.orchestra.run.smithi012.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-09-11T05:18:58.082 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:18:58.082 INFO:teuthology.orchestra.run.smithi012.stdout:Total 15 MB/s | 30 MB 00:02 2024-09-11T05:18:58.232 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:18:58.276 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:18:58.276 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:18:58.307 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:18:58.332 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:18:58.332 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:18:58.332 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T05:18:58.332 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:18:58.332 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:18:58.332 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:18:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:18:58.582 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:18:58.582 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T05:18:58.582 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:18:58.582 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:18:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:18:58.646 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:18:58.782 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:18:58.783 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:19:00.176 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:19:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T05:19:00.276 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T05:19:00.312 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T05:19:00.388 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 6/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T05:19:00.427 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T05:19:00.428 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T05:19:00.429 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T05:19:00.430 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T05:19:00.430 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T05:19:00.430 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T05:19:00.437 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T05:19:00.469 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T05:19:00.575 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T05:19:00.659 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T05:19:00.706 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T05:19:00.740 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T05:19:00.770 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T05:19:00.804 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T05:19:00.838 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T05:19:00.879 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T05:19:00.922 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T05:19:00.956 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T05:19:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T05:19:01.045 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T05:19:01.123 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T05:19:01.278 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T05:19:01.366 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T05:19:01.425 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T05:19:01.462 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T05:19:01.521 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T05:19:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T05:19:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T05:19:01.554 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T05:19:01.555 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T05:19:01.556 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T05:19:01.557 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:01.557 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:01.585 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T05:19:01.795 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T05:19:01.852 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T05:19:01.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-base 2024-09-11T05:19:01.932 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T05:19:02.030 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T05:19:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T05:19:02.198 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T05:19:02.369 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 32/37 2024-09-11T05:19:02.400 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:19:02.427 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:19:02.428 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:02.428 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T05:19:02.428 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:19:02.428 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:19:02.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:02.488 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:51 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:02.579 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:02.622 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:02.623 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:02.623 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:02.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install cephadm 2024-09-11T05:19:03.250 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:03.382 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:03.383 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:03.384 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 765 k 2024-09-11T05:19:03.385 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 771 k 2024-09-11T05:19:03.385 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:03.642 INFO:teuthology.orchestra.run.smithi153.stdout:cephadm-19.1.1-298.gb53b6d3e.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-11T05:19:03.643 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:03.643 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-11T05:19:03.643 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:03.648 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:03.648 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:03.654 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:03.654 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:03.724 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:03.959 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:19:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:19:03.987 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:03.988 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T05:19:03.988 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:19:03.988 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:19:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:04.443 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:19:04.468 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:19:04.468 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:04.468 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T05:19:04.468 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:19:04.468 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:19:04.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:04.696 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:04.710 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:19:04.735 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:19:04.735 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:04.735 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T05:19:04.736 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:19:04.736 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:19:04.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:04.801 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:19:04.934 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:04.934 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:04.935 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:04.935 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:04.935 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:04.935 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:05.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T05:19:05.725 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:05.863 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:05.863 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 145 k 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 435 k 2024-09-11T05:19:05.864 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-immutable-object-cache-19.1.1-298.gb53b6d3 699 kB/s | 145 kB 00:00 2024-09-11T05:19:06.073 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:06.073 INFO:teuthology.orchestra.run.smithi153.stdout:Total 693 kB/s | 145 kB 00:00 2024-09-11T05:19:06.073 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:06.081 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:06.081 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:06.139 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:06.139 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:06.296 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:19:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:19:06.382 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:06.382 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T05:19:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/37 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/37 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/37 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/37 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/37 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 6/37 2024-09-11T05:19:06.592 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T05:19:06.593 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T05:19:06.594 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T05:19:06.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T05:19:06.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T05:19:06.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T05:19:06.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T05:19:06.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T05:19:06.595 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T05:19:06.596 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T05:19:06.596 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T05:19:06.596 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T05:19:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:19:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:07.309 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:07.309 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:07.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T05:19:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T05:19:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T05:19:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T05:19:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T05:19:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T05:19:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T05:19:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:07.567 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:07.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-base 2024-09-11T05:19:08.129 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:08.223 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:08.266 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:08.267 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:08.268 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:08.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T05:19:08.569 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:53 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:19:08.662 INFO:teuthology.orchestra.run.smithi012.stdout:Package ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:08.707 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:19:08.708 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:19:08.708 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:08.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install cephadm 2024-09-11T05:19:08.890 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:09.023 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:09.024 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:09.024 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:19:09.024 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:09.024 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:09.024 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T05:19:09.025 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T05:19:09.026 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:09.026 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:09.026 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:09.026 INFO:teuthology.orchestra.run.smithi153.stdout:Install 12 Packages 2024-09-11T05:19:09.026 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:09.026 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 8.7 M 2024-09-11T05:19:09.026 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 104 M 2024-09-11T05:19:09.027 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:09.366 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:19:09.505 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:19:09.505 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 765 k 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 771 k 2024-09-11T05:19:09.506 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:19:09.726 INFO:teuthology.orchestra.run.smithi153.stdout:(1/12): ceph-grafana-dashboards-19.1.1-298.gb53 206 kB/s | 32 kB 00:00 2024-09-11T05:19:09.743 INFO:teuthology.orchestra.run.smithi012.stdout:cephadm-19.1.1-298.gb53b6d3e.el9.noarch.rpm 3.2 MB/s | 765 kB 00:00 2024-09-11T05:19:09.744 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:09.744 INFO:teuthology.orchestra.run.smithi012.stdout:Total 3.1 MB/s | 765 kB 00:00 2024-09-11T05:19:09.745 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:19:09.750 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:19:09.750 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:19:09.751 INFO:teuthology.orchestra.run.smithi153.stdout:(2/12): ceph-prometheus-alerts-19.1.1-298.gb53b 92 kB/s | 16 kB 00:00 2024-09-11T05:19:09.756 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:19:09.757 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:19:09.832 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:19:09.893 INFO:teuthology.orchestra.run.smithi153.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-11T05:19:09.951 INFO:teuthology.orchestra.run.smithi153.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-11T05:19:10.018 INFO:teuthology.orchestra.run.smithi153.stdout:(5/12): ceph-mgr-dashboard-19.1.1-298.gb53b6d3e 8.0 MB/s | 3.6 MB 00:00 2024-09-11T05:19:10.060 INFO:teuthology.orchestra.run.smithi153.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.9 MB/s | 548 kB 00:00 2024-09-11T05:19:10.094 INFO:teuthology.orchestra.run.smithi153.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 265 kB/s | 19 kB 00:00 2024-09-11T05:19:10.128 INFO:teuthology.orchestra.run.smithi153.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-11T05:19:10.153 INFO:teuthology.orchestra.run.smithi153.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T05:19:10.180 INFO:teuthology.orchestra.run.smithi153.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-11T05:19:10.228 INFO:teuthology.orchestra.run.smithi153.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-09-11T05:19:10.286 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:10.311 INFO:teuthology.orchestra.run.smithi153.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.0 MB/s | 863 kB 00:00 2024-09-11T05:19:10.315 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:10.316 INFO:teuthology.orchestra.run.smithi153.stdout:Total 6.7 MB/s | 8.7 MB 00:01 2024-09-11T05:19:10.365 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:10.383 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:10.383 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:10.594 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:10.594 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:19:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:11.124 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T05:19:11.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T05:19:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T05:19:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T05:19:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T05:19:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T05:19:11.566 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T05:19:11.651 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T05:19:11.696 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T05:19:11.732 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:19:11.764 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 10/12 2024-09-11T05:19:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:56 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:19:11.957 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:19:11.957 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repo Size 2024-09-11T05:19:11.957 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:11.957 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:19:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T05:19:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:19:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:19:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 145 k 2024-09-11T05:19:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 435 k 2024-09-11T05:19:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:19:12.199 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-immutable-object-cache-19.1.1-298.gb53b6d3 604 kB/s | 145 kB 00:00 2024-09-11T05:19:12.200 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:12.200 INFO:teuthology.orchestra.run.smithi012.stdout:Total 599 kB/s | 145 kB 00:00 2024-09-11T05:19:12.200 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:19:12.208 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:19:12.208 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:19:12.269 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:19:12.270 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:19:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:19:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:19:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:19:12.527 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:12.527 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T05:19:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:12.817 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 11/12 2024-09-11T05:19:12.857 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:19:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:19:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:13.411 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:19:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:13.412 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:13.640 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-mgr 2024-09-11T05:19:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:19:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 1/12 2024-09-11T05:19:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 2/12 2024-09-11T05:19:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 3/12 2024-09-11T05:19:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T05:19:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T05:19:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T05:19:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T05:19:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T05:19:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:19:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T05:19:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T05:19:14.229 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:59 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:19:14.322 INFO:teuthology.orchestra.run.smithi012.stdout:Package ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:14.366 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:19:14.367 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:19:14.367 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:14.436 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:14.498 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:14.499 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:14.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T05:19:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:00 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:19:15.163 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:19:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:19:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:19:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T05:19:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T05:19:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T05:19:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T05:19:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:19:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:Install 12 Packages 2024-09-11T05:19:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 8.7 M 2024-09-11T05:19:15.167 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 104 M 2024-09-11T05:19:15.167 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:19:15.300 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:04 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:15.434 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:15.435 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T05:19:15.436 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout:Install 12 Packages 2024-09-11T05:19:15.437 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:15.438 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 38 M 2024-09-11T05:19:15.438 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 212 M 2024-09-11T05:19:15.438 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:15.969 INFO:teuthology.orchestra.run.smithi012.stdout:(1/12): ceph-grafana-dashboards-19.1.1-298.gb53 204 kB/s | 32 kB 00:00 2024-09-11T05:19:15.986 INFO:teuthology.orchestra.run.smithi012.stdout:(2/12): ceph-prometheus-alerts-19.1.1-298.gb53b 95 kB/s | 16 kB 00:00 2024-09-11T05:19:16.228 INFO:teuthology.orchestra.run.smithi012.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-11T05:19:16.295 INFO:teuthology.orchestra.run.smithi012.stdout:(4/12): ceph-mgr-dashboard-19.1.1-298.gb53b6d3e 7.4 MB/s | 3.6 MB 00:00 2024-09-11T05:19:16.327 INFO:teuthology.orchestra.run.smithi153.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-29 14 MB/s | 7.4 MB 00:00 2024-09-11T05:19:16.328 INFO:teuthology.orchestra.run.smithi012.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-11T05:19:16.387 INFO:teuthology.orchestra.run.smithi012.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-11T05:19:16.444 INFO:teuthology.orchestra.run.smithi153.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-11T05:19:16.504 INFO:teuthology.orchestra.run.smithi012.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.6 MB/s | 548 kB 00:00 2024-09-11T05:19:16.546 INFO:teuthology.orchestra.run.smithi012.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-09-11T05:19:16.579 INFO:teuthology.orchestra.run.smithi012.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-09-11T05:19:16.602 INFO:teuthology.orchestra.run.smithi153.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 242 kB/s | 191 kB 00:00 2024-09-11T05:19:16.605 INFO:teuthology.orchestra.run.smithi012.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 525 kB/s | 31 kB 00:00 2024-09-11T05:19:16.630 INFO:teuthology.orchestra.run.smithi012.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-11T05:19:16.719 INFO:teuthology.orchestra.run.smithi153.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-11T05:19:16.803 INFO:teuthology.orchestra.run.smithi153.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 463 kB/s | 38 kB 00:00 2024-09-11T05:19:16.895 INFO:teuthology.orchestra.run.smithi153.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 741 kB/s | 801 kB 00:01 2024-09-11T05:19:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-09-11T05:19:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:Total 4.6 MB/s | 8.7 MB 00:01 2024-09-11T05:19:17.095 INFO:teuthology.orchestra.run.smithi153.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-11T05:19:17.114 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:19:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:19:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:19:17.333 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:19:17.334 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:19:17.412 INFO:teuthology.orchestra.run.smithi153.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.1 MB/s | 3.0 MB 00:00 2024-09-11T05:19:17.557 INFO:teuthology.orchestra.run.smithi153.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-11T05:19:17.837 INFO:teuthology.orchestra.run.smithi153.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.9 MB/s | 5.1 MB 00:00 2024-09-11T05:19:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:19:17.971 INFO:teuthology.orchestra.run.smithi153.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.2 MB/s | 4.9 MB 00:01 2024-09-11T05:19:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T05:19:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T05:19:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T05:19:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T05:19:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T05:19:18.288 INFO:teuthology.orchestra.run.smithi153.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-11T05:19:18.289 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:18.289 INFO:teuthology.orchestra.run.smithi153.stdout:Total 13 MB/s | 38 MB 00:02 2024-09-11T05:19:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T05:19:18.592 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T05:19:18.641 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T05:19:18.643 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:18.668 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:19:18.670 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:18.670 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:18.700 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 10/12 2024-09-11T05:19:19.091 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:19.092 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:19.823 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 11/12 2024-09-11T05:19:19.851 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:19.879 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:19:19.924 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T05:19:19.970 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:19:20.070 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:19:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T05:19:20.298 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T05:19:20.327 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T05:19:20.405 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T05:19:21.062 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T05:19:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T05:19:21.168 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:19:21.168 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 1/12 2024-09-11T05:19:21.168 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 2/12 2024-09-11T05:19:21.168 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 3/12 2024-09-11T05:19:21.168 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T05:19:21.168 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T05:19:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T05:19:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T05:19:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T05:19:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:19:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T05:19:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T05:19:21.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T05:19:21.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:21.501 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:19:21.501 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T05:19:21.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:21.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:21.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:21.502 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:21.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T05:19:22.325 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:07 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:19:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:19:22.465 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:19:22.469 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-11T05:19:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:19:22.469 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-11T05:19:22.469 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:19:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T05:19:22.469 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T05:19:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:22.471 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:19:22.471 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-11T05:19:22.471 INFO:teuthology.orchestra.run.smithi012.stdout:Install 12 Packages 2024-09-11T05:19:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:22.471 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 38 M 2024-09-11T05:19:22.471 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 212 M 2024-09-11T05:19:22.471 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:19:22.821 INFO:teuthology.orchestra.run.smithi012.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-11T05:19:22.971 INFO:teuthology.orchestra.run.smithi012.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-11T05:19:23.113 INFO:teuthology.orchestra.run.smithi012.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 112 kB/s | 33 kB 00:00 2024-09-11T05:19:23.205 INFO:teuthology.orchestra.run.smithi012.stdout:(4/12): ceph-mgr-diskprediction-local-19.1.1-29 14 MB/s | 7.4 MB 00:00 2024-09-11T05:19:23.230 INFO:teuthology.orchestra.run.smithi012.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-11T05:19:23.441 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T05:19:23.476 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:19:23.497 INFO:teuthology.orchestra.run.smithi012.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 132 kB/s | 38 kB 00:00 2024-09-11T05:19:23.881 INFO:teuthology.orchestra.run.smithi012.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 638 kB/s | 245 kB 00:00 2024-09-11T05:19:24.115 INFO:teuthology.orchestra.run.smithi012.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-09-11T05:19:24.231 INFO:teuthology.orchestra.run.smithi012.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-11T05:19:24.640 INFO:teuthology.orchestra.run.smithi012.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.7 MB/s | 5.1 MB 00:00 2024-09-11T05:19:24.949 INFO:teuthology.orchestra.run.smithi012.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.9 MB/s | 4.9 MB 00:01 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 1/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T05:19:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:19:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T05:19:26.483 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:26.484 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:26.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-rook 2024-09-11T05:19:27.438 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:16 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:27.575 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:27.575 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:27.575 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:19:27.575 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:27.575 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:27.575 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T05:19:27.575 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T05:19:27.576 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout:Install 13 Packages 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.2 M 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 26 M 2024-09-11T05:19:27.577 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:28.227 INFO:teuthology.orchestra.run.smithi153.stdout:(1/13): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el9. 308 kB/s | 49 kB 00:00 2024-09-11T05:19:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 38 kB/s | 19 kB 00:00 2024-09-11T05:19:28.669 INFO:teuthology.orchestra.run.smithi153.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 43 kB/s | 26 kB 00:00 2024-09-11T05:19:29.044 INFO:teuthology.orchestra.run.smithi153.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 272 kB/s | 222 kB 00:00 2024-09-11T05:19:29.361 INFO:teuthology.orchestra.run.smithi153.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 203 kB/s | 159 kB 00:00 2024-09-11T05:19:29.461 INFO:teuthology.orchestra.run.smithi153.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 323 kB/s | 32 kB 00:00 2024-09-11T05:19:29.486 INFO:teuthology.orchestra.run.smithi153.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 341 kB/s | 279 kB 00:00 2024-09-11T05:19:29.503 INFO:teuthology.orchestra.run.smithi153.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 346 kB/s | 14 kB 00:00 2024-09-11T05:19:29.570 INFO:teuthology.orchestra.run.smithi153.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 17 MB/s | 1.0 MB 00:00 2024-09-11T05:19:29.587 INFO:teuthology.orchestra.run.smithi153.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-11T05:19:29.612 INFO:teuthology.orchestra.run.smithi153.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.7 MB/s | 220 kB 00:00 2024-09-11T05:19:29.629 INFO:teuthology.orchestra.run.smithi153.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-09-11T05:19:29.696 INFO:teuthology.orchestra.run.smithi153.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 82 kB/s | 54 kB 00:00 2024-09-11T05:19:29.700 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:29.700 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.0 MB/s | 2.2 MB 00:02 2024-09-11T05:19:29.771 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:29.787 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:29.788 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:29.878 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:29.879 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:30.393 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T05:19:30.613 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T05:19:30.678 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T05:19:30.714 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T05:19:30.757 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T05:19:30.857 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T05:19:30.960 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T05:19:31.017 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T05:19:31.729 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T05:19:31.772 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T05:19:31.805 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T05:19:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T05:19:31.884 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:19:32.651 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:19:32.651 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 1/13 2024-09-11T05:19:32.651 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T05:19:32.651 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T05:19:32.651 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T05:19:32.652 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T05:19:32.979 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:32.980 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:33.218 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T05:19:33.784 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:22 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:33.917 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:33.918 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:33.918 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:19:33.918 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:33.918 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:33.918 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T05:19:33.918 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:19:33.918 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2024-09-11T05:19:33.919 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:33.920 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 7.0 M 2024-09-11T05:19:33.920 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 33 M 2024-09-11T05:19:33.920 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:34.232 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-11T05:19:34.257 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e.el 712 kB/s | 146 kB 00:00 2024-09-11T05:19:34.307 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T05:19:34.332 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.3 MB/s | 548 kB 00:00 2024-09-11T05:19:34.357 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-11T05:19:34.425 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-11T05:19:34.427 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:34.427 INFO:teuthology.orchestra.run.smithi153.stdout:Total 14 MB/s | 7.0 MB 00:00 2024-09-11T05:19:34.496 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:34.507 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:34.507 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:34.606 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:34.607 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:34.912 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T05:19:35.142 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T05:19:35.686 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T05:19:35.779 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T05:19:35.843 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T05:19:35.871 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:19:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:19:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/6 2024-09-11T05:19:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T05:19:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T05:19:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T05:19:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T05:19:36.945 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T05:19:36.945 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:36.945 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:36.945 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:36.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T05:19:36.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T05:19:36.945 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T05:19:36.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T05:19:36.946 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T05:19:36.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:36.946 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:37.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-fuse 2024-09-11T05:19:37.765 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:37.899 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:37.901 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:37.901 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:19:37.901 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:37.901 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T05:19:37.902 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-11T05:19:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T05:19:37.902 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:37.902 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:37.903 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:37.903 INFO:teuthology.orchestra.run.smithi153.stdout:Install 2 Packages 2024-09-11T05:19:37.903 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:37.903 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 977 k 2024-09-11T05:19:37.903 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.9 M 2024-09-11T05:19:37.903 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:38.276 INFO:teuthology.orchestra.run.smithi153.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 845 kB/s | 80 kB 00:00 2024-09-11T05:19:38.484 INFO:teuthology.orchestra.run.smithi153.stdout:(2/2): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86_6 2.9 MB/s | 897 kB 00:00 2024-09-11T05:19:38.485 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:38.485 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.6 MB/s | 977 kB 00:00 2024-09-11T05:19:38.497 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:38.520 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:38.520 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:38.602 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:38.602 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:38.790 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:38.929 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T05:19:39.001 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:19:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:19:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/2 2024-09-11T05:19:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T05:19:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:39.962 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T05:19:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:39.962 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:40.265 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-volume 2024-09-11T05:19:40.844 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:29 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:40.984 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:40.985 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 285 k 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 1.3 M 2024-09-11T05:19:40.986 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:41.230 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-volume-19.1.1-298.gb53b6d3e.el9.noarch.rpm 1.1 MB/s | 285 kB 00:00 2024-09-11T05:19:41.231 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:41.231 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-11T05:19:41.231 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:41.240 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:41.240 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:41.269 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:41.270 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:41.488 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:41.557 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:41.573 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:41.573 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:41.574 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T05:19:41.574 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:42.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:19:42.569 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:42.569 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:42.569 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:42.570 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:42.570 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:42.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados-devel 2024-09-11T05:19:43.435 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:32 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:43.570 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:43.570 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 127 k 2024-09-11T05:19:43.571 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 456 k 2024-09-11T05:19:43.572 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:43.776 INFO:teuthology.orchestra.run.smithi153.stdout:librados-devel-19.1.1-298.gb53b6d3e.el9.x86_64. 618 kB/s | 127 kB 00:00 2024-09-11T05:19:43.777 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:43.778 INFO:teuthology.orchestra.run.smithi153.stdout:Total 614 kB/s | 127 kB 00:00 2024-09-11T05:19:43.778 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:43.783 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:43.783 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:43.848 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:43.849 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:44.099 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:44.560 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:44.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:44.827 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:44.827 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:44.827 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:44.828 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:44.828 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:45.060 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs2 2024-09-11T05:19:45.194 INFO:teuthology.orchestra.run.smithi012.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 794 kB/s | 16 MB 00:20 2024-09-11T05:19:45.196 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:45.196 INFO:teuthology.orchestra.run.smithi012.stdout:Total 1.7 MB/s | 38 MB 00:22 2024-09-11T05:19:45.563 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:19:45.590 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:19:45.590 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:19:45.641 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:45.736 INFO:teuthology.orchestra.run.smithi153.stdout:Package libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:45.781 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:45.782 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:45.782 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:45.849 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs-devel 2024-09-11T05:19:46.042 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:19:46.043 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:19:46.419 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:46.553 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:46.553 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:46.553 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-11T05:19:46.553 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:46.553 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:46.554 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T05:19:46.554 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:46.554 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:46.554 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:46.554 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:46.554 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:46.554 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 32 k 2024-09-11T05:19:46.555 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 142 k 2024-09-11T05:19:46.555 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:46.721 INFO:teuthology.orchestra.run.smithi153.stdout:libcephfs-devel-19.1.1-298.gb53b6d3e.el9.x86_64 190 kB/s | 32 kB 00:00 2024-09-11T05:19:46.721 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:46.722 INFO:teuthology.orchestra.run.smithi153.stdout:Total 189 kB/s | 32 kB 00:00 2024-09-11T05:19:46.722 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:46.725 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:46.725 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:46.746 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:46.747 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:46.825 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:19:46.835 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:46.886 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T05:19:46.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:19:46.952 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:47.034 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:19:47.069 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T05:19:47.264 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T05:19:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T05:19:47.322 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:47.384 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T05:19:47.551 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:47.551 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:47.551 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:47.551 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:47.551 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:47.551 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:47.720 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados2 2024-09-11T05:19:48.081 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T05:19:48.210 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T05:19:48.284 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:48.375 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:48.418 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:48.419 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:48.419 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:48.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librbd1 2024-09-11T05:19:49.049 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:49.141 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:49.185 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:49.252 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rados 2024-09-11T05:19:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:19:49.823 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:49.913 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:49.956 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:50.021 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rgw 2024-09-11T05:19:50.587 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:50.631 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T05:19:50.658 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:19:50.677 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:50.722 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:50.787 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-cephfs 2024-09-11T05:19:51.356 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:51.447 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:51.491 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:51.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rbd 2024-09-11T05:19:52.125 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:52.215 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:19:52.258 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:52.258 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-11T05:19:52.259 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:52.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-fuse 2024-09-11T05:19:52.880 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:53.015 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:53.016 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:53.017 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:53.017 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 85 k 2024-09-11T05:19:53.017 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 231 k 2024-09-11T05:19:53.017 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:53.199 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 468 kB/s | 85 kB 00:00 2024-09-11T05:19:53.199 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:53.200 INFO:teuthology.orchestra.run.smithi153.stdout:Total 465 kB/s | 85 kB 00:00 2024-09-11T05:19:53.200 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:53.206 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:53.207 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:19:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 1/12 2024-09-11T05:19:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:19:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:19:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T05:19:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T05:19:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T05:19:53.260 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T05:19:53.260 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T05:19:53.260 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T05:19:53.260 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:19:53.260 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T05:19:53.269 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:53.270 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:53.414 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:53.513 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:53.813 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T05:19:53.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:53.813 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:53.814 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:53.919 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:54.177 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:54.178 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:54.208 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-mgr-rook 2024-09-11T05:19:54.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-mirror 2024-09-11T05:19:54.805 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:19:54.945 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:19:54.946 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:19:54.946 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:54.946 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T05:19:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T05:19:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T05:19:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:54.948 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:19:54.948 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:19:54.948 INFO:teuthology.orchestra.run.smithi012.stdout:Install 13 Packages 2024-09-11T05:19:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:54.948 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 2.2 M 2024-09-11T05:19:54.949 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 26 M 2024-09-11T05:19:54.949 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:19:55.042 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:55.143 INFO:teuthology.orchestra.run.smithi012.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 227 kB/s | 26 kB 00:00 2024-09-11T05:19:55.168 INFO:teuthology.orchestra.run.smithi012.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 139 kB/s | 19 kB 00:00 2024-09-11T05:19:55.180 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:55.180 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:55.180 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:55.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:55.182 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 3.1 M 2024-09-11T05:19:55.182 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 13 M 2024-09-11T05:19:55.182 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:55.193 INFO:teuthology.orchestra.run.smithi012.stdout:(3/13): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el9. 302 kB/s | 49 kB 00:00 2024-09-11T05:19:55.286 INFO:teuthology.orchestra.run.smithi012.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-11T05:19:55.311 INFO:teuthology.orchestra.run.smithi012.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-11T05:19:55.345 INFO:teuthology.orchestra.run.smithi012.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-09-11T05:19:55.378 INFO:teuthology.orchestra.run.smithi012.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-11T05:19:55.403 INFO:teuthology.orchestra.run.smithi012.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 249 kB/s | 14 kB 00:00 2024-09-11T05:19:55.437 INFO:teuthology.orchestra.run.smithi012.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-09-11T05:19:55.471 INFO:teuthology.orchestra.run.smithi012.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-11T05:19:55.496 INFO:teuthology.orchestra.run.smithi012.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-11T05:19:55.527 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-mirror-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 9.0 MB/s | 3.1 MB 00:00 2024-09-11T05:19:55.528 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:55.528 INFO:teuthology.orchestra.run.smithi153.stdout:Total 8.9 MB/s | 3.1 MB 00:00 2024-09-11T05:19:55.529 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:55.538 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:55.538 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:55.538 INFO:teuthology.orchestra.run.smithi012.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-09-11T05:19:55.579 INFO:teuthology.orchestra.run.smithi012.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-09-11T05:19:55.582 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:55.582 INFO:teuthology.orchestra.run.smithi012.stdout:Total 3.5 MB/s | 2.2 MB 00:00 2024-09-11T05:19:55.618 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:55.618 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:55.649 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:19:55.665 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:19:55.665 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:19:55.764 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:19:55.765 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:19:56.057 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:56.128 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:56.154 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:56.154 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:19:56.155 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T05:19:56.155 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:19:56.155 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:19:56.155 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:56.410 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:19:56.586 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T05:19:56.642 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T05:19:56.706 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T05:19:56.745 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T05:19:56.791 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T05:19:56.898 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T05:19:57.008 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T05:19:57.060 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T05:19:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:57.302 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:57.497 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-nbd 2024-09-11T05:19:57.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T05:19:57.898 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T05:19:57.931 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T05:19:57.980 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T05:19:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:19:58.089 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:47 ago on Wed 11 Sep 2024 05:18:11 AM UTC. 2024-09-11T05:19:58.223 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 171 k 2024-09-11T05:19:58.224 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 494 k 2024-09-11T05:19:58.225 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-11T05:19:58.406 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 945 kB/s | 171 kB 00:00 2024-09-11T05:19:58.406 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:19:58.406 INFO:teuthology.orchestra.run.smithi153.stdout:Total 937 kB/s | 171 kB 00:00 2024-09-11T05:19:58.407 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-11T05:19:58.414 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-11T05:19:58.414 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-11T05:19:58.479 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-11T05:19:58.479 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-11T05:19:58.632 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-11T05:19:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:58.896 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:19:58.896 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 1/13 2024-09-11T05:19:58.896 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T05:19:58.896 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T05:19:58.896 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T05:19:58.897 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T05:19:58.897 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T05:19:58.897 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T05:19:58.897 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T05:19:58.897 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T05:19:58.897 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T05:19:58.897 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T05:19:58.898 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T05:19:59.137 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:59.234 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T05:19:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T05:19:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T05:19:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T05:19:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T05:19:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T05:19:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:19:59.236 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:19:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:19:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:59.380 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-11T05:19:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:19:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:19:59.380 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-11T05:19:59.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T05:19:59.601 DEBUG:teuthology.parallel:result is None 2024-09-11T05:20:00.091 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:45 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:00.232 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:00.232 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:20:00.232 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:00.233 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:00.234 INFO:teuthology.orchestra.run.smithi012.stdout:Install 6 Packages 2024-09-11T05:20:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:00.234 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 7.0 M 2024-09-11T05:20:00.234 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 33 M 2024-09-11T05:20:00.234 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:01.106 INFO:teuthology.orchestra.run.smithi012.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-11T05:20:01.156 INFO:teuthology.orchestra.run.smithi012.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T05:20:01.185 INFO:teuthology.orchestra.run.smithi012.stdout:(3/6): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e.el 672 kB/s | 146 kB 00:00 2024-09-11T05:20:01.199 INFO:teuthology.orchestra.run.smithi012.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2024-09-11T05:20:01.240 INFO:teuthology.orchestra.run.smithi012.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-11T05:20:02.449 INFO:teuthology.orchestra.run.smithi012.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-09-11T05:20:02.451 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:02.452 INFO:teuthology.orchestra.run.smithi012.stdout:Total 3.2 MB/s | 7.0 MB 00:02 2024-09-11T05:20:02.526 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:02.539 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:02.539 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:02.646 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:02.646 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:02.962 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T05:20:03.193 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T05:20:03.749 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T05:20:03.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T05:20:03.911 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T05:20:03.938 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:20:04.720 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:20:04.720 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/6 2024-09-11T05:20:04.720 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T05:20:04.720 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T05:20:04.720 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T05:20:04.720 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T05:20:04.999 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:05.000 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:05.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-fuse 2024-09-11T05:20:05.834 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:50 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:05.974 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:05.975 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:20:05.975 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:05.975 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T05:20:05.975 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-11T05:20:05.975 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T05:20:05.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:Install 2 Packages 2024-09-11T05:20:05.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 977 k 2024-09-11T05:20:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 2.9 M 2024-09-11T05:20:05.977 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:06.275 INFO:teuthology.orchestra.run.smithi012.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 314 kB/s | 80 kB 00:00 2024-09-11T05:20:06.309 INFO:teuthology.orchestra.run.smithi012.stdout:(2/2): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-11T05:20:06.309 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:06.309 INFO:teuthology.orchestra.run.smithi012.stdout:Total 2.9 MB/s | 977 kB 00:00 2024-09-11T05:20:06.321 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:06.344 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:06.344 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:06.430 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:06.431 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:06.637 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:06.774 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T05:20:06.844 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:20:07.483 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:20:07.483 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/2 2024-09-11T05:20:07.754 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T05:20:07.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:07.754 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:07.754 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T05:20:07.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:07.754 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:08.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-volume 2024-09-11T05:20:08.791 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:53 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:08.931 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:08.932 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:08.933 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:20:08.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:08.933 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 285 k 2024-09-11T05:20:08.933 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 1.3 M 2024-09-11T05:20:08.933 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:09.163 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-volume-19.1.1-298.gb53b6d3e.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-11T05:20:09.163 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:09.164 INFO:teuthology.orchestra.run.smithi012.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T05:20:09.164 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:09.173 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:09.173 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:09.204 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:09.204 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:20:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:20:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:20:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T05:20:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:20:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:10.590 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:20:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:10.590 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:10.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install librados-devel 2024-09-11T05:20:11.493 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:56 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:11.633 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:11.634 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repo Size 2024-09-11T05:20:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:11.634 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T05:20:11.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:20:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 127 k 2024-09-11T05:20:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 456 k 2024-09-11T05:20:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:11.826 INFO:teuthology.orchestra.run.smithi012.stdout:librados-devel-19.1.1-298.gb53b6d3e.el9.x86_64. 660 kB/s | 127 kB 00:00 2024-09-11T05:20:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:Total 655 kB/s | 127 kB 00:00 2024-09-11T05:20:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:11.833 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:11.833 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:11.901 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:11.902 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:12.060 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:20:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:12.906 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:13.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install libcephfs2 2024-09-11T05:20:13.733 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:58 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:13.826 INFO:teuthology.orchestra.run.smithi012.stdout:Package libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:20:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:13.873 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:20:13.873 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:13.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install libcephfs-devel 2024-09-11T05:20:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:59 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repo Size 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:20:14.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 32 k 2024-09-11T05:20:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 142 k 2024-09-11T05:20:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:libcephfs-devel-19.1.1-298.gb53b6d3e.el9.x86_64 212 kB/s | 32 kB 00:00 2024-09-11T05:20:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:Total 210 kB/s | 32 kB 00:00 2024-09-11T05:20:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:14.866 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:15.739 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:20:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:15.739 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:15.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install librados2 2024-09-11T05:20:16.528 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:01 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:16.622 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:20:16.667 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:16.668 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:20:16.669 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:16.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install librbd1 2024-09-11T05:20:17.337 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:02 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:20:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:17.478 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:20:17.478 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:17.546 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install python3-rados 2024-09-11T05:20:18.138 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:03 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:18.233 INFO:teuthology.orchestra.run.smithi012.stdout:Package python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:20:18.278 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:20:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:18.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install python3-rgw 2024-09-11T05:20:18.946 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:03 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:19.039 INFO:teuthology.orchestra.run.smithi012.stdout:Package python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:20:19.085 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:19.086 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:20:19.086 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:19.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install python3-cephfs 2024-09-11T05:20:19.746 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:04 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:19.842 INFO:teuthology.orchestra.run.smithi012.stdout:Package python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:20:19.888 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:19.889 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:20:19.889 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:19.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install python3-rbd 2024-09-11T05:20:20.551 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:05 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:20.645 INFO:teuthology.orchestra.run.smithi012.stdout:Package python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:20:20.692 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:20.693 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-11T05:20:20.693 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:20.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install rbd-fuse 2024-09-11T05:20:21.373 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:06 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:21.517 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 85 k 2024-09-11T05:20:21.519 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 231 k 2024-09-11T05:20:21.519 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:21.716 INFO:teuthology.orchestra.run.smithi012.stdout:rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 434 kB/s | 85 kB 00:00 2024-09-11T05:20:21.716 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:21.716 INFO:teuthology.orchestra.run.smithi012.stdout:Total 430 kB/s | 85 kB 00:00 2024-09-11T05:20:21.717 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:21.724 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:21.724 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:21.791 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:21.792 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:21.944 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:22.066 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:22.778 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:20:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:22.778 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:23.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install rbd-mirror 2024-09-11T05:20:23.644 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:08 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:23.785 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:23.785 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:23.785 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repo Size 2024-09-11T05:20:23.785 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:23.785 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:23.785 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T05:20:23.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:23.786 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:23.786 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:23.786 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:20:23.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:23.786 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 3.1 M 2024-09-11T05:20:23.786 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 13 M 2024-09-11T05:20:23.786 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:24.135 INFO:teuthology.orchestra.run.smithi012.stdout:rbd-mirror-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 8.9 MB/s | 3.1 MB 00:00 2024-09-11T05:20:24.136 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:24.136 INFO:teuthology.orchestra.run.smithi012.stdout:Total 8.9 MB/s | 3.1 MB 00:00 2024-09-11T05:20:24.137 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:24.147 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:24.147 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:24.232 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:24.232 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:24.685 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:24.744 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:24.771 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:24.771 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:20:24.771 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T05:20:24.772 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:20:24.772 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:20:24.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:26.029 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:26.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:26.029 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:26.030 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:20:26.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:26.030 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:26.314 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install rbd-nbd 2024-09-11T05:20:26.918 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Sep 2024 05:18:15 AM UTC. 2024-09-11T05:20:27.058 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-11T05:20:27.058 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout:Install 1 Package 2024-09-11T05:20:27.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:27.060 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 171 k 2024-09-11T05:20:27.060 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 494 k 2024-09-11T05:20:27.060 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-11T05:20:27.306 INFO:teuthology.orchestra.run.smithi012.stdout:rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 697 kB/s | 171 kB 00:00 2024-09-11T05:20:27.306 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:20:27.306 INFO:teuthology.orchestra.run.smithi012.stdout:Total 692 kB/s | 171 kB 00:00 2024-09-11T05:20:27.306 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-11T05:20:27.315 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-11T05:20:27.315 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-11T05:20:27.383 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-11T05:20:27.384 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-11T05:20:27.544 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-11T05:20:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:28.083 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:28.360 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:20:28.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:28.360 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-11T05:20:28.360 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:20:28.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:28.360 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-11T05:20:28.601 DEBUG:teuthology.parallel:result is None 2024-09-11T05:20:28.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:20:28.742 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T05:20:28.765 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T05:20:28.765 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T05:20:28.765 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T05:20:28.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:20:28.911 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T05:20:28.938 INFO:teuthology.orchestra.run.smithi153.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T05:20:28.938 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T05:20:28.938 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T05:20:28.940 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T05:20:28.940 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:28.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T05:20:28.968 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:20:28.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T05:20:29.009 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T05:20:29.009 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:29.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T05:20:29.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T05:20:29.101 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:20:29.101 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T05:20:29.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T05:20:29.208 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T05:20:29.209 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:29.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T05:20:29.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T05:20:29.311 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:20:29.311 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T05:20:29.336 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T05:20:29.402 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T05:20:29.402 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:29.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T05:20:29.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T05:20:29.495 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:20:29.495 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T05:20:29.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T05:20:29.587 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T05:20:29.666 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T05:20:29.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2024-09-11T05:20:29.669 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-11T05:20:29.693 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T05:20:29.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T05:20:29.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T05:20:29.759 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T05:20:29.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T05:20:29.800 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T05:20:29.835 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T05:20:29.835 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T05:20:29.835 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900547', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6175, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '88/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae', 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVvtnpbNXFXYvY5DTYIQkcQ2Jp8iZgWWI4jBWYZI4QYIYqcaaatmFTojX8jcFs+96h+S7WBioMHFYYN+CD94yI=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF77cX9JEY8PNTTmn8xT5W8l7+qXGMSuOJm6TAX/XbwP/rB7YhqS1ZGk1mUERLneISohDax3Wdf4zpo/MLfGcPM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_21:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T05:20:29.836 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T05:20:29.866 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T05:20:29.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T05:20:29.922 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T05:20:29.947 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:29.947 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T05:20:30.005 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T05:20:30.005 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 05:20:25.013008754 +0000 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 05:17:35.491537356 +0000 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 05:17:35.491537356 +0000 2024-09-11T05:20:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-11 05:17:35.491537356 +0000 2024-09-11T05:20:30.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T05:20:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T05:20:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T05:20:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000254238 s, 2.0 MB/s 2024-09-11T05:20:30.126 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T05:20:30.183 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-11T05:20:30.238 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 05:20:25.014008745 +0000 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 05:17:35.826534497 +0000 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 05:17:35.826534497 +0000 2024-09-11T05:20:30.239 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-11 05:17:35.826534497 +0000 2024-09-11T05:20:30.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T05:20:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T05:20:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T05:20:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000194039 s, 2.6 MB/s 2024-09-11T05:20:30.304 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T05:20:30.361 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-11T05:20:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T05:20:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:30.418 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T05:20:30.418 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:30.419 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:30.419 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 05:20:25.014008745 +0000 2024-09-11T05:20:30.419 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 05:17:36.159531655 +0000 2024-09-11T05:20:30.419 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 05:17:36.159531655 +0000 2024-09-11T05:20:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-11 05:17:36.159531655 +0000 2024-09-11T05:20:30.419 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T05:20:30.486 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T05:20:30.486 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T05:20:30.486 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000213703 s, 2.4 MB/s 2024-09-11T05:20:30.486 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T05:20:30.542 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-11T05:20:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T05:20:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:30.598 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T05:20:30.598 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:30.599 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:30.599 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 05:20:25.014008745 +0000 2024-09-11T05:20:30.599 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 05:17:36.483528890 +0000 2024-09-11T05:20:30.599 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 05:17:36.483528890 +0000 2024-09-11T05:20:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-11 05:17:36.483528890 +0000 2024-09-11T05:20:30.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T05:20:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T05:20:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T05:20:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000193399 s, 2.6 MB/s 2024-09-11T05:20:30.664 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T05:20:30.721 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:30.721 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:20:30.721 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T05:20:30.738 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T05:20:30.738 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-11T05:20:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T05:20:30.793 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:30.793 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T05:20:30.794 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:30.794 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:30.794 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-11 05:19:56.435059758 +0000 2024-09-11T05:20:30.794 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-11 05:17:30.501220997 +0000 2024-09-11T05:20:30.794 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-11 05:17:30.501220997 +0000 2024-09-11T05:20:30.794 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-11 05:17:30.501220997 +0000 2024-09-11T05:20:30.794 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T05:20:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-11T05:20:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-11T05:20:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00024925 s, 2.1 MB/s 2024-09-11T05:20:30.857 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T05:20:30.913 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-11T05:20:30.968 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T05:20:30.968 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:30.968 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T05:20:30.968 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:30.968 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:30.968 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-11 05:19:56.435059758 +0000 2024-09-11T05:20:30.969 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-11 05:17:30.837214744 +0000 2024-09-11T05:20:30.969 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-11 05:17:30.837214744 +0000 2024-09-11T05:20:30.969 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-11 05:17:30.837214744 +0000 2024-09-11T05:20:30.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T05:20:31.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-11T05:20:31.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-11T05:20:31.032 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000201653 s, 2.5 MB/s 2024-09-11T05:20:31.033 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T05:20:31.089 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-11T05:20:31.144 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T05:20:31.144 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:31.144 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T05:20:31.144 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:31.144 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:31.145 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-11 05:19:56.435059758 +0000 2024-09-11T05:20:31.145 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-11 05:17:31.170208546 +0000 2024-09-11T05:20:31.145 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-11 05:17:31.170208546 +0000 2024-09-11T05:20:31.145 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-11 05:17:31.170208546 +0000 2024-09-11T05:20:31.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T05:20:31.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-11T05:20:31.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-11T05:20:31.207 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00019015 s, 2.7 MB/s 2024-09-11T05:20:31.209 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T05:20:31.265 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-11 05:19:56.436059740 +0000 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-11 05:17:31.495202498 +0000 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-11 05:17:31.495202498 +0000 2024-09-11T05:20:31.321 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-11 05:17:31.495202498 +0000 2024-09-11T05:20:31.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T05:20:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-11T05:20:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-11T05:20:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000213562 s, 2.4 MB/s 2024-09-11T05:20:31.386 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T05:20:31.442 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:31.442 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T05:20:31.442 INFO:tasks.ceph:Generating config... 2024-09-11T05:20:31.443 INFO:tasks.ceph:[client] rbd cache = True 2024-09-11T05:20:31.444 INFO:tasks.ceph:[client] rbd cache policy = writearound 2024-09-11T05:20:31.444 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-11T05:20:31.444 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-11T05:20:31.444 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-11T05:20:31.444 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T05:20:31.444 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T05:20:31.444 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T05:20:31.444 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T05:20:31.444 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T05:20:31.444 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T05:20:31.445 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T05:20:31.446 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T05:20:31.446 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-11T05:20:31.446 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T05:20:31.446 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T05:20:31.446 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T05:20:31.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T05:20:31.502 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T05:20:31.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T05:20:31.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T05:20:31.582 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.c', '[v2:172.21.15.12:3301,v1:172.21.15.12:6790]'), ('mon.b', '172.21.15.153')] 2024-09-11T05:20:31.583 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,[v2:172.21.15.12:3301,v1:172.21.15.12:6790],172.21.15.153', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache policy': 'writearound'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-11T05:20:31.584 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:31.584 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T05:20:31.639 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --addv c '[v2:172.21.15.12:3301,v1:172.21.15.12:6790]' --add b 172.21.15.153 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:31.727 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 5fd14db5-8ee9-4e34-bd57-a8040293ab17 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 5fd14db5-8ee9-4e34-bd57-a8040293ab17 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2024-09-11T05:20:31.727886+0000 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-11T05:20:31.727886+0000 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 17 (quincy) 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2024-09-11T05:20:31.728 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T05:20:31.730 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T05:20:31.745 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5fd14db5-8ee9-4e34-bd57-a8040293ab17... 2024-09-11T05:20:31.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T05:20:31.787 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.830 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2024-09-11T05:20:31.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,[v2:172.21.15.12:3301,v1:172.21.15.12:6790],172.21.15.153" 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: mon client directed command retry = 5 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on pool no app = False 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject socket failures = 5000 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 5fd14db5-8ee9-4e34-bd57-a8040293ab17 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2024-09-11T05:20:31.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug trim objects = true 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2024-09-11T05:20:31.833 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: bluefs allocator = hybrid 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = hybrid 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2024-09-11T05:20:31.834 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: osd blocked scrub grace period = 3600 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: osd max markdown count = 1000 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: osd shutdown pgref assert = True 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2024-09-11T05:20:31.835 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2024-09-11T05:20:31.836 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2024-09-11T05:20:31.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: rbd cache = True 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout: rbd cache policy = writearound 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2024-09-11T05:20:31.838 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-11T05:20:31.839 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.840 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.841 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.12,[v2:172.21.15.12:3301,v1:172.21.15.12:6790],172.21.15.153" 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: mon client directed command retry = 5 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on pool no app = False 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject socket failures = 5000 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 5fd14db5-8ee9-4e34-bd57-a8040293ab17 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.842 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-11T05:20:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: bluefs allocator = hybrid 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = hybrid 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-09-11T05:20:31.844 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: osd blocked scrub grace period = 3600 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: osd max markdown count = 1000 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: osd shutdown pgref assert = True 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-11T05:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:20:31.846 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-11T05:20:31.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: rbd cache = True 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: rbd cache policy = writearound 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-11T05:20:31.848 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-11T05:20:31.850 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T05:20:31.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T05:20:31.946 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T05:20:31.946 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:31.946 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T05:20:31.962 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:31.962 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T05:20:32.017 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:20:32.018 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:32.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T05:20:32.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T05:20:32.095 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:20:32.095 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:32.152 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:20:32.152 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:20:32.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T05:20:32.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T05:20:32.187 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:20:32.187 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:32.242 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T05:20:32.243 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T05:20:32.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T05:20:32.295 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T05:20:32.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T05:20:32.367 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T05:20:32.369 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T05:20:32.370 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T05:20:32.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T05:20:32.412 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T05:20:32.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T05:20:32.466 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T05:20:32.479 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T05:20:32.479 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T05:20:32.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T05:20:32.504 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:32.504 INFO:tasks.ceph:role: osd.0 2024-09-11T05:20:32.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:20:32.505 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:32.578 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:33.084 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-11T05:20:33.086 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-11T05:20:33.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T05:20:33.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T05:20:33.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T05:20:33.336 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:33.336 INFO:tasks.ceph:role: osd.1 2024-09-11T05:20:33.337 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:20:33.337 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T05:20:33.410 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:33.411 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:33.855 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-11T05:20:33.858 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-11T05:20:33.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T05:20:33.949 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T05:20:33.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T05:20:34.045 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:34.045 INFO:tasks.ceph:role: osd.2 2024-09-11T05:20:34.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:20:34.045 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T05:20:34.118 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:34.118 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:34.119 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:34.119 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:34.119 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:34.598 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-11T05:20:34.600 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-11T05:20:34.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T05:20:34.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T05:20:34.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T05:20:34.851 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:34.851 INFO:tasks.ceph:role: osd.3 2024-09-11T05:20:34.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:20:34.851 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:34.924 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:35.444 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-11T05:20:35.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-11T05:20:35.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T05:20:35.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T05:20:35.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:35.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:35.739+0000 7f24ae1fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T05:20:35.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:35.740+0000 7f24ae1fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T05:20:35.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:35.740+0000 7f24ae1fd640 -1 bdev(0x55d7b35ed800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T05:20:35.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:35.740+0000 7f24ae1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T05:20:38.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T05:20:38.688 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:38.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:38.779+0000 7fa186019640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T05:20:38.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:38.779+0000 7fa186019640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T05:20:38.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:38.779+0000 7fa186019640 -1 bdev(0x561f53b77800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T05:20:38.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:38.779+0000 7fa186019640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T05:20:42.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T05:20:42.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:42.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:42.314+0000 7f1574e33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T05:20:42.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:42.314+0000 7f1574e33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T05:20:42.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:42.314+0000 7f1574e33640 -1 bdev(0x56151d5c7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T05:20:42.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:42.315+0000 7f1574e33640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T05:20:45.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T05:20:45.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:45.592+0000 7f207ea2f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T05:20:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:45.592+0000 7f207ea2f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T05:20:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:45.593+0000 7f207ea2f640 -1 bdev(0x55b527b79800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T05:20:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:20:45.593+0000 7f207ea2f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T05:20:49.005 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T05:20:49.036 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T05:20:49.067 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:49.067 INFO:tasks.ceph:role: osd.4 2024-09-11T05:20:49.067 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:20:49.067 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:49.633 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-11T05:20:49.636 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-11T05:20:49.636 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T05:20:49.772 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T05:20:49.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T05:20:49.878 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:49.878 INFO:tasks.ceph:role: osd.5 2024-09-11T05:20:49.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:20:49.879 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T05:20:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:50.434 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-11T05:20:50.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-11T05:20:50.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T05:20:50.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T05:20:50.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T05:20:50.624 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:50.624 INFO:tasks.ceph:role: osd.6 2024-09-11T05:20:50.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:20:50.625 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T05:20:50.697 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:50.697 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:50.697 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:50.698 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:50.698 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:50.698 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-11T05:20:51.224 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-11T05:20:51.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T05:20:51.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T05:20:51.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T05:20:51.458 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:20:51.458 INFO:tasks.ceph:role: osd.7 2024-09-11T05:20:51.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:20:51.458 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T05:20:51.531 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:20:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:20:52.055 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-11T05:20:52.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-11T05:20:52.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T05:20:52.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T05:20:52.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:52.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:52.311+0000 7fc6c1120640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T05:20:52.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:52.311+0000 7fc6c1120640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T05:20:52.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:52.312+0000 7fc6c1120640 -1 bdev(0x564c84f13800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T05:20:52.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:52.312+0000 7fc6c1120640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T05:20:55.219 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T05:20:55.249 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:55.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:55.336+0000 7f492763e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T05:20:55.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:55.337+0000 7f492763e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T05:20:55.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:55.337+0000 7f492763e640 -1 bdev(0x563b15279800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T05:20:55.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:55.337+0000 7f492763e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T05:20:58.499 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T05:20:58.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:20:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:58.618+0000 7ff328c1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T05:20:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:58.618+0000 7ff328c1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T05:20:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:58.618+0000 7ff328c1e640 -1 bdev(0x5621a9e5b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T05:20:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:20:58.618+0000 7ff328c1e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T05:21:02.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T05:21:02.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:21:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:21:02.144+0000 7ffafdc40640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T05:21:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:21:02.144+0000 7ffafdc40640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T05:21:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:21:02.144+0000 7ffafdc40640 -1 bdev(0x564cd03af800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T05:21:02.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-11T05:21:02.145+0000 7ffafdc40640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T05:21:05.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T05:21:05.345 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T05:21:05.345 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:05.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T05:21:05.377 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:05.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T05:21:05.446 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:05.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T05:21:05.516 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:05.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T05:21:05.583 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:05.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T05:21:05.650 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:05.650 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T05:21:05.679 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:05.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T05:21:05.747 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:05.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T05:21:05.816 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:05.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T05:21:05.883 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:05.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T05:21:05.950 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:05.950 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T05:21:05.967 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:05.967 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T05:21:06.007 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T05:21:06.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T05:21:06.009 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T05:21:06.050 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2024-09-11T05:21:06.050 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgKOFm9e2kERAAy4gjHP38axD47iyKxJIIsw== 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCjKOFmVpYvLBAAQkL9D2ID/51OFLT5Gb5qaw== 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCmKOFmYPSILhAA5xJ3LWG1zPf4Vgy6UWnuwg== 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCqKOFmJijXEhAANOe+P9H1a/+q33Ae4Ul//Q== 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCtKOFmQYxqIxAAAstXyOqwyyjeM/jv/TJN8g== 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgKOFmRQLtFRAApLD9zhpLENMn3NsHioCGIA== 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC0KOFm3RuiEhAATVLuOcU8S0l5rxX7BDnxpg== 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2024-09-11T05:21:06.051 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC3KOFmwB0zFBAAzIgbO/su7462cUNdK6yPPQ== 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC6KOFmwBvrJBAA+tBIAhI3xH4GeSHr5gYRxw== 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC+KOFmiSStCBAABwLMcbDargk4FV7GUyTxQw== 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgKOFmBJ2cGBAAnD9qjWHqgzsKpoegCLk7nQ== 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2024-09-11T05:21:06.052 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgKOFmgAjTGxAAVcUB8yA1kXvEr9d3rIldCQ== 2024-09-11T05:21:06.071 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-09-11T05:21:06.071 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCgKOFm9e2kERAAy4gjHP38axD47iyKxJIIsw== 2024-09-11T05:21:06.071 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCjKOFmVpYvLBAAQkL9D2ID/51OFLT5Gb5qaw== 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCmKOFmYPSILhAA5xJ3LWG1zPf4Vgy6UWnuwg== 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCqKOFmJijXEhAANOe+P9H1a/+q33Ae4Ul//Q== 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCtKOFmQYxqIxAAAstXyOqwyyjeM/jv/TJN8g== 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCgKOFmRQLtFRAApLD9zhpLENMn3NsHioCGIA== 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQC0KOFm3RuiEhAATVLuOcU8S0l5rxX7BDnxpg== 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-09-11T05:21:06.072 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQC3KOFmwB0zFBAAzIgbO/su7462cUNdK6yPPQ== 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQC6KOFmwBvrJBAA+tBIAhI3xH4GeSHr5gYRxw== 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQC+KOFmiSStCBAABwLMcbDargk4FV7GUyTxQw== 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCgKOFmBJ2cGBAAnD9qjWHqgzsKpoegCLk7nQ== 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-09-11T05:21:06.073 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCgKOFmgAjTGxAAVcUB8yA1kXvEr9d3rIldCQ== 2024-09-11T05:21:06.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:21:06.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:21:06.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.168 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.221 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.326 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:21:06.379 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:21:06.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.488 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:21:06.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:21:06.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:21:06.701 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:21:06.703 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:21:06.757 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T05:21:06.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T05:21:06.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T05:21:06.882 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T05:21:06.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T05:21:06.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T05:21:07.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T05:21:07.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T05:21:07.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T05:21:07.218 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T05:21:07.244 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:21:07.246 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:21:07.299 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T05:21:07.299 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T05:21:07.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T05:21:07.302 INFO:tasks.ceph.mon.a:Started 2024-09-11T05:21:07.302 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T05:21:07.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T05:21:07.304 INFO:tasks.ceph.mon.c:Started 2024-09-11T05:21:07.304 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T05:21:07.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T05:21:07.341 INFO:tasks.ceph.mon.b:Started 2024-09-11T05:21:07.342 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T05:21:07.342 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T05:21:07.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T05:21:07.344 INFO:tasks.ceph.mgr.y:Started 2024-09-11T05:21:07.344 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T05:21:07.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T05:21:07.346 INFO:tasks.ceph.mgr.x:Started 2024-09-11T05:21:07.347 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T05:21:07.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T05:21:13.527 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:13.526+0000 7f51ef818040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T05:21:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-11T05:21:13.549 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T05:21:13.549 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T05:21:13.549 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:13.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T05:21:13.550 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:13.548+0000 7f395dfd4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T05:21:13.568 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:13.568+0000 7f51ef818040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T05:21:13.576 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:13.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T05:21:13.594 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:13.593+0000 7f395dfd4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T05:21:13.620 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:13.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T05:21:13.685 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T05:21:13.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T05:21:13.714 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:13.713+0000 7f51ef818040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T05:21:13.746 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:13.745+0000 7f395dfd4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T05:21:13.751 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:13.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T05:21:13.768 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:13.768+0000 7f51ef818040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T05:21:13.776 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:13.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T05:21:13.799 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:13.798+0000 7f395dfd4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T05:21:13.842 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:13.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T05:21:13.906 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-11T05:21:13.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T05:21:13.933 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:13.933+0000 7f51ef818040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:21:13.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new e628e137-3e68-4084-a084-200022b8da35 0 2024-09-11T05:21:13.967 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:13.966+0000 7f395dfd4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:21:14.050 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:14.049+0000 7f51ef818040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T05:21:14.082 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:14.081+0000 7f395dfd4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T05:21:14.182 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-09-11T05:21:14.193 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 26db6fe3-81d0-40ae-a4e1-9a7460fabc2c 1 2024-09-11T05:21:14.375 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-11T05:21:14.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 00ff2990-a7cb-48a2-ab03-6739942d65d7 2 2024-09-11T05:21:14.396 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:14.395+0000 7f51ef818040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T05:21:14.423 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:14.422+0000 7f395dfd4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T05:21:14.445 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:14.445+0000 7f51ef818040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T05:21:14.475 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:14.474+0000 7f395dfd4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T05:21:14.571 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-09-11T05:21:14.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new d1c858fd-7b66-4e1b-aa18-e3fd567e1417 3 2024-09-11T05:21:14.602 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:14.602+0000 7f51ef818040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T05:21:14.634 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:14.633+0000 7f395dfd4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T05:21:14.786 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-09-11T05:21:14.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 586534a4-d5e3-4af4-a2e5-aa4ec052b582 4 2024-09-11T05:21:14.981 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-09-11T05:21:14.993 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 801041dc-7a4c-4776-bfbb-68be37655407 5 2024-09-11T05:21:15.175 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-09-11T05:21:15.186 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new e0820ac1-b43f-486f-9d7b-155b46b33950 6 2024-09-11T05:21:15.368 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-09-11T05:21:15.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new e22fdfda-9a13-42f2-be4f-f7c6e0ffd324 7 2024-09-11T05:21:15.562 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-11T05:21:15.574 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T05:21:15.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T05:21:15.576 INFO:tasks.ceph.osd.0:Started 2024-09-11T05:21:15.576 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T05:21:15.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T05:21:15.579 INFO:tasks.ceph.osd.1:Started 2024-09-11T05:21:15.579 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T05:21:15.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T05:21:15.581 INFO:tasks.ceph.osd.2:Started 2024-09-11T05:21:15.581 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T05:21:15.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T05:21:15.584 INFO:tasks.ceph.osd.3:Started 2024-09-11T05:21:15.584 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T05:21:15.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T05:21:15.586 INFO:tasks.ceph.osd.4:Started 2024-09-11T05:21:15.586 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T05:21:15.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T05:21:15.588 INFO:tasks.ceph.osd.5:Started 2024-09-11T05:21:15.588 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T05:21:15.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T05:21:15.591 INFO:tasks.ceph.osd.6:Started 2024-09-11T05:21:15.591 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T05:21:15.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T05:21:15.593 INFO:tasks.ceph.osd.7:Started 2024-09-11T05:21:15.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:21:15.623 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:15.623+0000 7f51ef818040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T05:21:15.667 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:15.666+0000 7f395dfd4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T05:21:15.694 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:15.693+0000 7f51ef818040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T05:21:15.736 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:15.735+0000 7f395dfd4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T05:21:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:15.791 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:21:15.558170+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T05:21:15.558170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:21:15.803 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T05:21:15.803 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T05:21:16.062 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.061+0000 7f51ef818040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T05:21:16.123 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.122+0000 7f395dfd4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T05:21:16.146 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.145+0000 7f51ef818040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T05:21:16.211 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.210+0000 7f395dfd4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T05:21:16.253 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.253+0000 7f51ef818040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:21:16.300 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.300+0000 7f51ef818040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T05:21:16.323 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.322+0000 7f395dfd4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:21:16.371 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.370+0000 7f395dfd4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T05:21:16.412 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.412+0000 7f51ef818040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T05:21:16.465 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.465+0000 7f51ef818040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T05:21:16.489 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.488+0000 7f395dfd4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T05:21:16.511 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.511+0000 7f51ef818040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T05:21:16.544 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.543+0000 7f395dfd4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T05:21:16.572 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:16.571+0000 7f7e71019640 -1 Falling back to public interface 2024-09-11T05:21:16.592 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.591+0000 7f395dfd4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T05:21:16.607 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T05:21:16.623 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.622+0000 7f51ef818040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T05:21:16.673 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.673+0000 7f51ef818040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T05:21:16.716 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.715+0000 7f395dfd4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T05:21:16.725 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.724+0000 7f51ef818040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T05:21:16.768 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:16.767+0000 7f5eac418640 -1 Falling back to public interface 2024-09-11T05:21:16.768 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.767+0000 7f395dfd4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T05:21:16.772 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-11T05:21:16.772 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:21:15.558170+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T05:21:15.558170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:21:16.782 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T05:21:16.794 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.793+0000 7f51ef818040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T05:21:16.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:16.802+0000 7f6319e13640 -1 Falling back to public interface 2024-09-11T05:21:16.823 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.822+0000 7f395dfd4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T05:21:16.839 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.838+0000 7f51ef818040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T05:21:16.882 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:16.881+0000 7f51ef818040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T05:21:16.894 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.893+0000 7f395dfd4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T05:21:16.940 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.939+0000 7f395dfd4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T05:21:16.986 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:16.985+0000 7f395dfd4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T05:21:17.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:17.039+0000 7f50512eb640 -1 Falling back to public interface 2024-09-11T05:21:17.054 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:17.053+0000 7f13a1758640 -1 Falling back to public interface 2024-09-11T05:21:17.072 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:17.069+0000 7f15595a8640 -1 Falling back to public interface 2024-09-11T05:21:17.313 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:17.312+0000 7fc69d1dd640 -1 Falling back to public interface 2024-09-11T05:21:17.527 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:17.526+0000 7f51ef818040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T05:21:17.565 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:17.565+0000 7f2ac082a640 -1 Falling back to public interface 2024-09-11T05:21:17.675 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-11T05:21:17.674+0000 7f395dfd4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T05:21:18.545 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:18.545+0000 7f518f49b640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T05:21:18.546 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-09-11T05:21:18.546+0000 7f518f49b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T05:21:20.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:20.785+0000 7f50512eb640 -1 osd.1 0 log_to_monitors true 2024-09-11T05:21:20.788 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:20.787+0000 7f5eac418640 -1 osd.4 0 log_to_monitors true 2024-09-11T05:21:20.868 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:20.867+0000 7f15595a8640 -1 osd.2 0 log_to_monitors true 2024-09-11T05:21:20.894 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:20.893+0000 7f7e71019640 -1 osd.3 0 log_to_monitors true 2024-09-11T05:21:20.899 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:20.898+0000 7f6319e13640 -1 osd.0 0 log_to_monitors true 2024-09-11T05:21:20.907 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:20.907+0000 7f13a1758640 -1 osd.7 0 log_to_monitors true 2024-09-11T05:21:21.094 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:21.093+0000 7f2ac082a640 -1 osd.6 0 log_to_monitors true 2024-09-11T05:21:21.175 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:21.174+0000 7fc69d1dd640 -1 osd.5 0 log_to_monitors true 2024-09-11T05:21:23.588 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T05:21:23.911 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-11T05:21:23.911 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":12,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:21:22.646791+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T05:21:15.558170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:21:23.922 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T05:21:24.727 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:24.727+0000 7fc699980640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T05:21:24.746 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:24.746+0000 7fc690f8c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:24.858 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:24.857+0000 7f7e6d11a640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T05:21:24.872 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:24.871+0000 7f7e64726640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:24.897 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:24.896+0000 7f1555537640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T05:21:24.913 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:24.912+0000 7f154d357640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:24.928 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:24.927+0000 7f2abc7b9640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T05:21:24.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:24.932+0000 7f504d27a640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T05:21:24.941 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:24.941+0000 7f2ab45d9640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:24.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:24.944+0000 7f504509a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:24.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:24.958+0000 7f6315706640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T05:21:24.959 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:24.959+0000 7f139defb640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T05:21:24.962 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:24.962+0000 7f5ea7d7a640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T05:21:24.973 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:24.973+0000 7f1395507640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:24.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:24.974+0000 7f630d526640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:24.977 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:24.977+0000 7f5e9fb9a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:21:30.728 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T05:21:31.024 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-11T05:21:31.024 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":17,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:21:29.746634+0000","last_up_change":"2024-09-11T05:21:25.731933+0000","last_in_change":"2024-09-11T05:21:15.558170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:21:27.582783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6809","nonce":2997410357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6811","nonce":2997410357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6815","nonce":2997410357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6813","nonce":2997410357}]},"public_addr":"172.21.15.12:6809/2997410357","cluster_addr":"172.21.15.12:6811/2997410357","heartbeat_back_addr":"172.21.15.12:6815/2997410357","heartbeat_front_addr":"172.21.15.12:6813/2997410357","state":["exists","up"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6817","nonce":852655937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6819","nonce":852655937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6823","nonce":852655937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6821","nonce":852655937}]},"public_addr":"172.21.15.12:6817/852655937","cluster_addr":"172.21.15.12:6819/852655937","heartbeat_back_addr":"172.21.15.12:6823/852655937","heartbeat_front_addr":"172.21.15.12:6821/852655937","state":["exists","up"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6825","nonce":3485488459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6827","nonce":3485488459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6831","nonce":3485488459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6829","nonce":3485488459}]},"public_addr":"172.21.15.12:6825/3485488459","cluster_addr":"172.21.15.12:6827/3485488459","heartbeat_back_addr":"172.21.15.12:6831/3485488459","heartbeat_front_addr":"172.21.15.12:6829/3485488459","state":["exists","up"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6801","nonce":2211289880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6803","nonce":2211289880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6807","nonce":2211289880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6805","nonce":2211289880}]},"public_addr":"172.21.15.12:6801/2211289880","cluster_addr":"172.21.15.12:6803/2211289880","heartbeat_back_addr":"172.21.15.12:6807/2211289880","heartbeat_front_addr":"172.21.15.12:6805/2211289880","state":["exists","up"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6801","nonce":1639325236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6803","nonce":1639325236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6807","nonce":1639325236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6805","nonce":1639325236}]},"public_addr":"172.21.15.153:6801/1639325236","cluster_addr":"172.21.15.153:6803/1639325236","heartbeat_back_addr":"172.21.15.153:6807/1639325236","heartbeat_front_addr":"172.21.15.153:6805/1639325236","state":["exists","up"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6817","nonce":2370940838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6819","nonce":2370940838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6823","nonce":2370940838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6821","nonce":2370940838}]},"public_addr":"172.21.15.153:6817/2370940838","cluster_addr":"172.21.15.153:6819/2370940838","heartbeat_back_addr":"172.21.15.153:6823/2370940838","heartbeat_front_addr":"172.21.15.153:6821/2370940838","state":["exists","up"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6827","nonce":1798055911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6829","nonce":1798055911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6833","nonce":1798055911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6831","nonce":1798055911}]},"public_addr":"172.21.15.153:6827/1798055911","cluster_addr":"172.21.15.153:6829/1798055911","heartbeat_back_addr":"172.21.15.153:6833/1798055911","heartbeat_front_addr":"172.21.15.153:6831/1798055911","state":["exists","up"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6809","nonce":1122624549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6811","nonce":1122624549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6815","nonce":1122624549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6813","nonce":1122624549}]},"public_addr":"172.21.15.153:6809/1122624549","cluster_addr":"172.21.15.153:6811/1122624549","heartbeat_back_addr":"172.21.15.153:6815/1122624549","heartbeat_front_addr":"172.21.15.153:6813/1122624549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.912439+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.788769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.857319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.926699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.752975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.222079+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.095040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.860946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:21:31.035 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T05:21:31.035 INFO:tasks.ceph:Creating RBD pool 2024-09-11T05:21:31.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T05:21:31.761 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2024-09-11T05:21:31.777 DEBUG:teuthology.orchestra.run.smithi012:> rbd --cluster ceph pool init rbd 2024-09-11T05:21:34.801 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T05:21:34.801 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T05:21:34.801 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T05:21:34.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T05:21:34.802 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T05:21:35.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:35.165 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":834095032},{"type":"v1","addr":"172.21.15.153:6825","nonce":834095032}]},"active_addr":"172.21.15.153:6825/834095032","active_change":"2024-09-11T05:21:17.529665+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":1557128275}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":3863171997}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":1769947648}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":3360832259}]}]} 2024-09-11T05:21:35.169 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T05:21:35.169 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T05:21:35.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:21:35.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:35.458 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:21:34.778118+0000","last_up_change":"2024-09-11T05:21:25.731933+0000","last_in_change":"2024-09-11T05:21:15.558170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:21:27.582783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:21:31.353652+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6809","nonce":2997410357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6811","nonce":2997410357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6815","nonce":2997410357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6813","nonce":2997410357}]},"public_addr":"172.21.15.12:6809/2997410357","cluster_addr":"172.21.15.12:6811/2997410357","heartbeat_back_addr":"172.21.15.12:6815/2997410357","heartbeat_front_addr":"172.21.15.12:6813/2997410357","state":["exists","up"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6817","nonce":852655937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6819","nonce":852655937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6823","nonce":852655937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6821","nonce":852655937}]},"public_addr":"172.21.15.12:6817/852655937","cluster_addr":"172.21.15.12:6819/852655937","heartbeat_back_addr":"172.21.15.12:6823/852655937","heartbeat_front_addr":"172.21.15.12:6821/852655937","state":["exists","up"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6825","nonce":3485488459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6827","nonce":3485488459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6831","nonce":3485488459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6829","nonce":3485488459}]},"public_addr":"172.21.15.12:6825/3485488459","cluster_addr":"172.21.15.12:6827/3485488459","heartbeat_back_addr":"172.21.15.12:6831/3485488459","heartbeat_front_addr":"172.21.15.12:6829/3485488459","state":["exists","up"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6801","nonce":2211289880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6803","nonce":2211289880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6807","nonce":2211289880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6805","nonce":2211289880}]},"public_addr":"172.21.15.12:6801/2211289880","cluster_addr":"172.21.15.12:6803/2211289880","heartbeat_back_addr":"172.21.15.12:6807/2211289880","heartbeat_front_addr":"172.21.15.12:6805/2211289880","state":["exists","up"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6801","nonce":1639325236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6803","nonce":1639325236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6807","nonce":1639325236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6805","nonce":1639325236}]},"public_addr":"172.21.15.153:6801/1639325236","cluster_addr":"172.21.15.153:6803/1639325236","heartbeat_back_addr":"172.21.15.153:6807/1639325236","heartbeat_front_addr":"172.21.15.153:6805/1639325236","state":["exists","up"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6817","nonce":2370940838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6819","nonce":2370940838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6823","nonce":2370940838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6821","nonce":2370940838}]},"public_addr":"172.21.15.153:6817/2370940838","cluster_addr":"172.21.15.153:6819/2370940838","heartbeat_back_addr":"172.21.15.153:6823/2370940838","heartbeat_front_addr":"172.21.15.153:6821/2370940838","state":["exists","up"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6827","nonce":1798055911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6829","nonce":1798055911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6833","nonce":1798055911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6831","nonce":1798055911}]},"public_addr":"172.21.15.153:6827/1798055911","cluster_addr":"172.21.15.153:6829/1798055911","heartbeat_back_addr":"172.21.15.153:6833/1798055911","heartbeat_front_addr":"172.21.15.153:6831/1798055911","state":["exists","up"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6809","nonce":1122624549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6811","nonce":1122624549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6815","nonce":1122624549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6813","nonce":1122624549}]},"public_addr":"172.21.15.153:6809/1122624549","cluster_addr":"172.21.15.153:6811/1122624549","heartbeat_back_addr":"172.21.15.153:6815/1122624549","heartbeat_front_addr":"172.21.15.153:6813/1122624549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.912439+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.788769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.857319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.926699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.752975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.222079+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.095040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.860946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:21:35.471 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T05:21:35.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:21:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:35.767 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:21:34.778118+0000","last_up_change":"2024-09-11T05:21:25.731933+0000","last_in_change":"2024-09-11T05:21:15.558170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:21:27.582783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:21:31.353652+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6809","nonce":2997410357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6811","nonce":2997410357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6815","nonce":2997410357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6813","nonce":2997410357}]},"public_addr":"172.21.15.12:6809/2997410357","cluster_addr":"172.21.15.12:6811/2997410357","heartbeat_back_addr":"172.21.15.12:6815/2997410357","heartbeat_front_addr":"172.21.15.12:6813/2997410357","state":["exists","up"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6817","nonce":852655937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6819","nonce":852655937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6823","nonce":852655937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6821","nonce":852655937}]},"public_addr":"172.21.15.12:6817/852655937","cluster_addr":"172.21.15.12:6819/852655937","heartbeat_back_addr":"172.21.15.12:6823/852655937","heartbeat_front_addr":"172.21.15.12:6821/852655937","state":["exists","up"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6825","nonce":3485488459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6827","nonce":3485488459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6831","nonce":3485488459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3485488459},{"type":"v1","addr":"172.21.15.12:6829","nonce":3485488459}]},"public_addr":"172.21.15.12:6825/3485488459","cluster_addr":"172.21.15.12:6827/3485488459","heartbeat_back_addr":"172.21.15.12:6831/3485488459","heartbeat_front_addr":"172.21.15.12:6829/3485488459","state":["exists","up"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6801","nonce":2211289880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6803","nonce":2211289880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6807","nonce":2211289880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6805","nonce":2211289880}]},"public_addr":"172.21.15.12:6801/2211289880","cluster_addr":"172.21.15.12:6803/2211289880","heartbeat_back_addr":"172.21.15.12:6807/2211289880","heartbeat_front_addr":"172.21.15.12:6805/2211289880","state":["exists","up"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6801","nonce":1639325236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6803","nonce":1639325236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6807","nonce":1639325236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6805","nonce":1639325236}]},"public_addr":"172.21.15.153:6801/1639325236","cluster_addr":"172.21.15.153:6803/1639325236","heartbeat_back_addr":"172.21.15.153:6807/1639325236","heartbeat_front_addr":"172.21.15.153:6805/1639325236","state":["exists","up"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6817","nonce":2370940838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6819","nonce":2370940838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6823","nonce":2370940838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2370940838},{"type":"v1","addr":"172.21.15.153:6821","nonce":2370940838}]},"public_addr":"172.21.15.153:6817/2370940838","cluster_addr":"172.21.15.153:6819/2370940838","heartbeat_back_addr":"172.21.15.153:6823/2370940838","heartbeat_front_addr":"172.21.15.153:6821/2370940838","state":["exists","up"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6827","nonce":1798055911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6829","nonce":1798055911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6833","nonce":1798055911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6831","nonce":1798055911}]},"public_addr":"172.21.15.153:6827/1798055911","cluster_addr":"172.21.15.153:6829/1798055911","heartbeat_back_addr":"172.21.15.153:6833/1798055911","heartbeat_front_addr":"172.21.15.153:6831/1798055911","state":["exists","up"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6809","nonce":1122624549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6811","nonce":1122624549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6815","nonce":1122624549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6813","nonce":1122624549}]},"public_addr":"172.21.15.153:6809/1122624549","cluster_addr":"172.21.15.153:6811/1122624549","heartbeat_back_addr":"172.21.15.153:6815/1122624549","heartbeat_front_addr":"172.21.15.153:6813/1122624549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.912439+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.788769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.857319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.926699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.752975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.222079+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.095040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.860946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:21:35.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T05:21:35.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T05:21:35.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T05:21:35.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T05:21:35.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T05:21:35.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T05:21:35.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T05:21:35.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T05:21:36.034 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-09-11T05:21:36.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:21:36.036 INFO:teuthology.orchestra.run.smithi012.stdout:55834574852 2024-09-11T05:21:36.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:21:36.037 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-09-11T05:21:36.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:21:36.038 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-09-11T05:21:36.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:21:36.039 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-09-11T05:21:36.040 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:21:36.041 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-09-11T05:21:36.041 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:21:36.042 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-09-11T05:21:36.042 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:21:36.043 INFO:teuthology.orchestra.run.smithi012.stdout:55834574852 2024-09-11T05:21:36.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:21:36.624 INFO:teuthology.orchestra.run.smithi012.stdout:55834574852 2024-09-11T05:21:36.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-09-11T05:21:36.646 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2024-09-11T05:21:36.654 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-09-11T05:21:36.656 INFO:teuthology.orchestra.run.smithi012.stdout:55834574852 2024-09-11T05:21:36.656 INFO:teuthology.orchestra.run.smithi012.stdout:55834574852 2024-09-11T05:21:36.658 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-09-11T05:21:36.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-09-11T05:21:36.669 INFO:teuthology.orchestra.run.smithi012.stdout:55834574852 2024-09-11T05:21:36.674 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2024-09-11T05:21:36.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-09-11T05:21:36.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-11T05:21:36.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-09-11T05:21:36.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-09-11T05:21:36.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-11T05:21:36.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-09-11T05:21:37.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:21:37.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:21:37.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:21:37.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:21:37.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:21:37.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:21:37.690 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:21:37.690 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:21:38.245 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-09-11T05:21:38.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2024-09-11T05:21:38.265 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-09-11T05:21:38.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2024-09-11T05:21:38.297 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.313 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-09-11T05:21:38.315 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-09-11T05:21:38.315 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-09-11T05:21:38.319 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2024-09-11T05:21:38.323 INFO:teuthology.orchestra.run.smithi012.stdout:55834574856 2024-09-11T05:21:38.333 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2024-09-11T05:21:38.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-09-11T05:21:38.338 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2024-09-11T05:21:38.339 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.0 2024-09-11T05:21:38.339 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2024-09-11T05:21:38.341 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2024-09-11T05:21:38.344 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2024-09-11T05:21:38.351 DEBUG:teuthology.parallel:result is None 2024-09-11T05:21:38.351 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T05:21:38.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:21:38.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:21:38.692 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T05:21:37.538510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219124,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.773889"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806249+0000","last_change":"2024-09-11T05:21:34.806249+0000","last_active":"2024-09-11T05:21:34.806249+0000","last_peered":"2024-09-11T05:21:34.806249+0000","last_clean":"2024-09-11T05:21:34.806249+0000","last_became_active":"2024-09-11T05:21:32.774545+0000","last_became_peered":"2024-09-11T05:21:32.774545+0000","last_unstale":"2024-09-11T05:21:34.806249+0000","last_undegraded":"2024-09-11T05:21:34.806249+0000","last_fullsized":"2024-09-11T05:21:34.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:38:18.034757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042111999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795671+0000","last_change":"2024-09-11T05:21:34.795671+0000","last_active":"2024-09-11T05:21:34.795671+0000","last_peered":"2024-09-11T05:21:34.795671+0000","last_clean":"2024-09-11T05:21:34.795671+0000","last_became_active":"2024-09-11T05:21:32.776984+0000","last_became_peered":"2024-09-11T05:21:32.776984+0000","last_unstale":"2024-09-11T05:21:34.795671+0000","last_undegraded":"2024-09-11T05:21:34.795671+0000","last_fullsized":"2024-09-11T05:21:34.795671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:52.513515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788134+0000","last_change":"2024-09-11T05:21:34.788134+0000","last_active":"2024-09-11T05:21:34.788134+0000","last_peered":"2024-09-11T05:21:34.788134+0000","last_clean":"2024-09-11T05:21:34.788134+0000","last_became_active":"2024-09-11T05:21:32.795062+0000","last_became_peered":"2024-09-11T05:21:32.795062+0000","last_unstale":"2024-09-11T05:21:34.788134+0000","last_undegraded":"2024-09-11T05:21:34.788134+0000","last_fullsized":"2024-09-11T05:21:34.788134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:34.218237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040346199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795640+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:21:34.795640+0000","last_peered":"2024-09-11T05:21:34.795640+0000","last_clean":"2024-09-11T05:21:34.795640+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:21:34.795640+0000","last_undegraded":"2024-09-11T05:21:34.795640+0000","last_fullsized":"2024-09-11T05:21:34.795640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.796453+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:21:34.796453+0000","last_peered":"2024-09-11T05:21:34.796453+0000","last_clean":"2024-09-11T05:21:34.796453+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:21:34.796453+0000","last_undegraded":"2024-09-11T05:21:34.796453+0000","last_fullsized":"2024-09-11T05:21:34.796453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806216+0000","last_change":"2024-09-11T05:21:34.806216+0000","last_active":"2024-09-11T05:21:34.806216+0000","last_peered":"2024-09-11T05:21:34.806216+0000","last_clean":"2024-09-11T05:21:34.806216+0000","last_became_active":"2024-09-11T05:21:32.771398+0000","last_became_peered":"2024-09-11T05:21:32.771398+0000","last_unstale":"2024-09-11T05:21:34.806216+0000","last_undegraded":"2024-09-11T05:21:34.806216+0000","last_fullsized":"2024-09-11T05:21:34.806216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:02.081911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048853500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788135+0000","last_change":"2024-09-11T05:21:34.788135+0000","last_active":"2024-09-11T05:21:34.788135+0000","last_peered":"2024-09-11T05:21:34.788135+0000","last_clean":"2024-09-11T05:21:34.788135+0000","last_became_active":"2024-09-11T05:21:32.777217+0000","last_became_peered":"2024-09-11T05:21:32.777217+0000","last_unstale":"2024-09-11T05:21:34.788135+0000","last_undegraded":"2024-09-11T05:21:34.788135+0000","last_fullsized":"2024-09-11T05:21:34.788135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:35.634621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041021100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.793369+0000","last_change":"2024-09-11T05:21:34.793369+0000","last_active":"2024-09-11T05:21:34.793369+0000","last_peered":"2024-09-11T05:21:34.793369+0000","last_clean":"2024-09-11T05:21:34.793369+0000","last_became_active":"2024-09-11T05:21:32.774180+0000","last_became_peered":"2024-09-11T05:21:32.774180+0000","last_unstale":"2024-09-11T05:21:34.793369+0000","last_undegraded":"2024-09-11T05:21:34.793369+0000","last_fullsized":"2024-09-11T05:21:34.793369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:58.794390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.787622+0000","last_change":"2024-09-11T05:21:28.808943+0000","last_active":"2024-09-11T05:21:34.787622+0000","last_peered":"2024-09-11T05:21:34.787622+0000","last_clean":"2024-09-11T05:21:34.787622+0000","last_became_active":"2024-09-11T05:21:28.807969+0000","last_became_peered":"2024-09-11T05:21:28.807969+0000","last_unstale":"2024-09-11T05:21:34.787622+0000","last_undegraded":"2024-09-11T05:21:34.787622+0000","last_fullsized":"2024-09-11T05:21:34.787622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:25.945103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:21:38.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:21:38.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:38.982 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:21:38.994 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T05:21:37.538510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219124,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.773889"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806249+0000","last_change":"2024-09-11T05:21:34.806249+0000","last_active":"2024-09-11T05:21:34.806249+0000","last_peered":"2024-09-11T05:21:34.806249+0000","last_clean":"2024-09-11T05:21:34.806249+0000","last_became_active":"2024-09-11T05:21:32.774545+0000","last_became_peered":"2024-09-11T05:21:32.774545+0000","last_unstale":"2024-09-11T05:21:34.806249+0000","last_undegraded":"2024-09-11T05:21:34.806249+0000","last_fullsized":"2024-09-11T05:21:34.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:38:18.034757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042111999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795671+0000","last_change":"2024-09-11T05:21:34.795671+0000","last_active":"2024-09-11T05:21:34.795671+0000","last_peered":"2024-09-11T05:21:34.795671+0000","last_clean":"2024-09-11T05:21:34.795671+0000","last_became_active":"2024-09-11T05:21:32.776984+0000","last_became_peered":"2024-09-11T05:21:32.776984+0000","last_unstale":"2024-09-11T05:21:34.795671+0000","last_undegraded":"2024-09-11T05:21:34.795671+0000","last_fullsized":"2024-09-11T05:21:34.795671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:52.513515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788134+0000","last_change":"2024-09-11T05:21:34.788134+0000","last_active":"2024-09-11T05:21:34.788134+0000","last_peered":"2024-09-11T05:21:34.788134+0000","last_clean":"2024-09-11T05:21:34.788134+0000","last_became_active":"2024-09-11T05:21:32.795062+0000","last_became_peered":"2024-09-11T05:21:32.795062+0000","last_unstale":"2024-09-11T05:21:34.788134+0000","last_undegraded":"2024-09-11T05:21:34.788134+0000","last_fullsized":"2024-09-11T05:21:34.788134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:34.218237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040346199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795640+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:21:34.795640+0000","last_peered":"2024-09-11T05:21:34.795640+0000","last_clean":"2024-09-11T05:21:34.795640+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:21:34.795640+0000","last_undegraded":"2024-09-11T05:21:34.795640+0000","last_fullsized":"2024-09-11T05:21:34.795640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.796453+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:21:34.796453+0000","last_peered":"2024-09-11T05:21:34.796453+0000","last_clean":"2024-09-11T05:21:34.796453+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:21:34.796453+0000","last_undegraded":"2024-09-11T05:21:34.796453+0000","last_fullsized":"2024-09-11T05:21:34.796453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806216+0000","last_change":"2024-09-11T05:21:34.806216+0000","last_active":"2024-09-11T05:21:34.806216+0000","last_peered":"2024-09-11T05:21:34.806216+0000","last_clean":"2024-09-11T05:21:34.806216+0000","last_became_active":"2024-09-11T05:21:32.771398+0000","last_became_peered":"2024-09-11T05:21:32.771398+0000","last_unstale":"2024-09-11T05:21:34.806216+0000","last_undegraded":"2024-09-11T05:21:34.806216+0000","last_fullsized":"2024-09-11T05:21:34.806216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:02.081911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048853500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788135+0000","last_change":"2024-09-11T05:21:34.788135+0000","last_active":"2024-09-11T05:21:34.788135+0000","last_peered":"2024-09-11T05:21:34.788135+0000","last_clean":"2024-09-11T05:21:34.788135+0000","last_became_active":"2024-09-11T05:21:32.777217+0000","last_became_peered":"2024-09-11T05:21:32.777217+0000","last_unstale":"2024-09-11T05:21:34.788135+0000","last_undegraded":"2024-09-11T05:21:34.788135+0000","last_fullsized":"2024-09-11T05:21:34.788135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:35.634621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041021100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.793369+0000","last_change":"2024-09-11T05:21:34.793369+0000","last_active":"2024-09-11T05:21:34.793369+0000","last_peered":"2024-09-11T05:21:34.793369+0000","last_clean":"2024-09-11T05:21:34.793369+0000","last_became_active":"2024-09-11T05:21:32.774180+0000","last_became_peered":"2024-09-11T05:21:32.774180+0000","last_unstale":"2024-09-11T05:21:34.793369+0000","last_undegraded":"2024-09-11T05:21:34.793369+0000","last_fullsized":"2024-09-11T05:21:34.793369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:58.794390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.787622+0000","last_change":"2024-09-11T05:21:28.808943+0000","last_active":"2024-09-11T05:21:34.787622+0000","last_peered":"2024-09-11T05:21:34.787622+0000","last_clean":"2024-09-11T05:21:34.787622+0000","last_became_active":"2024-09-11T05:21:28.807969+0000","last_became_peered":"2024-09-11T05:21:28.807969+0000","last_unstale":"2024-09-11T05:21:34.787622+0000","last_undegraded":"2024-09-11T05:21:34.787622+0000","last_fullsized":"2024-09-11T05:21:34.787622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:25.945103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:21:38.995 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T05:21:38.995 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T05:21:38.995 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T05:21:38.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T05:21:39.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:39.320 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T05:21:39.333 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T05:21:39.333 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-11T05:21:39.345 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-11T05:21:39.345 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}} 2024-09-11T05:21:39.345 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-11T05:21:39.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-11T05:21:39.654 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-11T05:21:39.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T05:21:39.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:21:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:39.944 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:21:39.955 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-11T05:21:39.538966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219124,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.772966"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806249+0000","last_change":"2024-09-11T05:21:34.806249+0000","last_active":"2024-09-11T05:21:34.806249+0000","last_peered":"2024-09-11T05:21:34.806249+0000","last_clean":"2024-09-11T05:21:34.806249+0000","last_became_active":"2024-09-11T05:21:32.774545+0000","last_became_peered":"2024-09-11T05:21:32.774545+0000","last_unstale":"2024-09-11T05:21:34.806249+0000","last_undegraded":"2024-09-11T05:21:34.806249+0000","last_fullsized":"2024-09-11T05:21:34.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:38:18.034757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042111999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795671+0000","last_change":"2024-09-11T05:21:34.795671+0000","last_active":"2024-09-11T05:21:34.795671+0000","last_peered":"2024-09-11T05:21:34.795671+0000","last_clean":"2024-09-11T05:21:34.795671+0000","last_became_active":"2024-09-11T05:21:32.776984+0000","last_became_peered":"2024-09-11T05:21:32.776984+0000","last_unstale":"2024-09-11T05:21:34.795671+0000","last_undegraded":"2024-09-11T05:21:34.795671+0000","last_fullsized":"2024-09-11T05:21:34.795671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:52.513515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788134+0000","last_change":"2024-09-11T05:21:34.788134+0000","last_active":"2024-09-11T05:21:34.788134+0000","last_peered":"2024-09-11T05:21:34.788134+0000","last_clean":"2024-09-11T05:21:34.788134+0000","last_became_active":"2024-09-11T05:21:32.795062+0000","last_became_peered":"2024-09-11T05:21:32.795062+0000","last_unstale":"2024-09-11T05:21:34.788134+0000","last_undegraded":"2024-09-11T05:21:34.788134+0000","last_fullsized":"2024-09-11T05:21:34.788134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:34.218237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040346199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795640+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:21:34.795640+0000","last_peered":"2024-09-11T05:21:34.795640+0000","last_clean":"2024-09-11T05:21:34.795640+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:21:34.795640+0000","last_undegraded":"2024-09-11T05:21:34.795640+0000","last_fullsized":"2024-09-11T05:21:34.795640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.796453+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:21:34.796453+0000","last_peered":"2024-09-11T05:21:34.796453+0000","last_clean":"2024-09-11T05:21:34.796453+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:21:34.796453+0000","last_undegraded":"2024-09-11T05:21:34.796453+0000","last_fullsized":"2024-09-11T05:21:34.796453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806216+0000","last_change":"2024-09-11T05:21:34.806216+0000","last_active":"2024-09-11T05:21:34.806216+0000","last_peered":"2024-09-11T05:21:34.806216+0000","last_clean":"2024-09-11T05:21:34.806216+0000","last_became_active":"2024-09-11T05:21:32.771398+0000","last_became_peered":"2024-09-11T05:21:32.771398+0000","last_unstale":"2024-09-11T05:21:34.806216+0000","last_undegraded":"2024-09-11T05:21:34.806216+0000","last_fullsized":"2024-09-11T05:21:34.806216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:02.081911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048853500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788135+0000","last_change":"2024-09-11T05:21:34.788135+0000","last_active":"2024-09-11T05:21:34.788135+0000","last_peered":"2024-09-11T05:21:34.788135+0000","last_clean":"2024-09-11T05:21:34.788135+0000","last_became_active":"2024-09-11T05:21:32.777217+0000","last_became_peered":"2024-09-11T05:21:32.777217+0000","last_unstale":"2024-09-11T05:21:34.788135+0000","last_undegraded":"2024-09-11T05:21:34.788135+0000","last_fullsized":"2024-09-11T05:21:34.788135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:35.634621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041021100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.793369+0000","last_change":"2024-09-11T05:21:34.793369+0000","last_active":"2024-09-11T05:21:34.793369+0000","last_peered":"2024-09-11T05:21:34.793369+0000","last_clean":"2024-09-11T05:21:34.793369+0000","last_became_active":"2024-09-11T05:21:32.774180+0000","last_became_peered":"2024-09-11T05:21:32.774180+0000","last_unstale":"2024-09-11T05:21:34.793369+0000","last_undegraded":"2024-09-11T05:21:34.793369+0000","last_fullsized":"2024-09-11T05:21:34.793369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:58.794390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.787622+0000","last_change":"2024-09-11T05:21:28.808943+0000","last_active":"2024-09-11T05:21:34.787622+0000","last_peered":"2024-09-11T05:21:34.787622+0000","last_clean":"2024-09-11T05:21:34.787622+0000","last_became_active":"2024-09-11T05:21:28.807969+0000","last_became_peered":"2024-09-11T05:21:28.807969+0000","last_unstale":"2024-09-11T05:21:34.787622+0000","last_undegraded":"2024-09-11T05:21:34.787622+0000","last_fullsized":"2024-09-11T05:21:34.787622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:25.945103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:21:39.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:21:40.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:40.246 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:21:40.258 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-11T05:21:39.538966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219124,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.772966"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806249+0000","last_change":"2024-09-11T05:21:34.806249+0000","last_active":"2024-09-11T05:21:34.806249+0000","last_peered":"2024-09-11T05:21:34.806249+0000","last_clean":"2024-09-11T05:21:34.806249+0000","last_became_active":"2024-09-11T05:21:32.774545+0000","last_became_peered":"2024-09-11T05:21:32.774545+0000","last_unstale":"2024-09-11T05:21:34.806249+0000","last_undegraded":"2024-09-11T05:21:34.806249+0000","last_fullsized":"2024-09-11T05:21:34.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:38:18.034757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042111999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795671+0000","last_change":"2024-09-11T05:21:34.795671+0000","last_active":"2024-09-11T05:21:34.795671+0000","last_peered":"2024-09-11T05:21:34.795671+0000","last_clean":"2024-09-11T05:21:34.795671+0000","last_became_active":"2024-09-11T05:21:32.776984+0000","last_became_peered":"2024-09-11T05:21:32.776984+0000","last_unstale":"2024-09-11T05:21:34.795671+0000","last_undegraded":"2024-09-11T05:21:34.795671+0000","last_fullsized":"2024-09-11T05:21:34.795671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:52.513515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788134+0000","last_change":"2024-09-11T05:21:34.788134+0000","last_active":"2024-09-11T05:21:34.788134+0000","last_peered":"2024-09-11T05:21:34.788134+0000","last_clean":"2024-09-11T05:21:34.788134+0000","last_became_active":"2024-09-11T05:21:32.795062+0000","last_became_peered":"2024-09-11T05:21:32.795062+0000","last_unstale":"2024-09-11T05:21:34.788134+0000","last_undegraded":"2024-09-11T05:21:34.788134+0000","last_fullsized":"2024-09-11T05:21:34.788134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:34.218237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040346199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.795640+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:21:34.795640+0000","last_peered":"2024-09-11T05:21:34.795640+0000","last_clean":"2024-09-11T05:21:34.795640+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:21:34.795640+0000","last_undegraded":"2024-09-11T05:21:34.795640+0000","last_fullsized":"2024-09-11T05:21:34.795640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.796453+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:21:34.796453+0000","last_peered":"2024-09-11T05:21:34.796453+0000","last_clean":"2024-09-11T05:21:34.796453+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:21:34.796453+0000","last_undegraded":"2024-09-11T05:21:34.796453+0000","last_fullsized":"2024-09-11T05:21:34.796453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.806216+0000","last_change":"2024-09-11T05:21:34.806216+0000","last_active":"2024-09-11T05:21:34.806216+0000","last_peered":"2024-09-11T05:21:34.806216+0000","last_clean":"2024-09-11T05:21:34.806216+0000","last_became_active":"2024-09-11T05:21:32.771398+0000","last_became_peered":"2024-09-11T05:21:32.771398+0000","last_unstale":"2024-09-11T05:21:34.806216+0000","last_undegraded":"2024-09-11T05:21:34.806216+0000","last_fullsized":"2024-09-11T05:21:34.806216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:02.081911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048853500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.788135+0000","last_change":"2024-09-11T05:21:34.788135+0000","last_active":"2024-09-11T05:21:34.788135+0000","last_peered":"2024-09-11T05:21:34.788135+0000","last_clean":"2024-09-11T05:21:34.788135+0000","last_became_active":"2024-09-11T05:21:32.777217+0000","last_became_peered":"2024-09-11T05:21:32.777217+0000","last_unstale":"2024-09-11T05:21:34.788135+0000","last_undegraded":"2024-09-11T05:21:34.788135+0000","last_fullsized":"2024-09-11T05:21:34.788135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:35.634621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041021100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.793369+0000","last_change":"2024-09-11T05:21:34.793369+0000","last_active":"2024-09-11T05:21:34.793369+0000","last_peered":"2024-09-11T05:21:34.793369+0000","last_clean":"2024-09-11T05:21:34.793369+0000","last_became_active":"2024-09-11T05:21:32.774180+0000","last_became_peered":"2024-09-11T05:21:32.774180+0000","last_unstale":"2024-09-11T05:21:34.793369+0000","last_undegraded":"2024-09-11T05:21:34.793369+0000","last_fullsized":"2024-09-11T05:21:34.793369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:58.794390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:21:34.787622+0000","last_change":"2024-09-11T05:21:28.808943+0000","last_active":"2024-09-11T05:21:34.787622+0000","last_peered":"2024-09-11T05:21:34.787622+0000","last_clean":"2024-09-11T05:21:34.787622+0000","last_became_active":"2024-09-11T05:21:28.807969+0000","last_became_peered":"2024-09-11T05:21:28.807969+0000","last_unstale":"2024-09-11T05:21:34.787622+0000","last_undegraded":"2024-09-11T05:21:34.787622+0000","last_fullsized":"2024-09-11T05:21:34.787622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:25.945103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:21:40.259 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T05:21:40.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 21 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 5fd14db5-8ee9-4e34-bd57-a8040293ab17 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-11T05:21:12.602514+0000 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-09-11T05:21:34.778118+0000 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:crush_version 4 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:full_ratio 0.95 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:backfillfull_ratio 0.9 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:nearfull_ratio 0.85 2024-09-11T05:21:40.548 INFO:teuthology.orchestra.run.smithi012.stdout:require_min_compat_client luminous 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:min_compat_client jewel 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:require_osd_release squid 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:stretch_mode_enabled false 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout: removed_snaps_queue [2~1] 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:max_osd 8 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6808/2997410357,v1:172.21.15.12:6809/2997410357] [v2:172.21.15.12:6810/2997410357,v1:172.21.15.12:6811/2997410357] exists,up e628e137-3e68-4084-a084-200022b8da35 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6816/852655937,v1:172.21.15.12:6817/852655937] [v2:172.21.15.12:6818/852655937,v1:172.21.15.12:6819/852655937] exists,up 26db6fe3-81d0-40ae-a4e1-9a7460fabc2c 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6824/3485488459,v1:172.21.15.12:6825/3485488459] [v2:172.21.15.12:6826/3485488459,v1:172.21.15.12:6827/3485488459] exists,up 00ff2990-a7cb-48a2-ab03-6739942d65d7 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6800/2211289880,v1:172.21.15.12:6801/2211289880] [v2:172.21.15.12:6802/2211289880,v1:172.21.15.12:6803/2211289880] exists,up d1c858fd-7b66-4e1b-aa18-e3fd567e1417 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/1639325236,v1:172.21.15.153:6801/1639325236] [v2:172.21.15.153:6802/1639325236,v1:172.21.15.153:6803/1639325236] exists,up 586534a4-d5e3-4af4-a2e5-aa4ec052b582 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6816/2370940838,v1:172.21.15.153:6817/2370940838] [v2:172.21.15.153:6818/2370940838,v1:172.21.15.153:6819/2370940838] exists,up 801041dc-7a4c-4776-bfbb-68be37655407 2024-09-11T05:21:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6826/1798055911,v1:172.21.15.153:6827/1798055911] [v2:172.21.15.153:6828/1798055911,v1:172.21.15.153:6829/1798055911] exists,up e0820ac1-b43f-486f-9d7b-155b46b33950 2024-09-11T05:21:40.550 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6808/1122624549,v1:172.21.15.153:6809/1122624549] [v2:172.21.15.153:6810/1122624549,v1:172.21.15.153:6811/1122624549] exists,up e22fdfda-9a13-42f2-be4f-f7c6e0ffd324 2024-09-11T05:21:40.560 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6808/2997410357,v1:172.21.15.12:6809/2997410357] [v2:172.21.15.12:6810/2997410357,v1:172.21.15.12:6811/2997410357] exists,up e628e137-3e68-4084-a084-200022b8da35', 'osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6816/852655937,v1:172.21.15.12:6817/852655937] [v2:172.21.15.12:6818/852655937,v1:172.21.15.12:6819/852655937] exists,up 26db6fe3-81d0-40ae-a4e1-9a7460fabc2c', 'osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6824/3485488459,v1:172.21.15.12:6825/3485488459] [v2:172.21.15.12:6826/3485488459,v1:172.21.15.12:6827/3485488459] exists,up 00ff2990-a7cb-48a2-ab03-6739942d65d7', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6800/2211289880,v1:172.21.15.12:6801/2211289880] [v2:172.21.15.12:6802/2211289880,v1:172.21.15.12:6803/2211289880] exists,up d1c858fd-7b66-4e1b-aa18-e3fd567e1417', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/1639325236,v1:172.21.15.153:6801/1639325236] [v2:172.21.15.153:6802/1639325236,v1:172.21.15.153:6803/1639325236] exists,up 586534a4-d5e3-4af4-a2e5-aa4ec052b582', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6816/2370940838,v1:172.21.15.153:6817/2370940838] [v2:172.21.15.153:6818/2370940838,v1:172.21.15.153:6819/2370940838] exists,up 801041dc-7a4c-4776-bfbb-68be37655407', 'osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6826/1798055911,v1:172.21.15.153:6827/1798055911] [v2:172.21.15.153:6828/1798055911,v1:172.21.15.153:6829/1798055911] exists,up e0820ac1-b43f-486f-9d7b-155b46b33950', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6808/1122624549,v1:172.21.15.153:6809/1122624549] [v2:172.21.15.153:6810/1122624549,v1:172.21.15.153:6811/1122624549] exists,up e22fdfda-9a13-42f2-be4f-f7c6e0ffd324'] 2024-09-11T05:21:40.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mon.a", 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster": "ceph", 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout: "admin_socket_mode": "", 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_client_required": "cephx, none", 2024-09-11T05:21:40.663 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_cluster_required": "cephx", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_debug": "true", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_service_required": "cephx", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_supported": "cephx", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_aio": "true", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_aio_poll_ms": "250", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_aio_reap_max": "16", 2024-09-11T05:21:40.664 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_async_discard": "false", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_block_size": "4096", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_debug_aio": "false", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_debug_inflight_ios": "false", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_enable_discard": "false", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_flock_retry": "3", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_inject_crash": "0", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_ioring": "false", 2024-09-11T05:21:40.665 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_ioring_hipri": "false", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bdev_type": "", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_alloc_size": "1048576", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_allocator": "hybrid", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_buffered_io": "true", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_check_for_zeros": "false", 2024-09-11T05:21:40.666 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_compact_log_sync": "false", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_max_log_runway": "4194304", 2024-09-11T05:21:40.667 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_max_prefetch": "1048576", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_min_flush_size": "524288", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_min_log_runway": "1048576", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_replay_recovery": "false", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_sync_write": "false", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-11T05:21:40.668 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_allocation_from_file": "true", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_allocator": "hybrid", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bdev_label_multi": "true", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-11T05:21:40.669 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_create": "true", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_db_create": "false", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_db_path": "", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_db_size": "0", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_path": "", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_preallocate_file": "false", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_size": "107374182400", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_wal_create": "false", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_wal_path": "", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_block_wal_size": "100663296", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bluefs": "true", 2024-09-11T05:21:40.670 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_autotune": "true", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-11T05:21:40.671 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_size": "0", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_type": "2q", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_clone_cow": "true", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-11T05:21:40.672 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_mode": "none", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_csum_type": "crc32c", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_freelist": "false", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-11T05:21:40.673 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_small_allocations": "0", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_default_buffered_read": "true", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_default_buffered_write": "false", 2024-09-11T05:21:40.674 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fail_eio": "false", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-11T05:21:40.675 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_on_mount": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_on_umount": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-11T05:21:40.676 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_ignore_data_csum": "false", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_log_op_age": "5.000000", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_max_alloc_size": "0", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_max_blob_size": "0", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-11T05:21:40.677 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_max_deferred_txc": "32", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_min_alloc_size": "0", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_nid_prealloc": "1024", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_retry_disk_reads": "3", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_rocksdb_cf": "true", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-11T05:21:40.678 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_spdk_mem": "512", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-11T05:21:40.679 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_tracing": "false", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-11T05:21:40.680 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_zero_block_detection": "false", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-11T05:21:40.681 INFO:teuthology.orchestra.run.smithi012.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephx_cluster_require_signatures": "false", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephx_cluster_require_version": "2", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephx_require_signatures": "false", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephx_require_version": "2", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephx_service_require_signatures": "false", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephx_service_require_version": "2", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "cephx_sign_messages": "true", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "chdir": "", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client_acl_type": "", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client_asio_thread_count": "2", 2024-09-11T05:21:40.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client_cache_mid": "0.750000", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_cache_size": "16384", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_caps_release_delay": "5", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_check_pool_perm": "true", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_debug_force_sync_read": "false", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_debug_getattr_caps": "false", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_debug_inject_features": "", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_debug_inject_tick_delay": "0", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_die_on_failed_remount": "false", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_dirsize_rbytes": "true", 2024-09-11T05:21:40.683 INFO:teuthology.orchestra.run.smithi012.stdout: "client_force_lazyio": "false", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_fs": "", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_inject_release_failure": "false", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_max_inline_size": "4096", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_mds_namespace": "", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_metadata": "", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_mount_gid": "-1", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_mount_timeout": "300", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_mount_uid": "-1", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_mountpoint": "/", 2024-09-11T05:21:40.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_notify_timeout": "10", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_oc": "true", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_oc_max_dirty": "104857600", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_oc_max_objects": "1000", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_oc_size": "209715200", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_oc_target_dirty": "8388608", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_permissions": "true", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_quota": "true", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_quota_df": "true", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_readahead_max_bytes": "0", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_readahead_max_periods": "4", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_readahead_min": "131072", 2024-09-11T05:21:40.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_reconnect_stale": "false", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_shutdown_timeout": "30", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_snapdir": ".snap", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_tick_interval": "1", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_trace": "", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_try_dentry_invalidate": "false", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_use_faked_inos": "false", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_use_random_mds": "false", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "clog_to_graylog": "false", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "clog_to_graylog_port": "12201", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "clog_to_monitors": "default=true", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "clog_to_syslog": "false", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "clog_to_syslog_level": "info", 2024-09-11T05:21:40.686 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "-", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_network": "", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_network_interface": "", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "compressor_zlib_isal": "false", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "compressor_zlib_level": "5", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "compressor_zlib_winsize": "-15", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "compressor_zstd_level": "1", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "crimson_alien_op_num_threads": "6", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "crimson_osd_stat_interval": "0", 2024-09-11T05:21:40.687 INFO:teuthology.orchestra.run.smithi012.stdout: "crimson_seastar_cpu_cores": "", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "crimson_seastar_num_threads": "0", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_location": "", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_location_hook": "", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_location_hook_timeout": "10", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "daemonize": "false", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "daos_pool": "tank", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_alienstore": "0/5", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_allow_any_pool_priority": "false", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_asok": "1/5", 2024-09-11T05:21:40.688 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_asok_assert_abort": "false", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_asserts_on_shutdown": "true", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_auth": "20/20", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_bdev": "1/3", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_bluefs": "1/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_bluestore": "1/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_buffer": "0/1", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_ceph_exporter": "1/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_cephfs_mirror": "0/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_cephsqlite": "0/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_client": "0/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_compressor": "1/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_context": "0/1", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_crimson_interrupt": "0/5", 2024-09-11T05:21:40.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_crush": "1/1", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_crypto": "1/5", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_cyanstore": "0/5", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_deliberately_leak_memory": "false", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_disable_randomized_ping": "false", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_dpdk": "1/5", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_eventtrace": "1/5", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_filer": "0/1", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_filestore": "1/3", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_finisher": "1/1", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_fuse": "1/5", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_heartbeat_testing_span": "0", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_heartbeatmap": "1/5", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-11T05:21:40.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_javaclient": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_journal": "1/3", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_journaler": "0/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_kstore": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_lockdep": "0/1", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mclock": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mds": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mds_balancer": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mds_locker": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mds_log": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mds_log_expire": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mds_migrator": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mds_quiesce": "3/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_memstore": "1/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mgr": "2/5", 2024-09-11T05:21:40.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mgrc": "1/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_mon": "20/20", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_monc": "0/10", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_ms": "1/1", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_none": "0/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_objclass": "0/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_objectcacher": "0/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_objecter": "0/1", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_optracker": "0/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_osd": "1/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_paxos": "20/20", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_perfcounter": "1/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_prioritycache": "1/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rados": "0/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rbd": "0/5", 2024-09-11T05:21:40.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rbd_mirror": "0/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rbd_pwl": "0/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rbd_replay": "0/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_refs": "0/0", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_reserver": "1/1", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rgw": "1/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rgw_access": "1/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rgw_datacache": "1/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rgw_dbstore": "1/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rgw_flight": "1/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rgw_sync": "1/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_rocksdb": "4/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore": "0/5", 2024-09-11T05:21:40.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_backref": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_cache": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_cleaner": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_device": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_epm": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_journal": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_lba": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_odata": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_omap": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_onode": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_t": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_seastore_tm": "0/5", 2024-09-11T05:21:40.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_striper": "0/1", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_test": "0/5", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_throttle": "1/1", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_timer": "0/1", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_tp": "0/5", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "debug_trace": "1/5", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "device_failure_prediction_mode": "none", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "err_to_graylog": "false", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "err_to_journald": "false", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "err_to_stderr": "true", 2024-09-11T05:21:40.695 INFO:teuthology.orchestra.run.smithi012.stdout: "err_to_syslog": "false", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event_tracing": "false", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "exporter_addr": "0.0.0.0", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "exporter_http_port": "9926", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "exporter_prio_limit": "5", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "exporter_sort_metrics": "true", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "exporter_stats_period": "5", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "fake_statfs_for_testing": "0", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "fatal_signal_handlers": "true", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "filer_max_purge_ops": "10", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "filer_max_truncate_ops": "128", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_apply_finisher_threads": "1", 2024-09-11T05:21:40.696 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_blackhole": "false", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_btrfs_clone_range": "true", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_btrfs_snap": "true", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_caller_concurrency": "10", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_collect_device_partition_information": "true", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_commit_timeout": "600.000000", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_debug_inject_read_err": "false", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_debug_omap_check": "false", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_debug_verify_split": "false", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_dump_file": "", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-11T05:21:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_fadvise": "true", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_fail_eio": "true", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_fd_cache_shards": "16", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_fd_cache_size": "128", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_fiemap": "false", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_fiemap_threshold": "4096", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_inject_stall": "0", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_journal_parallel": "false", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_journal_trailing": "false", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_journal_writeahead": "false", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_kill_at": "0", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-11T05:21:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattrs": "0", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_xattr_value_size": "0", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_merge_threshold": "-10", 2024-09-11T05:21:40.699 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_odsync_write": "false", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_omap_backend": "rocksdb", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_omap_backend_path": "", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_op_thread_timeout": "60", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_op_threads": "2", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_punch_hole": "false", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-11T05:21:40.700 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_queue_max_ops": "50", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_seek_data_hole": "false", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_sloppy_crc": "false", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_splice": "false", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_split_multiple": "2", 2024-09-11T05:21:40.701 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_split_rand_factor": "20", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_update_to": "1000", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_enable": "true", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-11T05:21:40.702 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_xfs_extsize": "false", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "filestore_zfs_snap": "false", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fio_dir": "/tmp/fio", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "5fd14db5-8ee9-4e34-bd57-a8040293ab17", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_allow_other": "true", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_atomic_o_trunc": "true", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_big_writes": "true", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_debug": "false", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_default_permissions": "false", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_disable_pagecache": "false", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_max_write": "0", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_multithreaded": "true", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_require_active_mds": "true", 2024-09-11T05:21:40.703 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_set_user_groups": "true", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_splice_move": "true", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_splice_read": "true", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_splice_write": "true", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "fuse_use_invalidate_cb": "true", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "gss_target_name": "ceph", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_file": "", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_inject_failure": "0", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_interval": "5", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "host": "smithi012", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-11T05:21:40.704 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "inject_early_sigterm": "false", 2024-09-11T05:21:40.705 INFO:teuthology.orchestra.run.smithi012.stdout: "jaeger_agent_port": "6799", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "jaeger_tracing_enable": "false", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_aio": "true", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_align_min_size": "65536", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_block_align": "true", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_block_size": "4096", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_dio": "true", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_discard": "false", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_force_aio": "false", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_ignore_corruption": "false", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_max_write_bytes": "10485760", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_max_write_entries": "100", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_replay_from": "0", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-11T05:21:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_write_header_frequency": "0", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "journal_zero_on_create": "false", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "journaler_prefetch_periods": "10", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "journaler_prezero_periods": "5", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "journaler_write_head_interval": "15", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "keyfile": "", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_backend": "rocksdb", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_default_stripe_size": "65536", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_fsck_on_mount": "false", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_max_bytes": "67108864", 2024-09-11T05:21:40.707 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_max_ops": "512", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_nid_prealloc": "1024", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_onode_map_size": "1024", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_sync_submit_transaction": "false", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "kstore_sync_transaction": "false", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "librados_thread_count": "2", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "lockdep": "false", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "lockdep_force_backtrace": "false", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "log_coarse_timestamps": "true", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "log_flush_on_exit": "false", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "log_graylog_host": "127.0.0.1", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "log_graylog_port": "12201", 2024-09-11T05:21:40.708 INFO:teuthology.orchestra.run.smithi012.stdout: "log_max_new": "1000", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_max_recent": "10000", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_stderr_prefix": "", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_stop_at_utilization": "0.970000", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": "true", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_graylog": "false", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_journald": "false", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_stderr": "false", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_syslog": "false", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "max_rotating_auth_attempts": "10", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_action_on_write_error": "1", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_alternate_name_max": "8192", 2024-09-11T05:21:40.709 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_asio_thread_count": "2", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_export_pin": "true", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_fragment_dirs": "true", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_fragment_interval": "5", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_interval": "10", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_max": "-1", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_max_until": "-1", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_merge_size": "50", 2024-09-11T05:21:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_midchunk": "0.300000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_min_start": "0.200000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_minchunk": "0.001000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_mode": "0", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_need_max": "1.200000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_need_min": "0.800000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_overload_epochs": "2", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_split_bits": "3", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_split_size": "10000", 2024-09-11T05:21:40.711 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_target_decay": "10.000000", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_beacon_grace": "15.000000", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_beacon_interval": "4.000000", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_mid": "0.700000", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_quiesce_delay": "0", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-11T05:21:40.712 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_release_free_interval": "10", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_reservation": "0.050000", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_trim_interval": "1", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache_trim_threshold": "262144", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_client_prealloc_inos": "1000", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_connect_bootstrapping": "false", 2024-09-11T05:21:40.713 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_damage_table_max_entries": "10000", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_debug_auth_pins": "false", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_debug_frag": "false", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_debug_scatterstat": "false", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_debug_subtrees": "false", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_decay_halflife": "5.000000", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_default_dir_hash": "2", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_defer_session_stale": "true", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_deny_all_reconnect": "false", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dir_keys_per_op": "16384", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dir_max_commit_size": "10", 2024-09-11T05:21:40.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dir_max_entries": "0", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dir_prefetch": "true", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dump_cache_on_map": "false", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_early_reply": "true", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_enable_op_tracker": "true", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_enforce_unique_name": "true", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_export_ephemeral_random": "true", 2024-09-11T05:21:40.715 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_health_summarize_threshold": "10", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_inject_health_dummy": "false", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-11T05:21:40.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_inject_migrator_session_race": "false", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_join_fs": "", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_journal_format": "1", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_create_at": "0", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_export_at": "0", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_import_at": "0", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_journal_at": "0", 2024-09-11T05:21:40.717 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_journal_expire_at": "0", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_journal_replay_at": "0", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_link_at": "0", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_mdstable_at": "0", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_openc_at": "0", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_rename_at": "0", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_kill_shutdown_at": "0", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_event_large_threshold": "524288", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_events_per_segment": "1024", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_max_events": "-1", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_max_segments": "128", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_pause": "false", 2024-09-11T05:21:40.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_segment_size": "0", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_trim_threshold": "128", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log_warn_factor": "2.000000", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_caps_per_client": "1048576", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_completed_flushes": "100000", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_completed_requests": "100000", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_export_size": "20971520", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_file_recover": "32", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_purge_files": "64", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_purge_ops": "8192", 2024-09-11T05:21:40.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_max_snaps_per_dir": "100", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_metrics_update_interval": "2", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_min_caps_per_client": "100", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_min_caps_working_set": "10000", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_numa_node": "-1", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_op_complaint_time": "30.000000", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_op_history_duration": "600", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_op_history_size": "20", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_op_history_slow_op_size": "20", 2024-09-11T05:21:40.720 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_op_log_threshold": "5", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_ping_grace": "15", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_ping_interval": "5", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_recall_max_caps": "30000", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_recall_warning_threshold": "262144", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-11T05:21:40.721 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_replay_interval": "1.000000", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_root_ino_gid": "0", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_root_ino_uid": "0", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-11T05:21:40.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_shutdown_check": "0", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_skip_ino": "0", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_snap_max_uid": "4294967294", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_snap_min_uid": "0", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_snap_rstat": "false", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_standby_replay_damaged": "false", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_symlink_recovery": "true", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-11T05:21:40.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_thrash_exports": "0", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_thrash_fragments": "0", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_tick_interval": "5.000000", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_valgrind_exit": "false", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_verify_backtrace": "1", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_verify_scatter": "false", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_wipe_sessions": "false", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool_debug": "false", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "memstore_device_bytes": "1073741824", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "memstore_page_set": "false", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "memstore_page_size": "65536", 2024-09-11T05:21:40.724 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_client_bytes": "134217728", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_client_messages": "512", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_disabled_modules": "", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_enable_op_tracker": "true", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_max_pg_num_change": "128", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_mds_bytes": "134217728", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_mds_messages": "128", 2024-09-11T05:21:40.725 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_mon_bytes": "134217728", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_mon_messages": "128", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_op_history_duration": "600", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_op_history_size": "20", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_op_log_threshold": "5", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_osd_bytes": "536870912", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_osd_messages": "8192", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_pool": "true", 2024-09-11T05:21:40.726 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_standby_modules": "true", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_stats_period": "5", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_stats_threshold": "5", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_tick_period": "2", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_allow_pool_delete": "true", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_allow_pool_size_one": "true", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_auth_validate_all_caps": "true", 2024-09-11T05:21:40.727 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_bytes": "104857600", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_directed_command_retry": "5", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_hunt_parallel": "3", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_log_interval": "1.000000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_ping_interval": "10.000000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-11T05:21:40.728 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_client_target_rank": "-1", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_file_level": "debug", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_file": "true", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_journald": "false", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-11T05:21:40.729 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_compact_on_bootstrap": "false", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_compact_on_start": "false", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_compact_on_trim": "true", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_cpu_threads": "4", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_crush_min_required_version": "hammer", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_daemon_bytes": "419430400", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_data_avail_crit": "5", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_data_avail_warn": "5", 2024-09-11T05:21:40.730 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_data_size_warn": "16106127360", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_dump_json": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_dump_transactions": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_extra_checks": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_no_require_reef": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_no_require_squid": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-11T05:21:40.731 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_down_mkfs_grace": "120", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_down_uptime_grace": "60", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_election_default_strategy": "1", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_election_timeout": "5.000000", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_elector_ping_divisor": "2", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_enable_op_tracker": "true", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_fake_pool_delete": "false", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_force_quorum_join": "false", 2024-09-11T05:21:40.732 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_globalid_prealloc": "10000", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_health_detail_to_clog": "false", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_health_log_update_period": "5", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_health_max_detail": "50", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_health_to_clog": "true", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_health_to_clog_interval": "600", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_host": "172.21.15.12,[v2:172.21.15.12:3301,v1:172.21.15.12:6790],172.21.15.153", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_host_override": "", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_initial_members": "", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-11T05:21:40.733 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_lease": "5.000000", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_log_full_interval": "50", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_log_max": "10000", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_log_max_summary": "50", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_log_epochs": "500", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_osd": "10000", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_pg_per_osd": "10000", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_pool_pg_num": "65536", 2024-09-11T05:21:40.734 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mds_force_trim_to": "0", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mds_skip_sanity": "false", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_memory_autotune": "true", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_memory_target": "2147483648", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mgr_beacon_grace": "30", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mgr_digest_period": "5", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mgr_inactive_grace": "60", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_min_osdmap_epochs": "500", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_op_complaint_time": "30", 2024-09-11T05:21:40.735 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_op_history_duration": "600", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_op_history_size": "20", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_op_history_slow_op_size": "20", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_op_log_threshold": "5", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_auto_mark_in": "false", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_cache_size": "500", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-11T05:21:40.736 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_down_out_interval": "600", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_force_trim_to": "0", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-11T05:21:40.737 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_min_down_reporters": "2", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_report_timeout": "900", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-11T05:21:40.738 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pg_stuck_threshold": "60", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_probe_timeout": "2.000000", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_reweight_max_change": "0.050000", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_reweight_max_osds": "4", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-11T05:21:40.739 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_scrub_interval": "86400", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_scrub_max_keys": "100", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_scrub_timeout": "300", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_session_timeout": "300", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_smart_report_timeout": "5", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_stat_smooth_intervals": "6", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_stretch_pool_min_size": "2", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_stretch_pool_size": "4", 2024-09-11T05:21:40.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_sync_debug": "false", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_sync_provider_kill_at": "0", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_sync_requester_kill_at": "0", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_sync_timeout": "60.000000", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_target_pg_per_osd": "100", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_tick_interval": "5", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_timecheck_interval": "300.000000", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-11T05:21:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_use_min_delay_socket": "false", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_older_version_delay": "604800", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_misplaced": "false", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_older_version": "true", 2024-09-11T05:21:40.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "monmap": "", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T05:21:40.743 INFO:teuthology.orchestra.run.smithi012.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "motr_tracing_enabled": "false", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_op_threads": "3", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_cm": "false", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_device_name": "", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_dscp": "96", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_local_gid": "", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_port_num": "1", 2024-09-11T05:21:40.744 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_sl": "3", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_support_srq": "true", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_rdma_type": "ib", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_async_reap_threshold": "5", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_before_connect": "false", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_ipv4": "true", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_ipv6": "false", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_msgr1": "true", 2024-09-11T05:21:40.745 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_msgr2": "true", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_port_max": "7568", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_port_min": "6800", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_retry_count": "3", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_bind_retry_delay": "5", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_blackhole_client": "false", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_blackhole_mds": "false", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_blackhole_mgr": "false", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_blackhole_mon": "false", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_blackhole_osd": "false", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_client_mode": "crc secure", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_cluster_mode": "crc secure", 2024-09-11T05:21:40.746 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_cluster_type": "", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_compress_secure": "false", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_connection_idle_timeout": "900", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_connection_ready_timeout": "10", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_crc_data": "true", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_crc_header": "true", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_die_on_bad_msg": "false", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_die_on_bug": "true", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_die_on_old_message": "true", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_die_on_skipped_message": "false", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_coremask": "0xF", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-11T05:21:40.747 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_enable_tso": "true", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_hugepages": "", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_lro": "true", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_memory_channel": "4", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_pmd": "", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_port_id": "0", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-11T05:21:40.748 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_dump_on_send": "false", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_initial_backoff": "0.200000", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_inject_delay_max": "1.000000", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_inject_delay_type": "", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_inject_network_congestion": "0", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_inject_socket_failures": "5000", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_learn_addr_from_peer": "true", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_max_accept_failures": "4", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_max_backoff": "15.000000", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_mon_client_mode": "secure crc", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-11T05:21:40.749 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_mon_service_mode": "secure crc", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_osd_compress_min_size": "1024", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_osd_compress_mode": "none", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_pq_min_cost": "65536", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_public_type": "", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_service_mode": "crc secure", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_tcp_listen_backlog": "512", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_tcp_nodelay": "true", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_tcp_rcvbuf": "0", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ms_type": "async+posix", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "no_config_file": "false", 2024-09-11T05:21:40.750 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_completion_locks_per_session": "32", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_inflight_ops": "1024", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_tick_interval": "5.000000", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter_timeout": "10.000000", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objectstore_blackhole": "false", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "openssl_engine_opts": "", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_agent_delay_time": "5.000000", 2024-09-11T05:21:40.751 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_agent_hist_halflife": "1000", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_agent_max_low_ops": "2", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_agent_max_ops": "4", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_agent_slop": "0.020000", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_asio_thread_count": "2", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_async_recovery_min_cost": "100", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_backfill_scan_max": "512", 2024-09-11T05:21:40.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_backfill_scan_min": "64", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_backoff_on_degraded": "false", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_backoff_on_peering": "false", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_backoff_on_unfound": "true", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_beacon_report_interval": "300", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bench_duration": "30", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bench_max_block_size": "67108864", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_blkin_trace_all": "false", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-11T05:21:40.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_check_for_log_corruption": "false", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_class_update_on_start": "true", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_client_message_cap": "256", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_client_message_size_cap": "524288000", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_client_op_priority": "63", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_client_watch_timeout": "30", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_command_max_records": "256", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_compact_on_start": "false", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-11T05:21:40.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_crush_update_on_start": "true", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_crush_update_weight_set": "true", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_feed_pullee": "-1", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_misdirected_ops": "false", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_no_acting_change": "false", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_no_purge_strays": "false", 2024-09-11T05:21:40.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_op_order": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_shutdown": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_trim_objects": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_verify_snaps": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-11T05:21:40.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_deep_scrub_keys": "1024", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_deep_scrub_stride": "524288", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_default_notify_timeout": "30", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_delete_sleep": "0.000000", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_discard_disconnected_ops": "true", 2024-09-11T05:21:40.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_enable_op_tracker": "true", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_fast_info": "true", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_fast_shutdown": "true", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_function_tracing": "false", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_heartbeat_grace": "20", 2024-09-11T05:21:40.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_heartbeat_interval": "6", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_heartbeat_min_peers": "10", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_heartbeat_min_size": "2000", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_heartbeat_stale": "600", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_hit_set_max_size": "100000", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_hit_set_min_size": "1000", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-11T05:21:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_journal_size": "5120", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_kill_backfill_at": "0", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_map_cache_size": "50", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_map_dedup": "true", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_map_message_max": "40", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_map_share_max_epochs": "40", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_attr_name_len": "100", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_attr_size": "0", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_backfills": "1", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_markdown_count": "5", 2024-09-11T05:21:40.760 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_markdown_period": "600", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_object_name_len": "2048", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_object_namespace_len": "256", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_object_size": "134217728", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_pg_blocked_by": "16", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_pg_log_entries": "10000", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_pgls": "1024", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_push_cost": "8388608", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_push_objects": "10", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_scrubs": "3", 2024-09-11T05:21:40.761 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_trimming_pgs": "2", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_write_op_reply_len": "64", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_max_write_size": "90", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_profile": "balanced", 2024-09-11T05:21:40.762 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_memory_base": "805306368", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_memory_cache_min": "134217728", 2024-09-11T05:21:40.763 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_memory_target": "4294967296", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_memory_target_autotune": "false", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_min_pg_log_entries": "250", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_min_recovery_priority": "0", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mon_report_interval": "5", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_num_cache_shards": "32", 2024-09-11T05:21:40.764 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_num_op_tracker_shard": "32", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_numa_auto_affinity": "true", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_numa_node": "-1", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_numa_prefer_iface": "true", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_objecter_finishers": "1", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_objectstore": "bluestore", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_objectstore_fuse": "false", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_objectstore_tracing": "false", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_complaint_time": "30.000000", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_history_duration": "600", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_history_size": "20", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_history_slow_op_size": "20", 2024-09-11T05:21:40.765 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_log_threshold": "5", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_num_shards": "0", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_num_shards_hdd": "5", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_num_shards_ssd": "8", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_pq_min_cost": "65536", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_queue_cut_off": "high", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_op_thread_timeout": "15", 2024-09-11T05:21:40.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_open_classes_on_start": "true", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_os_flags": "0", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_peering_op_priority": "255", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_delete_cost": "1048576", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_delete_priority": "5", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_log_trim_max": "10000", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_log_trim_min": "100", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-11T05:21:40.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_crimson": "false", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-11T05:21:40.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_flags": "0", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_min_size": "0", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_pg_num": "32", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_pgp_num": "0", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_read_ratio": "70", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_size": "2", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_default_type": "replicated", 2024-09-11T05:21:40.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_push_per_object_cost": "1000", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recover_clone_overlap": "true", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_cost": "20971520", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_max_active": "0", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_max_single_start": "1", 2024-09-11T05:21:40.770 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_op_priority": "3", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_priority": "5", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_sleep": "0.000000", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_repair_during_recovery": "false", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_requested_scrub_priority": "120", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_auto_repair": "false", 2024-09-11T05:21:40.771 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_begin_hour": "0", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_begin_week_day": "0", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_chunk_max": "25", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_chunk_min": "5", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_cost": "52428800", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_during_recovery": "false", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_end_hour": "0", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_end_week_day": "0", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_event_cost": "4096", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-11T05:21:40.772 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_invalid_stats": "true", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_max_preemptions": "5", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_priority": "5", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_scrub_sleep": "0.000000", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_skip_data_digest": "false", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_smart_report_timeout": "5", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_snap_trim_cost": "1048576", 2024-09-11T05:21:40.773 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_snap_trim_priority": "5", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_target_transaction_size": "30", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-11T05:21:40.774 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_tracing": "false", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_use_stale_snap": "false", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "osdc_blkin_trace_all": "false", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_kill_at": "0", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_max_join_drift": "10", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_min": "500", 2024-09-11T05:21:40.775 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_min_wait": "0.050000", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_propose_interval": "1.000000", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_service_trim_max": "500", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_service_trim_min": "250", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_stash_full_interval": "25", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_trim_max": "500", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "paxos_trim_min": "250", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "perf": "true", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "-", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrv": "", 2024-09-11T05:21:40.776 INFO:teuthology.orchestra.run.smithi012.stdout: "public_bind_addr": "-", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "public_network": "", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "public_network_interface": "", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "qat_compressor_busy_polling": "false", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "qat_compressor_enabled": "false", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "qat_compressor_session_max_number": "256", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rados_mon_op_timeout": "0", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rados_osd_op_timeout": "0", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rados_tracing": "false", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_atime_update_interval": "60", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_balance_parent_reads": "false", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_balance_snap_reads": "false", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_blkin_trace_all": "false", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-11T05:21:40.777 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache": "true", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_policy": "writearound", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_size": "33554432", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_clone_copy_on_read": "false", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_compression_hint": "none", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_concurrent_management_ops": "10", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_clone_format": "auto", 2024-09-11T05:21:40.778 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_data_pool": "", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_features": "61", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_format": "2", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_map_options": "", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_order": "22", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_pool": "rbd", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_stripe_count": "0", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_default_stripe_unit": "0", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_enable_alloc_hint": "true", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_io_scheduler": "simple", 2024-09-11T05:21:40.779 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_order": "24", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_pool": "", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_journal_splay_width": "4", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_localize_parent_reads": "false", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_localize_snap_reads": "false", 2024-09-11T05:21:40.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-11T05:21:40.781 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-11T05:21:40.782 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_mtime_update_interval": "60", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_non_blocking_aio": "true", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_op_thread_timeout": "60", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_op_threads": "1", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_parent_cache_enabled": "false", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-11T05:21:40.783 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_plugins": "", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_bps_burst": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_bps_limit": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_exclude_ops": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_iops_burst": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_iops_limit": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-11T05:21:40.784 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_read_from_replica_policy": "default", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-11T05:21:40.785 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_skip_partial_discard": "true", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_tracing": "false", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_validate_names": "true", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_validate_pool": "true", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "restapi_base_url": "", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "restapi_log_level": "", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_acl_grants_max_num": "100", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_admin_entry": "admin", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-11T05:21:40.786 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_backend_store": "rados", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_barbican_url": "", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_beast_enable_async": "true", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_counters_cache": "false", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_cache_enabled": "true", 2024-09-11T05:21:40.787 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_cache_expiry_interval": "900", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_cache_lru_size": "25000", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_config_store": "rados", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_content_length_compat": "false", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_copy_obj_progress": "true", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_cors_rules_max_num": "100", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_cross_domain_policy": "", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_addr": "", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-11T05:21:40.788 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_password": "", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_kmip_username": "", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_require_ssl": "true", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-11T05:21:40.789 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_addr": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_auth": "token", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_namespace": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_prefix": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-11T05:21:40.790 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_token_file": "", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_curl_buffersize": "524288", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_curl_low_speed_time": "300", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-11T05:21:40.791 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_d4n_port": "6379", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data_log_changes_size": "1000", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data_log_num_shards": "128", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data_log_window": "30", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-11T05:21:40.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-11T05:21:40.793 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dns_name": "", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dns_s3website_name": "", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_dynamic_resharding": "true", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enable_gc_threads": "true", 2024-09-11T05:21:40.794 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enable_lc_threads": "true", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enable_ops_log": "false", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enable_quota_threads": "true", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enable_static_website": "false", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enable_usage_log": "false", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_enforce_swift_acls": "true", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_exit_timeout_secs": "120", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_expose_bucket": "false", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_extended_http_attrs": "", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_filter": "none", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-11T05:21:40.795 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_frontends": "beast port=7480", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_max_deferred": "50", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_max_objs": "32", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_gc_processor_period": "3600", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-11T05:21:40.796 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_init_timeout": "300", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_kafka_connection_idle": "300", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_domain": "", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_password": "", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_password_path": "", 2024-09-11T05:21:40.797 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_project": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_tenant": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_token": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_token_path": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_admin_user": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_api_version": "2", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_barbican_domain": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_barbican_password": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_barbican_project": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_barbican_user": "", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-11T05:21:40.798 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_url": "", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lc_debug_interval": "-1", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lc_lock_max_time": "90", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lc_max_objs": "32", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lc_max_rules": "1000", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lc_max_worker": "3", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lc_thread_delay": "0", 2024-09-11T05:21:40.799 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ldap_dnattr": "uid", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ldap_searchfilter": "", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ldap_uri": "", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_log_http_headers": "", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-11T05:21:40.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_log_object_name_utc": "false", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_attr_name_len": "0", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_attr_size": "0", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_chunk_size": "4194304", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_listing_results": "1000", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_notify_retries": "10", 2024-09-11T05:21:40.801 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_put_param_size": "1048576", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_put_size": "5368709120", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_max_slo_entries": "1000", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_md_log_max_shards": "64", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_mp_lock_max_time": "600", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-11T05:21:40.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_max_gc": "300", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_num_async_rados_threads": "32", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_num_control_oids": "8", 2024-09-11T05:21:40.803 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_numa_node": "-1", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_objexp_chunk_size": "100", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_objexp_gc_interval": "600", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_op_thread_timeout": "600", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_op_tracing": "false", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_opa_token": "", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_opa_url": "", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_opa_verify_ssl": "true", 2024-09-11T05:21:40.804 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ops_log_rados": "false", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_ops_log_socket_path": "", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_period_push_interval": "2.000000", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_posix_cache_lanes": "3", 2024-09-11T05:21:40.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_posix_cache_partitions": "3", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_print_continue": "true", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_rados_tracing": "false", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_realm": "", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_realm_id": "", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_region": "", 2024-09-11T05:21:40.806 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_request_uri": "", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_reshard_batch_size": "64", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_reshard_max_aio": "128", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_reshard_num_logs": "16", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_reshard_thread_interval": "600", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_resolve_cname": "false", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_run_sync_thread": "true", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-11T05:21:40.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_scheduler_type": "throttler", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_script_uri": "", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_service_provider_name": "", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sts_client_id": "", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sts_client_secret": "", 2024-09-11T05:21:40.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sts_entry": "sts", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sts_key": "sts", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sts_min_session_duration": "900", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sts_token_introspection_url": "", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_account_in_url": "false", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_auth_entry": "auth", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_auth_url": "", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_custom_header": "", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_need_stats": "true", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_tenant_name": "", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_token_expiration": "86400", 2024-09-11T05:21:40.809 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_url": "", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_url_prefix": "swift", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_lease_period": "120", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-11T05:21:40.810 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_thread_pool_size": "512", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_comment": "", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_createby": "", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_encoding": "", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_flag": "false", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-11T05:21:40.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_origin": "", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_torrent_tracker": "", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_trust_forwarded_https": "false", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_usage_max_shards": "32", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_usage_max_user_shards": "1", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_use_opa_authz": "false", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_counters_cache": "false", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_max_buckets": "1000", 2024-09-11T05:21:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_policies_max_num": "100", 2024-09-11T05:21:40.813 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-11T05:21:40.813 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-11T05:21:40.813 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-11T05:21:40.813 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-11T05:21:40.813 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_user_unique_email": "true", 2024-09-11T05:21:40.813 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_verify_ssl": "true", 2024-09-11T05:21:40.815 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-11T05:21:40.815 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_zone": "", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_zone_id": "", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_zonegroup": "", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_zonegroup_id": "", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rgwlc_auto_session_clear": "true", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_block_size": "4096", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-11T05:21:40.816 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cache_size": "536870912", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_index_type": "binary_search", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-11T05:21:40.817 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_partition_filters": "false", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_perf": "false", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "run_dir": "/var/run/ceph", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_block_create": "true", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_cache_lru_size": "67108864", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_default_max_object_size": "16777216", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_device_size": "53687091200", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-11T05:21:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_full_integrity_check": "false", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_journal_batch_capacity": "16", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_main_device_type": "SSD", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "seastore_segment_size": "67108864", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "set_keepcaps": "false", 2024-09-11T05:21:40.819 INFO:teuthology.orchestra.run.smithi012.stdout: "setgroup": "", 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: "setuser": "", 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: "setuser_match_path": "", 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: "thp": "false", 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: "threadpool_default_timeout": "60", 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: "throttler_perf_counter": "true" 2024-09-11T05:21:40.820 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:40.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-11T05:21:40.938 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a: {} 2024-09-11T05:21:40.939 INFO:teuthology.orchestra.run.smithi012.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:21:40.949 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b: {} 2024-09-11T05:21:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:21:40.957 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c: {} 2024-09-11T05:21:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:21:40.968 DEBUG:teuthology.orchestra.run.smithi012:> type ceph-objectstore-tool 2024-09-11T05:21:40.983 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T05:21:40.983 DEBUG:teuthology.orchestra.run.smithi153:> type ceph-objectstore-tool 2024-09-11T05:21:41.001 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T05:21:41.002 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-11T05:21:41.012 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-11T05:21:41.012 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-11T05:21:41.012 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:21:41.012 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:21:41.012 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T05:21:41.012 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 1.000000 2024-09-11T05:21:41.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-11T05:21:41.013 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-11T05:21:41.013 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-11T05:21:41.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:21:41.014 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-11T05:21:41.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:21:41.014 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-11T05:21:41.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:21:41.015 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-11T05:21:41.025 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:41.024+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:41.064 INFO:teuthology.orchestra.run.smithi012.stdout:mapped writes DISABLED 2024-09-11T05:21:41.064 INFO:teuthology.orchestra.run.smithi012.stdout:mapped reads DISABLED 2024-09-11T05:21:41.064 INFO:teuthology.orchestra.run.smithi012.stdout:Seed set to 2172 2024-09-11T05:21:41.115 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:41.115+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:41.145 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:41.146 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:41.146 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:21:41.146 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:41.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:21:41.202 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:41.216 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:41.215+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:41.221 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:41.239 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:41.275 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:41.275 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:41.305 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:41.305 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:41.306 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:41.306 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:41.314 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:21:41.317 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:41.317+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:41.323 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:41.323 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:41.357 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:41.357 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:41.374 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:41.374 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:41.418 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:41.417+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:41.436 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:41.436 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:41.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:21:41.519 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:41.519+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:41.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:21:41.621 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:41.621+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:41.668 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:41.668 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:41.677 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:21:41.721 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:41.721+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:41.784 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:41.784 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:41.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:21:41.807 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:21:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-11T05:21:41.822 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:41.822+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:41.919 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:41.919 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:41.922 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:41.923+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:41.928 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:21:42.023 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:42.023+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:42.075 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:42.075 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:42.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:21:42.125 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:42.125+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:42.190 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:42.190 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:42.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:21:42.226 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:42.226+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:42.306 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:42.306 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:42.315 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:21:42.326 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:42.326+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:42.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:42.427+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:42.429 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:42.430 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:42.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:21:42.527 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:42.528+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:42.587 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:42.587 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:42.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:21:42.640 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:42.640+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:42.711 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:42.711 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:42.720 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:21:42.729 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:42.729+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:42.830 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:42.830+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:42.867 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:42.868 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:42.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:21:42.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:42.931+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:43.020 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:43.020 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:43.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:21:43.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:43.031+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:43.131 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:43.132 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:43.132 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:43.131+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:43.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:21:43.232 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:43.232+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:43.283 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:43.283 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:43.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:21:43.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:43.334+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:43.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:21:43.397 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:43.397 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:43.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:21:43.450 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:43.450+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:43.511 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:43.511 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:43.519 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:21:43.530 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:43.548 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:43.548 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:43.560 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:43.560+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:43.564 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:43.581 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:43.598 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:43.598 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:43.614 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:43.632 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:43.633 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:43.636 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:43.636+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:43.649 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:43.665 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:43.665 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:43.665 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:21:43.665 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:21:43.665 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:43.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:21:43.737 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:43.737+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:43.777 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:43.778 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:21:43.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:21:43.778 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [] 2024-09-11T05:21:43.778 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:43.787 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:21:43.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:21:43.837 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:43.837+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:43.890 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:21:43.890 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:43.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:21:43.940 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:43.939+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:44.038 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:44.038+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:21:44.041 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:44.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:21:44.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:44.140+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:44.196 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.444031265, 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:21:44.197 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:21:44.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:21:44.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:32 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.833554+0000", 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.361092798, 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068393380000000004, 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 32 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833554+0000", 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833554+0000", 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833555+0000", 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7000000000000005e-07 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833618+0000", 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2927000000000002e-05 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833626+0000", 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3019999999999995e-06 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833631+0000", 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.566e-06 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.834468+0000", 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00083701100000000003 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.834520+0000", 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2098000000000002e-05 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.834615+0000", 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4834999999999996e-05 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.836636+0000", 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020212780000000001 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840335+0000", 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036986559999999998 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840368+0000", 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2937e-05 2024-09-11T05:21:44.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840394+0000", 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6157999999999999e-05 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:33 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.833641+0000", 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.361006425999999, 2024-09-11T05:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068721540000000001, 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 33 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833641+0000", 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833641+0000", 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833641+0000", 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833644+0000", 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.599e-06 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833648+0000", 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.07e-06 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833651+0000", 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.123e-06 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.835072+0000", 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00142132 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.835138+0000", 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5291999999999998e-05 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.835222+0000", 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3966000000000002e-05 2024-09-11T05:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837376+0000", 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021540600000000002 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840443+0000", 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030668570000000001 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840473+0000", 2024-09-11T05:21:44.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0595000000000001e-05 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840513+0000", 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9774999999999998e-05 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.833656+0000", 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.360991101, 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069558789999999999, 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 34 2024-09-11T05:21:44.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833656+0000", 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833656+0000", 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833656+0000", 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.23e-07 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833658+0000", 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833662+0000", 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4769999999999999e-06 2024-09-11T05:21:44.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833666+0000", 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7079999999999999e-06 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.835652+0000", 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019864840000000002 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.835718+0000", 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6049000000000004e-05 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.835802+0000", 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3667999999999999e-05 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837382+0000", 2024-09-11T05:21:44.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001580026 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840558+0000", 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031758899999999998 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840589+0000", 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0926000000000002e-05 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840612+0000", 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3374e-05 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.833670+0000", 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.360977558, 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070741629999999996, 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 35 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833670+0000", 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833670+0000", 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833670+0000", 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.11e-07 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833731+0000", 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1087000000000007e-05 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833742+0000", 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1528e-05 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833748+0000", 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.836055+0000", 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023068910000000001 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.836108+0000", 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2911999999999998e-05 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.836209+0000", 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101028 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837585+0000", 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00137524 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840657+0000", 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030727689999999999 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840688+0000", 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1180000000000003e-05 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840744+0000", 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5339e-05 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.833766+0000", 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.360881558999999, 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070637190000000004, 2024-09-11T05:21:44.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833766+0000", 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833766+0000", 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833766+0000", 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5499999999999998e-07 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833771+0000", 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8919999999999999e-06 2024-09-11T05:21:44.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833776+0000", 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1569999999999999e-06 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833780+0000", 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8039999999999999e-06 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.836668+0000", 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002887892 2024-09-11T05:21:44.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.836718+0000", 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0175e-05 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.836817+0000", 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8453000000000001e-05 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837942+0000", 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001125701 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840779+0000", 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002836383 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840808+0000", 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9289999999999999e-05 2024-09-11T05:21:44.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.840829+0000", 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1316999999999999e-05 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.833786+0000", 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.360861062, 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095838539999999993, 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.235 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833786+0000", 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833786+0000", 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833786+0000", 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833789+0000", 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5950000000000001e-06 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833794+0000", 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0560000000000004e-06 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.833803+0000", 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.149e-06 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837059+0000", 2024-09-11T05:21:44.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032559479999999998 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837112+0000", 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2722000000000001e-05 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837197+0000", 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5033999999999999e-05 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.837946+0000", 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00074963000000000004 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.843190+0000", 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005243358 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.843268+0000", 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8281999999999994e-05 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.843370+0000", 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101872 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.883602+0000", 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.311045194, 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068004889999999998, 2024-09-11T05:21:44.241 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 69 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883602+0000", 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883602+0000", 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883603+0000", 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883670+0000", 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7372999999999993e-05 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883679+0000", 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9260000000000006e-06 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883685+0000", 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6930000000000004e-06 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.884589+0000", 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00090467 2024-09-11T05:21:44.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.884640+0000", 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0531999999999997e-05 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.884714+0000", 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3980999999999995e-05 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.889786+0000", 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050722320000000003 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.890347+0000", 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00056125000000000001 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.890379+0000", 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2104999999999998e-05 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.890402+0000", 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3036000000000001e-05 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.883698+0000", 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.310949451000001, 2024-09-11T05:21:44.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095115909999999998, 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 70 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883698+0000", 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883698+0000", 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883698+0000", 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4799999999999998e-07 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883703+0000", 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1289999999999998e-06 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883710+0000", 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5510000000000002e-06 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.883716+0000", 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5130000000000004e-06 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.888018+0000", 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043025579999999997 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.888068+0000", 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9604000000000001e-05 2024-09-11T05:21:44.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.888156+0000", 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8251999999999995e-05 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.890071+0000", 2024-09-11T05:21:44.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019149080000000001 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.893154+0000", 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030834009999999999 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.893185+0000", 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1053000000000002e-05 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.893209+0000", 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3974000000000001e-05 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.057635+0000", 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.137011769000001, 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067856069999999999, 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.254 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 111 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057635+0000", 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057635+0000", 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057636+0000", 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1e-07 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057638+0000", 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5500000000000001e-06 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057642+0000", 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.985e-06 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057645+0000", 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7300000000000001e-06 2024-09-11T05:21:44.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.060491+0000", 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028463490000000002 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.060551+0000", 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0009000000000001e-05 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.060626+0000", 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4658000000000002e-05 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063582+0000", 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029559600000000001 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064357+0000", 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00077534900000000005 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064385+0000", 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7285999999999999e-05 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064421+0000", 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6421000000000002e-05 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.057651+0000", 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.136995838000001, 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068702939999999999, 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 112 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057651+0000", 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057651+0000", 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057652+0000", 2024-09-11T05:21:44.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7300000000000002e-07 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057704+0000", 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1910000000000003e-05 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057709+0000", 2024-09-11T05:21:44.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6579999999999999e-06 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057714+0000", 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.060931+0000", 2024-09-11T05:21:44.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032170279999999998 2024-09-11T05:21:44.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.060979+0000", 2024-09-11T05:21:44.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7364999999999998e-05 2024-09-11T05:21:44.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.061053+0000", 2024-09-11T05:21:44.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4219000000000002e-05 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063584+0000", 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025314209999999998 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064460+0000", 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00087520199999999995 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064486+0000", 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6818e-05 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064522+0000", 2024-09-11T05:21:44.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5238999999999999e-05 2024-09-11T05:21:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.057725+0000", 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.136922522000001, 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068945680000000002, 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 113 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057725+0000", 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057725+0000", 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057725+0000", 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9500000000000002e-07 2024-09-11T05:21:44.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057730+0000", 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6419999999999998e-06 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057737+0000", 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9269999999999999e-06 2024-09-11T05:21:44.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057741+0000", 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6129999999999997e-06 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.061418+0000", 2024-09-11T05:21:44.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036763329999999999 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.061461+0000", 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3251000000000003e-05 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.061533+0000", 2024-09-11T05:21:44.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2087000000000003e-05 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063588+0000", 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020550360000000001 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064558+0000", 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00096940399999999999 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064584+0000", 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6342e-05 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064619+0000", 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5337999999999999e-05 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.057752+0000", 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.136894767999999, 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0069638319999999997, 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 114 2024-09-11T05:21:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057752+0000", 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057752+0000", 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057753+0000", 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6599999999999996e-07 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057756+0000", 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3830000000000001e-06 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057764+0000", 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057769+0000", 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7010000000000004e-06 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.061879+0000", 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041103040000000004 2024-09-11T05:21:44.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.061931+0000", 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.062004+0000", 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2615999999999997e-05 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063591+0000", 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001586992 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064655+0000", 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010639759999999999 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064681+0000", 2024-09-11T05:21:44.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6798999999999999e-05 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064716+0000", 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4857000000000002e-05 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.057791+0000", 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.136856627, 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070259889999999998, 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.288 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 115 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057791+0000", 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057791+0000", 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057791+0000", 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0999999999999998e-07 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057869+0000", 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7725000000000005e-05 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057878+0000", 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6500000000000002e-06 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057885+0000", 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7519999999999996e-06 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.062249+0000", 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004363507 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.062296+0000", 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7166999999999998e-05 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.062372+0000", 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6250999999999999e-05 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063615+0000", 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001242529 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064752+0000", 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011375529999999999 2024-09-11T05:21:44.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064780+0000", 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7523999999999999e-05 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064817+0000", 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6721000000000003e-05 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.057907+0000", 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.136739758999999, 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070072090000000004, 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 116 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057907+0000", 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057907+0000", 2024-09-11T05:21:44.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057908+0000", 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1600000000000001e-07 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057912+0000", 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9920000000000001e-06 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057924+0000", 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2108e-05 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057931+0000", 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9949999999999999e-06 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.062712+0000", 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004781207 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.062758+0000", 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5735000000000002e-05 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.062831+0000", 2024-09-11T05:21:44.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2743000000000005e-05 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063618+0000", 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00078719300000000005 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064851+0000", 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001232691 2024-09-11T05:21:44.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064878+0000", 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7080000000000002e-05 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064915+0000", 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6848999999999999e-05 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.057943+0000", 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.136703952, 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070723230000000002, 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.302 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 117 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057943+0000", 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057943+0000", 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057944+0000", 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2799999999999996e-07 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057948+0000", 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0350000000000003e-06 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057956+0000", 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6070000000000008e-06 2024-09-11T05:21:44.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.057965+0000", 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5359999999999992e-06 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063118+0000", 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.005153304 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063201+0000", 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2904000000000004e-05 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.063344+0000", 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000143077 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064213+0000", 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00086894399999999997 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064950+0000", 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00073660100000000003 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.064979+0000", 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8835000000000001e-05 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.065016+0000", 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6952000000000001e-05 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.528542+0000", 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.666105131, 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067525170000000004, 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 138 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528542+0000", 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528542+0000", 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528542+0000", 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8599999999999999e-07 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528544+0000", 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7749999999999999e-06 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528548+0000", 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1590000000000003e-06 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528551+0000", 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8329999999999998e-06 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.532963+0000", 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00441144 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.533053+0000", 2024-09-11T05:21:44.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0240000000000003e-05 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.533185+0000", 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000132211 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.534872+0000", 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001686683 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535236+0000", 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000364185 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535262+0000", 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6435999999999999e-05 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535295+0000", 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2268999999999999e-05 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.528555+0000", 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.666092525, 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068227729999999999, 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.314 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 139 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528555+0000", 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528555+0000", 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528555+0000", 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528557+0000", 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.72e-06 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528561+0000", 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9609999999999999e-06 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528566+0000", 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3619999999999997e-06 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.533550+0000", 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049845050000000002 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.533597+0000", 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6862e-05 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.533664+0000", 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6267999999999996e-05 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535109+0000", 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001445132 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535318+0000", 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020937500000000001 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535345+0000", 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535377+0000", 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2622e-05 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.528571+0000", 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.666075801, 2024-09-11T05:21:44.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087980320000000008, 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 140 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528571+0000", 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528571+0000", 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528572+0000", 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.11e-07 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528613+0000", 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1887000000000001e-05 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528627+0000", 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3550000000000001e-05 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528635+0000", 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5469999999999999e-06 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.533935+0000", 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053008370000000001 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.534015+0000", 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9185999999999997e-05 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.534095+0000", 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0128000000000003e-05 2024-09-11T05:21:44.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535114+0000", 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001018826 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.537305+0000", 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021916000000000001 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.537334+0000", 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8671e-05 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.537369+0000", 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5589000000000001e-05 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:29.528646+0000", 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.666001510999999, 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011633124, 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 141 2024-09-11T05:21:44.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528646+0000", 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:44.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528646+0000", 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528646+0000", 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.06e-07 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528650+0000", 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0389999999999998e-06 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528656+0000", 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1720000000000004e-06 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.528663+0000", 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3609999999999997e-06 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.534431+0000", 2024-09-11T05:21:44.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057686760000000004 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.534474+0000", 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2676999999999998e-05 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.534544+0000", 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9628999999999994e-05 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.535640+0000", 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010962579999999999 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.540204+0000", 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045643120000000001 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.540229+0000", 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4777e-05 2024-09-11T05:21:44.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:29.540279+0000", 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9716999999999998e-05 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:44.333 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:44.335 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:44.334+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:44.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:21:44.402 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:21:44.435 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:44.435+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:44.453 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:44.453 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:44.453 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:21:44.453 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:44.462 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:21:44.536 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:44.536+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:44.616 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:44.616 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:44.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:21:44.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:44.668+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.834213+0000", 2024-09-11T05:21:44.734 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.898644821, 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033091570000000001, 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834213+0000", 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834213+0000", 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834215+0000", 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.049e-06 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834236+0000", 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1736e-05 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834252+0000", 2024-09-11T05:21:44.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5746000000000001e-05 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834260+0000", 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0199999999999994e-06 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834302+0000", 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1783000000000003e-05 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834316+0000", 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3932e-05 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837490+0000", 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003174708 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837523+0000", 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2183e-05 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.738 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.898167646999999, 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0055014299999999999, 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-07 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834777+0000", 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5338000000000002e-05 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834789+0000", 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2809000000000001e-05 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834807+0000", 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7346e-05 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834860+0000", 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2714999999999999e-05 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834881+0000", 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1759999999999998e-05 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840133+0000", 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0052513509999999996 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840192+0000", 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9417999999999999e-05 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.835299+0000", 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.897559011, 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049197149999999999, 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.743 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835299+0000", 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835299+0000", 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835300+0000", 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3600000000000002e-07 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835307+0000", 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0820000000000001e-06 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835320+0000", 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3158e-05 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835326+0000", 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6200000000000004e-06 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835375+0000", 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9048999999999997e-05 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835391+0000", 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5724999999999999e-05 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840195+0000", 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048044810000000002 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840219+0000", 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3663999999999999e-05 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.835882+0000", 2024-09-11T05:21:44.747 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.896976153000001, 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0043566489999999998, 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835882+0000", 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835882+0000", 2024-09-11T05:21:44.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835883+0000", 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0400000000000005e-07 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835889+0000", 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9059999999999999e-06 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835902+0000", 2024-09-11T05:21:44.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3144e-05 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835908+0000", 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9200000000000001e-06 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835966+0000", 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8412999999999998e-05 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.835983+0000", 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6208000000000001e-05 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840220+0000", 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0042373020000000001 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840239+0000", 2024-09-11T05:21:44.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8851999999999998e-05 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.836296+0000", 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.896561848999999, 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039593299999999996, 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836296+0000", 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836296+0000", 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836297+0000", 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3099999999999996e-07 2024-09-11T05:21:44.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836350+0000", 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2781000000000002e-05 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836364+0000", 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3886000000000001e-05 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836370+0000", 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836427+0000", 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7278999999999998e-05 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836442+0000", 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5111e-05 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840240+0000", 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0037975909999999999 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840256+0000", 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6109000000000001e-05 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'15)", 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.836875+0000", 2024-09-11T05:21:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.895983635, 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033971190000000001, 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836875+0000", 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836875+0000", 2024-09-11T05:21:44.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836875+0000", 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3399999999999998e-07 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836881+0000", 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7350000000000001e-06 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836893+0000", 2024-09-11T05:21:44.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1875000000000001e-05 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836899+0000", 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7289999999999997e-06 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836955+0000", 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6267000000000002e-05 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.836970+0000", 2024-09-11T05:21:44.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5339999999999999e-05 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840257+0000", 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032861409999999998 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840272+0000", 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5197999999999999e-05 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'15)", 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.895604642, 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0056426719999999996, 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.54e-07 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837260+0000", 2024-09-11T05:21:44.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3820000000000003e-06 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837269+0000", 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2269999999999999e-06 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837277+0000", 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837343+0000", 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6841999999999995e-05 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837363+0000", 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9809999999999998e-05 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.842857+0000", 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0054938920000000002 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.842896+0000", 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9115000000000001e-05 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:59 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'37, mlcod=16'33)", 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.869428+0000", 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.863430641000001, 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033556850000000002, 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869428+0000", 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869428+0000", 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869428+0000", 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4799999999999998e-07 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869435+0000", 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3749999999999999e-06 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869453+0000", 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8104000000000001e-05 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869460+0000", 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0840000000000003e-06 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869537+0000", 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7458000000000003e-05 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.869554+0000", 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6500000000000001e-05 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.872750+0000", 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031958469999999999 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.872783+0000", 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3668999999999999e-05 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.884775+0000", 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.848083240999999, 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.005419798, 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884775+0000", 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884775+0000", 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884776+0000", 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4899999999999995e-07 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884827+0000", 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1817000000000002e-05 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884837+0000", 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3349999999999996e-06 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884842+0000", 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2889999999999997e-06 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884889+0000", 2024-09-11T05:21:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6799999999999999e-05 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884902+0000", 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.311e-05 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.890139+0000", 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0052367409999999996 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.890195+0000", 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6156999999999998e-05 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.888220+0000", 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.844637979, 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047330180000000003, 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888220+0000", 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888220+0000", 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888221+0000", 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3799999999999996e-07 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888226+0000", 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9309999999999999e-06 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888237+0000", 2024-09-11T05:21:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1242e-05 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888242+0000", 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888282+0000", 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9901000000000003e-05 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.888296+0000", 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4270000000000001e-05 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.892920+0000", 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004623238 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.892953+0000", 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3581000000000003e-05 2024-09-11T05:21:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:83 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'53, mlcod=16'50)", 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.906876+0000", 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.825982245000001, 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033645820000000001, 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906876+0000", 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906876+0000", 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906877+0000", 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.61e-07 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906882+0000", 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3499999999999996e-06 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906893+0000", 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1049e-05 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906898+0000", 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8659999999999997e-06 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906940+0000", 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2089999999999999e-05 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.906953+0000", 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2364000000000001e-05 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.910187+0000", 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003234822 2024-09-11T05:21:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.910241+0000", 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3279999999999998e-05 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.907300+0000", 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.825558056, 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003331245, 2024-09-11T05:21:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907300+0000", 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907300+0000", 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907301+0000", 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4700000000000001e-07 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907339+0000", 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7821999999999998e-05 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907350+0000", 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1425e-05 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907356+0000", 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5470000000000004e-06 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907397+0000", 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1254000000000002e-05 2024-09-11T05:21:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.907410+0000", 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2969999999999999e-05 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.910599+0000", 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031888060000000002 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.910631+0000", 2024-09-11T05:21:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2774000000000002e-05 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:106 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'68, mlcod=16'64)", 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.058450+0000", 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.674408205000001, 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0052274649999999997, 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058450+0000", 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058450+0000", 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058457+0000", 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9909999999999996e-06 2024-09-11T05:21:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058508+0000", 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1116999999999999e-05 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058519+0000", 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1255e-05 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058527+0000", 2024-09-11T05:21:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8359999999999992e-06 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058561+0000", 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3448999999999998e-05 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058572+0000", 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175999999999999e-05 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063650+0000", 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050784970000000004 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063678+0000", 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7144e-05 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.058956+0000", 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.673902419999999, 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047359189999999999, 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058956+0000", 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058956+0000", 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058956+0000", 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-07 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058968+0000", 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1487e-05 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058978+0000", 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0407e-05 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.058986+0000", 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6380000000000004e-06 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059019+0000", 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3485000000000002e-05 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059030+0000", 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0643e-05 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063679+0000", 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046492169999999998 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063692+0000", 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2432999999999999e-05 2024-09-11T05:21:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'65)", 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.059443+0000", 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.673415154000001, 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0042606939999999998, 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059443+0000", 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059443+0000", 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059444+0000", 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059449+0000", 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1869999999999996e-06 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059456+0000", 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059462+0000", 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4689999999999996e-06 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059503+0000", 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0642000000000002e-05 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059514+0000", 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.092e-05 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063692+0000", 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0041788149999999998 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063704+0000", 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1484999999999999e-05 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'65)", 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.059835+0000", 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.673023392999999, 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0038825840000000001, 2024-09-11T05:21:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059835+0000", 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059835+0000", 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059835+0000", 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2799999999999996e-07 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059886+0000", 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0720999999999998e-05 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059894+0000", 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2369999999999992e-06 2024-09-11T05:21:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059900+0000", 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6400000000000002e-06 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059927+0000", 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6641000000000001e-05 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.059936+0000", 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6709999999999994e-06 2024-09-11T05:21:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063704+0000", 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0037680510000000001 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063717+0000", 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3095000000000001e-05 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'65)", 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.060295+0000", 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.67256308, 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034370450000000001, 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060295+0000", 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060295+0000", 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060296+0000", 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6100000000000001e-07 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060301+0000", 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1479999999999997e-06 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060310+0000", 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4550000000000001e-06 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060322+0000", 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1817000000000001e-05 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060355+0000", 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2910000000000002e-05 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060365+0000", 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0492999999999999e-05 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063718+0000", 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033525170000000002 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.063732+0000", 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4243999999999999e-05 2024-09-11T05:21:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'65)", 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.060667+0000", 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.672191102999999, 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033945780000000001, 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060667+0000", 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060667+0000", 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060668+0000", 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060674+0000", 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5810000000000002e-06 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060683+0000", 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3410000000000003e-06 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060688+0000", 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:21:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060732+0000", 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4206999999999999e-05 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.060752+0000", 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9652000000000001e-05 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.064029+0000", 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032771020000000001 2024-09-11T05:21:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.064062+0000", 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2631e-05 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'90)", 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.198282356, 2024-09-11T05:21:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0054473009999999999, 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.37e-07 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534581+0000", 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0829999999999997e-06 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534589+0000", 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4169999999999992e-06 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534595+0000", 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.84e-06 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534791+0000", 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019571899999999999 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534812+0000", 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1362e-05 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.539994+0000", 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051821640000000004 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.540023+0000", 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9179e-05 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:44.410162+0000", 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.32269600999999998, 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0080536380000000001, 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 11 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410162+0000", 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410162+0000", 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410164+0000", 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.03e-06 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410175+0000", 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1119e-05 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410196+0000", 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0721999999999999e-05 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410209+0000", 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2796000000000001e-05 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410270+0000", 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0797000000000001e-05 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op must wait for map", 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410274+0000", 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6160000000000004e-06 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.413632+0000", 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033579759999999999 2024-09-11T05:21:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.413778+0000", 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014591499999999999 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.413957+0000", 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017878800000000001 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.415405+0000", 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0014477380000000001 2024-09-11T05:21:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418140+0000", 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0027356440000000002 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418180+0000", 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0088e-05 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418216+0000", 2024-09-11T05:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5408999999999999e-05 2024-09-11T05:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:44.825 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:44.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:21:44.827 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:44.826+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:44.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:44.927+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:21:44.975 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:44.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:21:45.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:45.027+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:45.128 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:45.128+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:45.131 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:45.133 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:45.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:21:45.228 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:45.228+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4253.0:5 2.2 e20/18 2:5cea7035:::rbd_info:head v 20'1, mlcod=0'0)", 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:33.787228+0000", 2024-09-11T05:21:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 11.460842735, 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001348637, 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787228+0000", 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787228+0000", 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787229+0000", 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787238+0000", 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1700000000000003e-06 2024-09-11T05:21:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787268+0000", 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0057e-05 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787294+0000", 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6213000000000001e-05 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787416+0000", 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012216899999999999 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.787468+0000", 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1802000000000003e-05 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.788531+0000", 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010629820000000001 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:33.788577+0000", 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5697e-05 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4253.0:7 2.2 e21/18 2:5cea7035:::rbd_info:head v 21'2, mlcod=0'0)", 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:34.793558+0000", 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 10.454513002000001, 2024-09-11T05:21:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00087135900000000004, 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793558+0000", 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793558+0000", 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793558+0000", 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793563+0000", 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3040000000000004e-06 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793575+0000", 2024-09-11T05:21:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2245e-05 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793586+0000", 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0022e-05 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793654+0000", 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8212000000000004e-05 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.793674+0000", 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9823999999999999e-05 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.794364+0000", 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000690188 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:34.794429+0000", 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5351999999999994e-05 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:9 3.1a e25/22 3:5cea7035:::rbd_info:head v 25'2, mlcod=0'0)", 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:44.402991+0000", 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.84507923299999999, 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0014832960000000001, 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.402991+0000", 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.402991+0000", 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.402992+0000", 2024-09-11T05:21:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0499999999999999e-07 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.402997+0000", 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.152e-06 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.403016+0000", 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9544000000000001e-05 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.403027+0000", 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0023e-05 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.403075+0000", 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8726000000000001e-05 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.403092+0000", 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6526000000000001e-05 2024-09-11T05:21:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.404431+0000", 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0013395950000000001 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.404475+0000", 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3424999999999998e-05 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:12 3.6 e25/22 3:65afa4bc:::rbd_header.1179d519140e:head v 25'1, mlcod=0'0)", 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:44.418928+0000", 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.82914272700000002, 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00062062499999999997, 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418928+0000", 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418928+0000", 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418928+0000", 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6199999999999999e-07 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418935+0000", 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2580000000000001e-06 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418946+0000", 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1851999999999999e-05 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418953+0000", 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.419003+0000", 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0006000000000002e-05 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.419022+0000", 2024-09-11T05:21:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9227000000000001e-05 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.419511+0000", 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00048912999999999995 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.419549+0000", 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7168000000000001e-05 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:25 3.6 e25/22 3:65afa4bc:::rbd_header.1179d519140e:head v 25'2, mlcod=0'0)", 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:44.435735+0000", 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.81233602999999999, 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00061831899999999999, 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435735+0000", 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435735+0000", 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435736+0000", 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3069999999999999e-06 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435749+0000", 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2756e-05 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435770+0000", 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1100000000000001e-05 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435779+0000", 2024-09-11T05:21:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2839999999999995e-06 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435852+0000", 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3349999999999994e-05 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.435874+0000", 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1959000000000001e-05 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.436314+0000", 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00043941899999999997 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.436353+0000", 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9144000000000003e-05 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.272 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:45.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:21:45.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:45.329+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:45.381 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:21:45.381 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:45.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:21:45.430 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:45.430+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:45.531 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:45.531+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:45.537 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:45.537 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:45.546 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:21:45.632 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:45.631+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:45.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:21:45.695 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4253.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.920729851000001, 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0041632789999999998, 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774978+0000", 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8799999999999999e-07 2024-09-11T05:21:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774986+0000", 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3669999999999997e-06 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774997+0000", 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1274000000000001e-05 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775005+0000", 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6660000000000008e-06 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775080+0000", 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4821999999999996e-05 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775102+0000", 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1894000000000001e-05 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779079+0000", 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039771809999999998 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779141+0000", 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1886999999999999e-05 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:45.701 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:45.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:21:45.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:45.746+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:45.790 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:45.790 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:45.809 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:45.825 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:45.825 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:45.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:45.833+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:45.842 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:45.860 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:45.867 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:45.867 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:45.878 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:21:45.878 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:45.894 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:45.895 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:45.912 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:45.934 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:45.934+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:46.002 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.002 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.011 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:21:46.035 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:46.035+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:21:46.136 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:46.135+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:46.143 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.144 INFO:teuthology.orchestra.run.smithi012.stdout:skipping zero size read 2024-09-11T05:21:46.167 INFO:teuthology.orchestra.run.smithi012.stdout:5 write 0xcd769bf thru 0xcd7d228 (0x686a bytes) 2024-09-11T05:21:46.170 INFO:teuthology.orchestra.run.smithi012.stdout:truncating to largest ever: 0x8387fdd 2024-09-11T05:21:46.176 INFO:teuthology.orchestra.run.smithi012.stdout:6 trunc from 0xcd7d229 to 0x8387fdd 2024-09-11T05:21:46.187 INFO:teuthology.orchestra.run.smithi012.stdout:7 punch from 0x242685f to 0x2434fb4, (0xe755 bytes) 2024-09-11T05:21:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:8 read 0x7eb0e55 thru 0x7ebf687 (0xe833 bytes) 2024-09-11T05:21:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:9 punch from 0x1b33e7f to 0x1b40255, (0xc3d6 bytes) 2024-09-11T05:21:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:11 punch from 0x823a402 to 0x82423d4, (0x7fd2 bytes) 2024-09-11T05:21:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:12 read 0x55a68b thru 0x5602cb (0x5c41 bytes) 2024-09-11T05:21:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:15 read 0x3bddf99 thru 0x3be1db4 (0x3e1c bytes) 2024-09-11T05:21:46.188 INFO:teuthology.orchestra.run.smithi012.stdout:truncating to largest ever: 0xa3f39bf 2024-09-11T05:21:46.189 INFO:teuthology.orchestra.run.smithi012.stdout:16 trunc from 0x8387fdd to 0xa3f39bf 2024-09-11T05:21:46.195 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.195 INFO:teuthology.orchestra.run.smithi012.stdout:18 read 0x1be07bd thru 0x1be703e (0x6882 bytes) 2024-09-11T05:21:46.195 INFO:teuthology.orchestra.run.smithi012.stdout:19 write 0x821ebe7 thru 0x82274ba (0x88d4 bytes) 2024-09-11T05:21:46.206 INFO:teuthology.orchestra.run.smithi012.stdout:21 trunc from 0xa3f39bf to 0x3c7fd02 2024-09-11T05:21:46.217 INFO:teuthology.orchestra.run.smithi012.stdout:22 read 0x36304f0 thru 0x36350cd (0x4bde bytes) 2024-09-11T05:21:46.225 INFO:teuthology.orchestra.run.smithi012.stdout:25 write 0x5289ead thru 0x5294e16 (0xaf6a bytes) 2024-09-11T05:21:46.237 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:46.237+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:46.241 INFO:teuthology.orchestra.run.smithi012.stdout:26 write 0xace7a5a thru 0xacf0d92 (0x9339 bytes) 2024-09-11T05:21:46.245 INFO:teuthology.orchestra.run.smithi012.stdout:27 punch from 0xf65db4 to 0xf74cae, (0xeefa bytes) 2024-09-11T05:21:46.245 INFO:teuthology.orchestra.run.smithi012.stdout:28 read 0xa45c53a thru 0xa461862 (0x5329 bytes) 2024-09-11T05:21:46.245 INFO:teuthology.orchestra.run.smithi012.stdout:30 read 0x5ed7b9d thru 0x5ed9dcb (0x222f bytes) 2024-09-11T05:21:46.245 INFO:teuthology.orchestra.run.smithi012.stdout:31 writesame 0x1ee8bf thru 0x1fdb11 data_size 0x13(0xf253 bytes) 2024-09-11T05:21:46.250 INFO:teuthology.orchestra.run.smithi012.stdout:32 writesame 0x161cbe5 thru 0x162a811 data_size 0x1(0xdc2d bytes) 2024-09-11T05:21:46.258 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.258 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.268 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:21:46.280 INFO:teuthology.orchestra.run.smithi012.stdout:33 writesame 0x881a166 thru 0x8825bce data_size 0x1(0xba69 bytes) 2024-09-11T05:21:46.309 INFO:teuthology.orchestra.run.smithi012.stdout:34 writesame 0x943adcd thru 0x9449fd4 data_size 0x14(0xf208 bytes) 2024-09-11T05:21:46.313 INFO:teuthology.orchestra.run.smithi012.stdout:truncating to largest ever: 0xe184731 2024-09-11T05:21:46.317 INFO:teuthology.orchestra.run.smithi012.stdout:36 trunc from 0xacf0d93 to 0xe184731 2024-09-11T05:21:46.322 INFO:teuthology.orchestra.run.smithi012.stdout:38 read 0xbe72d49 thru 0xbe7c784 (0x9a3c bytes) 2024-09-11T05:21:46.322 INFO:teuthology.orchestra.run.smithi012.stdout:39 writesame 0xa85e522 thru 0xa8638f4 data_size 0x17(0x53d3 bytes) 2024-09-11T05:21:46.325 INFO:teuthology.orchestra.run.smithi012.stdout:41 writesame 0xf1d155 thru 0xf26abf data_size 0x5(0x996b bytes) 2024-09-11T05:21:46.336 INFO:teuthology.orchestra.run.smithi012.stdout:45 trunc from 0xe184731 to 0xb13622e 2024-09-11T05:21:46.341 INFO:teuthology.orchestra.run.smithi012.stdout:46 writesame 0x9309fa2 thru 0x930f3c9 data_size 0x4(0x5428 bytes) 2024-09-11T05:21:46.345 INFO:teuthology.orchestra.run.smithi012.stdout:47 write 0xfd432d thru 0xfd7762 (0x3436 bytes) 2024-09-11T05:21:46.348 INFO:teuthology.orchestra.run.smithi012.stdout:49 punch from 0x8e0871 to 0x8ea784, (0x9f13 bytes) 2024-09-11T05:21:46.349 INFO:teuthology.orchestra.run.smithi012.stdout:51 trunc from 0xb13622e to 0xc94f6ef 2024-09-11T05:21:46.352 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:46.352+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:55 punch from 0x82a3af9 to 0x82b18de, (0xdde5 bytes) 2024-09-11T05:21:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:57 read 0x983f9b thru 0x9924d0 (0xe536 bytes) 2024-09-11T05:21:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:58 read 0x175d8fd thru 0x1768761 (0xae65 bytes) 2024-09-11T05:21:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:62 read 0xa60c075 thru 0xa61283b (0x67c7 bytes) 2024-09-11T05:21:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:63 punch from 0x1862e68 to 0x1865d24, (0x2ebc bytes) 2024-09-11T05:21:46.357 INFO:teuthology.orchestra.run.smithi012.stdout:64 trunc from 0xc94f6ef to 0xb7684a5 2024-09-11T05:21:46.361 INFO:teuthology.orchestra.run.smithi012.stdout:65 write 0x4340fb6 thru 0x434ce88 (0xbed3 bytes) 2024-09-11T05:21:46.365 INFO:teuthology.orchestra.run.smithi012.stdout:66 read 0x3d17a02 thru 0x3d19fe2 (0x25e1 bytes) 2024-09-11T05:21:46.365 INFO:teuthology.orchestra.run.smithi012.stdout:68 read 0x1ba5dc8 thru 0x1bb0136 (0xa36f bytes) 2024-09-11T05:21:46.365 INFO:teuthology.orchestra.run.smithi012.stdout:69 writesame 0x636c1cc thru 0x6373c20 data_size 0x27(0x7a55 bytes) 2024-09-11T05:21:46.368 INFO:teuthology.orchestra.run.smithi012.stdout:71 read 0x96c6010 thru 0x96cc95d (0x694e bytes) 2024-09-11T05:21:46.368 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.374 INFO:teuthology.orchestra.run.smithi012.stdout:74 write 0xbf81f2b thru 0xbf82aea (0xbc0 bytes) 2024-09-11T05:21:46.377 INFO:teuthology.orchestra.run.smithi012.stdout:75 clone 1 order 18 su 32768 sc 5 2024-09-11T05:21:46.418 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.418 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.422 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:21:46.427 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:21:46.466 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:46.466+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:46.540 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:46.540+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:46.571 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.571 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:21:46.591 INFO:teuthology.orchestra.run.smithi012.stdout:76 write 0xa70f714 thru 0xa71d6bd (0xdfaa bytes) 2024-09-11T05:21:46.607 INFO:teuthology.orchestra.run.smithi012.stdout:77 trunc from 0xbf82aeb to 0x516f74f 2024-09-11T05:21:46.639 INFO:teuthology.orchestra.run.smithi012.stdout:79 writesame 0x9ba47da thru 0x9bb3651 data_size 0x4(0xee78 bytes) 2024-09-11T05:21:46.639 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.639 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:46.639 INFO:teuthology.orchestra.run.smithi012.stdout:82 punch from 0x28dae94 to 0x28e1883, (0x69ef bytes) 2024-09-11T05:21:46.639 INFO:teuthology.orchestra.run.smithi012.stdout:85 punch from 0x4bdcbc4 to 0x4be7da5, (0xb1e1 bytes) 2024-09-11T05:21:46.639 INFO:teuthology.orchestra.run.smithi012.stdout:87 write 0x8b6e4a7 thru 0x8b7d460 (0xefba bytes) 2024-09-11T05:21:46.640 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:46.640+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:46.658 INFO:teuthology.orchestra.run.smithi012.stdout:88 write 0xba9a672 thru 0xba9bf62 (0x18f1 bytes) 2024-09-11T05:21:46.662 INFO:teuthology.orchestra.run.smithi012.stdout:89 punch from 0x7644bf5 to 0x764693d, (0x1d48 bytes) 2024-09-11T05:21:46.662 INFO:teuthology.orchestra.run.smithi012.stdout:90 read 0x7064004 thru 0x70663b2 (0x23af bytes) 2024-09-11T05:21:46.662 INFO:teuthology.orchestra.run.smithi012.stdout:91 punch from 0x904038f to 0x904d3a9, (0xd01a bytes) 2024-09-11T05:21:46.662 INFO:teuthology.orchestra.run.smithi012.stdout:92 read 0x3bf7e3a thru 0x3c040dd (0xc2a4 bytes) 2024-09-11T05:21:46.663 INFO:teuthology.orchestra.run.smithi012.stdout:94 clone 2 order 21 su 16384 sc 10 2024-09-11T05:21:46.692 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.692 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:21:46.741 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:46.740+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:46.832 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:21:46.833 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:21:46.833 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-11T05:21:46.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-09-11T05:21:46.844 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.844 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.852 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:21:46.877 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:46.877+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:46.943 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:46.942+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:46.955 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:46.956 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:46.965 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:21:47.048 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:47.047+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:47.109 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:47.109 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:47.117 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:21:47.124 INFO:teuthology.orchestra.run.smithi012.stdout:moved 0 / 82 (0%) 2024-09-11T05:21:47.124 INFO:teuthology.orchestra.run.smithi012.stdout:avg 10.25 2024-09-11T05:21:47.124 INFO:teuthology.orchestra.run.smithi012.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout:oload 1000 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout:max_change 3 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout:max_change_osds 4 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout:average_utilization 0.0003 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stdout:overload_utilization 0.0029 2024-09-11T05:21:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:no change 2024-09-11T05:21:47.137 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-11T05:21:47.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-11T05:21:47.158 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:47.157+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:47.245 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:47.244+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:47.260 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:47.261 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:47.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:21:47.354 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:47.353+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:47.409 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:21:47.414 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:47.414 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:47.424 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:21:47.465 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:47.464+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:moved 0 / 82 (0%) 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:avg 10.25 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:oload 110 2024-09-11T05:21:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:max_change 0.05 2024-09-11T05:21:47.477 INFO:teuthology.orchestra.run.smithi012.stdout:max_change_osds 4 2024-09-11T05:21:47.477 INFO:teuthology.orchestra.run.smithi012.stdout:average_utilization 0.0003 2024-09-11T05:21:47.477 INFO:teuthology.orchestra.run.smithi012.stdout:overload_utilization 0.0003 2024-09-11T05:21:47.477 INFO:teuthology.orchestra.run.smithi012.stderr:no change 2024-09-11T05:21:47.480 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone1 from 0xba9bf63 (overlap 0x516f74f) to 0x0 2024-09-11T05:21:47.492 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-11T05:21:47.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-11T05:21:47.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:47.548+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:47.601 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:47.602 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:47.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:21:47.656 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:47.655+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:47.741 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:47.741 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:47.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:47.750+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:47.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:21:47.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:47.851+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:47.856 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:moved 0 / 82 (0%) 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:avg 10.25 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:oload 110 2024-09-11T05:21:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:max_change 0.05 2024-09-11T05:21:47.876 INFO:teuthology.orchestra.run.smithi012.stdout:max_change_osds 4 2024-09-11T05:21:47.876 INFO:teuthology.orchestra.run.smithi012.stdout:average_utilization 0.0003 2024-09-11T05:21:47.876 INFO:teuthology.orchestra.run.smithi012.stdout:overload_utilization 0.0003 2024-09-11T05:21:47.876 INFO:teuthology.orchestra.run.smithi012.stderr:no change 2024-09-11T05:21:47.891 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-11T05:21:47.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-11T05:21:47.902 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:47.902 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:47.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:21:47.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:21:47.977 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:47.977+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:48.050 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:48.050 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:48.052 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:48.052+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:48.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:21:48.080 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:48.080 INFO:teuthology.orchestra.run.smithi012.stdout:97 writesame 0x9158bd1 thru 0x915975b data_size 0x5(0xb8b bytes) 2024-09-11T05:21:48.088 INFO:teuthology.orchestra.run.smithi012.stdout:98 write 0x1ac2b72 thru 0x1ad2812 (0xfca1 bytes) 2024-09-11T05:21:48.102 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:48.102 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:48.123 INFO:teuthology.orchestra.run.smithi012.stdout:100 writesame 0xc86b4f7 thru 0xc877891 data_size 0x5(0xc39b bytes) 2024-09-11T05:21:48.123 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.124 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:48.124 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:48.131 INFO:teuthology.orchestra.run.smithi012.stdout:106 writesame 0xe161112 thru 0xe163bc6 data_size 0xd(0x2ab5 bytes) 2024-09-11T05:21:48.131 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.131 INFO:teuthology.orchestra.run.smithi012.stdout:108 read 0x192064b thru 0x192ba6c (0xb422 bytes) 2024-09-11T05:21:48.131 INFO:teuthology.orchestra.run.smithi012.stdout:109 write 0x7ad0f16 thru 0x7ad429f (0x338a bytes) 2024-09-11T05:21:48.142 INFO:teuthology.orchestra.run.smithi012.stdout:110 trunc from 0xe163bc7 to 0x83b81d1 2024-09-11T05:21:48.143 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:48.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:48.153+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:48.165 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:48.165 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:48.168 INFO:teuthology.orchestra.run.smithi012.stdout:111 write 0x2f1e366 thru 0x2f22517 (0x41b2 bytes) 2024-09-11T05:21:48.176 INFO:teuthology.orchestra.run.smithi012.stdout:112 read 0x84d3e5 thru 0x85502e (0x7c4a bytes) 2024-09-11T05:21:48.176 INFO:teuthology.orchestra.run.smithi012.stdout:113 punch from 0x8191afd to 0x8199e6f, (0x8372 bytes) 2024-09-11T05:21:48.176 INFO:teuthology.orchestra.run.smithi012.stdout:114 read 0x6ff99dc thru 0x70074b9 (0xdade bytes) 2024-09-11T05:21:48.177 INFO:teuthology.orchestra.run.smithi012.stdout:115 read 0x358f719 thru 0x359c5d1 (0xceb9 bytes) 2024-09-11T05:21:48.182 INFO:teuthology.orchestra.run.smithi012.stdout:116 trunc from 0x83b81d1 to 0xdc1bd73 2024-09-11T05:21:48.187 INFO:teuthology.orchestra.run.smithi012.stdout:117 read 0x7f593b7 thru 0x7f60887 (0x74d1 bytes) 2024-09-11T05:21:48.188 INFO:teuthology.orchestra.run.smithi012.stdout:118 write 0xd41c9a0 thru 0xd429c32 (0xd293 bytes) 2024-09-11T05:21:48.193 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.194 INFO:teuthology.orchestra.run.smithi012.stdout:121 read 0x47af0e6 thru 0x47b764c (0x8567 bytes) 2024-09-11T05:21:48.194 INFO:teuthology.orchestra.run.smithi012.stdout:123 write 0x359688e thru 0x3599a10 (0x3183 bytes) 2024-09-11T05:21:48.197 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:48.199 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.199 INFO:teuthology.orchestra.run.smithi012.stdout:126 read 0x739fc3b thru 0x73ab7ba (0xbb80 bytes) 2024-09-11T05:21:48.199 INFO:teuthology.orchestra.run.smithi012.stdout:127 punch from 0xce3364c to 0xce3dba0, (0xa554 bytes) 2024-09-11T05:21:48.199 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.199 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.199 INFO:teuthology.orchestra.run.smithi012.stdout:130 punch from 0x86c6a94 to 0x86d3223, (0xc78f bytes) 2024-09-11T05:21:48.199 INFO:teuthology.orchestra.run.smithi012.stdout:132 write 0x83257b1 thru 0x8335243 (0xfa93 bytes) 2024-09-11T05:21:48.204 INFO:teuthology.orchestra.run.smithi012.stdout:133 read 0x5bca7d5 thru 0x5bcedc2 (0x45ee bytes) 2024-09-11T05:21:48.204 INFO:teuthology.orchestra.run.smithi012.stdout:136 punch from 0x7aa9b07 to 0x7ab4d4b, (0xb244 bytes) 2024-09-11T05:21:48.204 INFO:teuthology.orchestra.run.smithi012.stdout:137 read 0xbb79df2 thru 0xbb7b3cb (0x15da bytes) 2024-09-11T05:21:48.213 INFO:teuthology.orchestra.run.smithi012.stdout:138 trunc from 0xdc1bd73 to 0x677ff4b 2024-09-11T05:21:48.216 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:48.216 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:48.222 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:48.223 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:48.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:21:48.236 INFO:teuthology.orchestra.run.smithi012.stdout:140 writesame 0x233a688 thru 0x2346b44 data_size 0x7(0xc4bd bytes) 2024-09-11T05:21:48.252 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:48.252 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:48.253 INFO:teuthology.orchestra.run.smithi012.stdout:141 read 0xf0ee3b thru 0xf12291 (0x3457 bytes) 2024-09-11T05:21:48.254 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:48.254+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:48.257 INFO:teuthology.orchestra.run.smithi012.stdout:142 trunc from 0x677ff4b to 0x3685a26 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:143 punch from 0xa39455 to 0xa42b66, (0x9711 bytes) 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:moved 0 / 82 (0%) 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:avg 10.25 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-11T05:21:48.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:48.291 INFO:teuthology.orchestra.run.smithi012.stdout:oload 110 2024-09-11T05:21:48.291 INFO:teuthology.orchestra.run.smithi012.stdout:max_change 1 2024-09-11T05:21:48.291 INFO:teuthology.orchestra.run.smithi012.stdout:max_change_osds 4 2024-09-11T05:21:48.291 INFO:teuthology.orchestra.run.smithi012.stdout:average_utilization 0.0003 2024-09-11T05:21:48.291 INFO:teuthology.orchestra.run.smithi012.stdout:overload_utilization 0.0003 2024-09-11T05:21:48.291 INFO:teuthology.orchestra.run.smithi012.stdout:145 trunc from 0x3685a26 to 0x3091d1a 2024-09-11T05:21:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:no change 2024-09-11T05:21:48.302 INFO:teuthology.orchestra.run.smithi012.stdout:146 punch from 0x158f54f to 0x158fb26, (0x5d7 bytes) 2024-09-11T05:21:48.303 INFO:teuthology.orchestra.run.smithi012.stdout:147 read 0x2c756b3 thru 0x2c7c70e (0x705c bytes) 2024-09-11T05:21:48.306 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-11T05:21:48.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-09-11T05:21:48.307 INFO:teuthology.orchestra.run.smithi012.stdout:148 trunc from 0x3091d1a to 0x6420928 2024-09-11T05:21:48.314 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.314 INFO:teuthology.orchestra.run.smithi012.stdout:150 read 0x52b8848 thru 0x52c727c (0xea35 bytes) 2024-09-11T05:21:48.324 INFO:teuthology.orchestra.run.smithi012.stdout:151 write 0x8abebb6 thru 0x8ac1b8d (0x2fd8 bytes) 2024-09-11T05:21:48.331 INFO:teuthology.orchestra.run.smithi012.stdout:152 read 0xa4800d thru 0xa532b8 (0xb2ac bytes) 2024-09-11T05:21:48.331 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.331 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.331 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.331 INFO:teuthology.orchestra.run.smithi012.stdout:159 write 0x1cbc0bd thru 0x1cc60cf (0xa013 bytes) 2024-09-11T05:21:48.350 INFO:teuthology.orchestra.run.smithi012.stdout:160 read 0x2d93319 thru 0x2d98bd2 (0x58ba bytes) 2024-09-11T05:21:48.351 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.351 INFO:teuthology.orchestra.run.smithi012.stdout:162 read 0x1e85b90 thru 0x1e93695 (0xdb06 bytes) 2024-09-11T05:21:48.352 INFO:teuthology.orchestra.run.smithi012.stdout:163 read 0x4313ae1 thru 0x4321c00 (0xe120 bytes) 2024-09-11T05:21:48.352 INFO:teuthology.orchestra.run.smithi012.stdout:164 writesame 0xd8d339 thru 0xd97839 data_size 0x1(0xa501 bytes) 2024-09-11T05:21:48.354 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:48.354+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:48.369 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:48.369 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:48.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:48.369 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:48.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 19.533494859000001, 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0055014299999999999, 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:48.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834691+0000", 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-07 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834777+0000", 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5338000000000002e-05 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834789+0000", 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2809000000000001e-05 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834807+0000", 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7346e-05 2024-09-11T05:21:48.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834860+0000", 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2714999999999999e-05 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.834881+0000", 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1759999999999998e-05 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840133+0000", 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0052513509999999996 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.840192+0000", 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9417999999999999e-05 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'15)", 2024-09-11T05:21:48.374 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 19.530931853999999, 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0056426719999999996, 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837254+0000", 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.54e-07 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837260+0000", 2024-09-11T05:21:48.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3820000000000003e-06 2024-09-11T05:21:48.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837269+0000", 2024-09-11T05:21:48.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2269999999999999e-06 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837277+0000", 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837343+0000", 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6841999999999995e-05 2024-09-11T05:21:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.837363+0000", 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9809999999999998e-05 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.842857+0000", 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0054938920000000002 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.842896+0000", 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9115000000000001e-05 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:28.884775+0000", 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 19.483410453000001, 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.005419798, 2024-09-11T05:21:48.380 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884775+0000", 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884775+0000", 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884776+0000", 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4899999999999995e-07 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884827+0000", 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1817000000000002e-05 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884837+0000", 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3349999999999996e-06 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884842+0000", 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2889999999999997e-06 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884889+0000", 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6799999999999999e-05 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.884902+0000", 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.311e-05 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.890139+0000", 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0052367409999999996 2024-09-11T05:21:48.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:28.890195+0000", 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6156999999999998e-05 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4207.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'90)", 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.833609568, 2024-09-11T05:21:48.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0054473009999999999, 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534576+0000", 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.37e-07 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534581+0000", 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0829999999999997e-06 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534589+0000", 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4169999999999992e-06 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534595+0000", 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.84e-06 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534791+0000", 2024-09-11T05:21:48.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019571899999999999 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.534812+0000", 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1362e-05 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.539994+0000", 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051821640000000004 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:29.540023+0000", 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9179e-05 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:44.410162+0000", 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.958023222, 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0080536380000000001, 2024-09-11T05:21:48.390 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 11 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410162+0000", 2024-09-11T05:21:48.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410162+0000", 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410164+0000", 2024-09-11T05:21:48.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.03e-06 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410175+0000", 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1119e-05 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410196+0000", 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0721999999999999e-05 2024-09-11T05:21:48.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410209+0000", 2024-09-11T05:21:48.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2796000000000001e-05 2024-09-11T05:21:48.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410270+0000", 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0797000000000001e-05 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op must wait for map", 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.410274+0000", 2024-09-11T05:21:48.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6160000000000004e-06 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.413632+0000", 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033579759999999999 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.413778+0000", 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014591499999999999 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:21:48.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.413957+0000", 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017878800000000001 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.415405+0000", 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0014477380000000001 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418140+0000", 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0027356440000000002 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418180+0000", 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0088e-05 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:44.418216+0000", 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5408999999999999e-05 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2046 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 131072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150098+0000", 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21808772900000001, 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0053260640000000001, 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2046 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150098+0000", 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150098+0000", 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150098+0000", 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150100+0000", 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2400000000000002e-06 2024-09-11T05:21:48.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150107+0000", 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5239999999999997e-06 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150112+0000", 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9339999999999997e-06 2024-09-11T05:21:48.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155013+0000", 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049008599999999999 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155111+0000", 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8675e-05 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155424+0000", 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00031241 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2047 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150118+0000", 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21806762800000001, 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0055641589999999999, 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2047 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150118+0000", 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150118+0000", 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150118+0000", 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6699999999999999e-07 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150120+0000", 2024-09-11T05:21:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.841e-06 2024-09-11T05:21:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150126+0000", 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.993e-06 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150131+0000", 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6890000000000003e-06 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155489+0000", 2024-09-11T05:21:48.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0053586789999999999 2024-09-11T05:21:48.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155591+0000", 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000101993 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155682+0000", 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0597e-05 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2048 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150137+0000", 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.218048824, 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0057817770000000001, 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2048 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.412 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150137+0000", 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150137+0000", 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150137+0000", 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2000000000000001e-07 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150139+0000", 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.784e-06 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150145+0000", 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.925e-06 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150149+0000", 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6759999999999998e-06 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155729+0000", 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0055794590000000002 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155830+0000", 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000101362 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155918+0000", 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8251000000000006e-05 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2049 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 229376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150155+0000", 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.218030371, 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0059799780000000004, 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2049 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150155+0000", 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150155+0000", 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150155+0000", 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.27e-07 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150157+0000", 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.807e-06 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150163+0000", 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0190000000000003e-06 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150168+0000", 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:21:48.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.155963+0000", 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0057951699999999997 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156053+0000", 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0397999999999997e-05 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156135+0000", 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1710000000000002e-05 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2050 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 16384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150174+0000", 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21801167799999999, 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0062303829999999999, 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2050 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150174+0000", 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150174+0000", 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150174+0000", 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150176+0000", 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.767e-06 2024-09-11T05:21:48.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150182+0000", 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0630000000000002e-06 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150187+0000", 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5419999999999999e-06 2024-09-11T05:21:48.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156176+0000", 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0059893780000000001 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156266+0000", 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0332000000000002e-05 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156404+0000", 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000137964 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2051 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 49152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150192+0000", 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21799354700000001, 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0065109130000000001, 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2051 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150192+0000", 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150192+0000", 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150192+0000", 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.22e-07 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150201+0000", 2024-09-11T05:21:48.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9109999999999999e-06 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150208+0000", 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5860000000000001e-06 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150212+0000", 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156458+0000", 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0062458649999999998 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156581+0000", 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012234 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156703+0000", 2024-09-11T05:21:48.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012218999999999999 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2052 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 81920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150219+0000", 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21796644900000001, 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0067347539999999999, 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2052 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150219+0000", 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150219+0000", 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150219+0000", 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.01e-07 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150222+0000", 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0930000000000001e-06 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150228+0000", 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3949999999999998e-06 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150235+0000", 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156749+0000", 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0065141519999999996 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156841+0000", 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2188999999999994e-05 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156954+0000", 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011289 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2053 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.435 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150242+0000", 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21794387500000001, 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0069537799999999997, 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2053 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150242+0000", 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150242+0000", 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150242+0000", 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150244+0000", 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.04e-06 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150251+0000", 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5830000000000003e-06 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150266+0000", 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.588e-05 2024-09-11T05:21:48.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.156996+0000", 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0067297110000000002 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157085+0000", 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8807999999999994e-05 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157195+0000", 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011038400000000001 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2054 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 147456~5217] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150290+0000", 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.217895802, 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0073107340000000002, 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.440 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2054 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150290+0000", 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150290+0000", 2024-09-11T05:21:48.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150290+0000", 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.82e-07 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150293+0000", 2024-09-11T05:21:48.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4200000000000001e-06 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150300+0000", 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0949999999999998e-06 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150305+0000", 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0769999999999998e-06 2024-09-11T05:21:48.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157240+0000", 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0069351259999999998 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157337+0000", 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7441000000000004e-05 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157600+0000", 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026299299999999999 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2055 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150311+0000", 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.217874286, 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0075212300000000003, 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2055 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150311+0000", 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150311+0000", 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150312+0000", 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150314+0000", 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.891e-06 2024-09-11T05:21:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150320+0000", 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0209999999999996e-06 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150331+0000", 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.149e-05 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157647+0000", 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0073155759999999998 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157742+0000", 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5241000000000005e-05 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157832+0000", 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0555000000000003e-05 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2056 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 212992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150346+0000", 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21783909700000001, 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0077097820000000001, 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2056 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150346+0000", 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150346+0000", 2024-09-11T05:21:48.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150347+0000", 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.01e-07 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150349+0000", 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1280000000000002e-06 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150355+0000", 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.579e-06 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150360+0000", 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8029999999999996e-06 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157875+0000", 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0075146049999999997 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.157970+0000", 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5266999999999994e-05 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.158056+0000", 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5999000000000001e-05 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2057 3.1b 3:df27f123:::rbd_data.1179e5aa145a.000000000000022e:4 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.454 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.150367+0000", 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21781809599999999, 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.008056545, 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2057 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150367+0000", 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150367+0000", 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150368+0000", 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3700000000000001e-07 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150385+0000", 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7221999999999999e-05 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150393+0000", 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6109999999999996e-06 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.150398+0000", 2024-09-11T05:21:48.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.356e-06 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.158242+0000", 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0078441540000000008 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.158343+0000", 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100515 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.158424+0000", 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1249999999999996e-05 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2216 3.18 e27/22 3:1ad149f8:::rbd_data.1179262aa3d7.0000000000000016:head v 27'27, mlcod=27'25)", 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.276840+0000", 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.091345701000000001, 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0061325429999999998, 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276840+0000", 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276840+0000", 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276841+0000", 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1399999999999996e-07 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276848+0000", 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4800000000000004e-06 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276860+0000", 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1522000000000001e-05 2024-09-11T05:21:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276867+0000", 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3130000000000001e-06 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276945+0000", 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8005999999999998e-05 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.276967+0000", 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2368e-05 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282927+0000", 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0059601599999999999 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282972+0000", 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4879999999999997e-05 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2218 3.1 3:852c2043:::rbd_data.1179262aa3d7.0000000000000018:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,truncate 1523712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.277152+0000", 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.091033898000000002, 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0058956369999999996, 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2218 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277152+0000", 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277152+0000", 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277153+0000", 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.122e-06 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277159+0000", 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8309999999999997e-06 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277170+0000", 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1447000000000001e-05 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277177+0000", 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6800000000000004e-06 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277240+0000", 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3548999999999998e-05 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277358+0000", 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000117915 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 4", 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277541+0000", 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00018302699999999999 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278294+0000", 2024-09-11T05:21:48.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00075260099999999999 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282933+0000", 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046392660000000004 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282989+0000", 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6449000000000001e-05 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.283047+0000", 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7750000000000001e-05 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2220 3.17 3:e8cace3b:::rbd_data.1179262aa3d7.000000000000001c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,truncate 1523712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.277244+0000", 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.090941449999999993, 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0058091699999999998, 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2220 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277244+0000", 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277244+0000", 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277245+0000", 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7000000000000004e-07 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277251+0000", 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0959999999999997e-06 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277260+0000", 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1540000000000008e-06 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277267+0000", 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277323+0000", 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6691000000000003e-05 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277438+0000", 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011413600000000001 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277608+0000", 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017040100000000001 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278348+0000", 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00073973400000000003 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282943+0000", 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045949509999999999 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282992+0000", 2024-09-11T05:21:48.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9174e-05 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.283053+0000", 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1402000000000006e-05 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.476 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:48.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:21:48.481 INFO:teuthology.orchestra.run.smithi012.stdout:165 writesame 0x500d4eb thru 0x5017a7d data_size 0x47(0xa593 bytes) 2024-09-11T05:21:48.481 INFO:teuthology.orchestra.run.smithi012.stdout:166 punch from 0x48651c4 to 0x486f388, (0xa1c4 bytes) 2024-09-11T05:21:48.481 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.481 INFO:teuthology.orchestra.run.smithi012.stdout:168 read 0x2b63a79 thru 0x2b71756 (0xdcde bytes) 2024-09-11T05:21:48.481 INFO:teuthology.orchestra.run.smithi012.stdout:170 punch from 0x528ede4 to 0x529e9c3, (0xfbdf bytes) 2024-09-11T05:21:48.481 INFO:teuthology.orchestra.run.smithi012.stdout:174 trunc from 0x8ac1b8e to 0x72425dd 2024-09-11T05:21:48.481 INFO:teuthology.orchestra.run.smithi012.stdout:176 read 0x4e7e037 thru 0x4e84e06 (0x6dd0 bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:truncating to largest ever: 0xea949ea 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:177 trunc from 0x72425dd to 0xea949ea 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:178 write 0x6806c72 thru 0x680bdfb (0x518a bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:180 write 0xc356390 thru 0xc3655a7 (0xf218 bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:181 write 0x22a14f4 thru 0x22a2e30 (0x193d bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:182 writesame 0xdd38345 thru 0xdd3fff3 data_size 0x1(0x7caf bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:183 punch from 0xe9f2f64 to 0xe9f68cf, (0x396b bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:184 writesame 0xd2d3384 thru 0xd2db732 data_size 0x11(0x83af bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:185 write 0x6b770dd thru 0x6b7976e (0x2692 bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:186 trunc from 0xea949ea to 0x992bb13 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:189 write 0x704732a thru 0x7049719 (0x23f0 bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:193 punch from 0x4361910 to 0x437146b, (0xfb5b bytes) 2024-09-11T05:21:48.482 INFO:teuthology.orchestra.run.smithi012.stdout:195 read 0x55192ca thru 0x55200b9 (0x6df0 bytes) 2024-09-11T05:21:48.483 INFO:teuthology.orchestra.run.smithi012.stdout:197 write 0x56b5f16 thru 0x56b62bb (0x3a6 bytes) 2024-09-11T05:21:48.483 INFO:teuthology.orchestra.run.smithi012.stdout:203 punch from 0x67d6f89 to 0x67e0e2e, (0x9ea5 bytes) 2024-09-11T05:21:48.483 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.483 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:48.479+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:48.484 INFO:teuthology.orchestra.run.smithi012.stdout:206 trunc from 0x992bb13 to 0x5e41fd7 2024-09-11T05:21:48.499 INFO:teuthology.orchestra.run.smithi012.stdout:208 write 0x38d59d2 thru 0x38d633a (0x969 bytes) 2024-09-11T05:21:48.512 INFO:teuthology.orchestra.run.smithi012.stdout:209 write 0xa8b104a thru 0xa8b2a1c (0x19d3 bytes) 2024-09-11T05:21:48.515 INFO:teuthology.orchestra.run.smithi012.stdout:210 read 0xdfd95d thru 0xe0963f (0xbce3 bytes) 2024-09-11T05:21:48.525 INFO:teuthology.orchestra.run.smithi012.stdout:212 trunc from 0xa8b2a1d to 0x4228abd 2024-09-11T05:21:48.542 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.543 INFO:teuthology.orchestra.run.smithi012.stdout:215 read 0x189e214 thru 0x18a5c1d (0x7a0a bytes) 2024-09-11T05:21:48.549 INFO:teuthology.orchestra.run.smithi012.stdout:216 writesame 0x42d72cf thru 0x42e17fa data_size 0x3e(0xa52c bytes) 2024-09-11T05:21:48.554 INFO:teuthology.orchestra.run.smithi012.stdout:217 trunc from 0x42e17fb to 0x7f923f3 2024-09-11T05:21:48.561 INFO:teuthology.orchestra.run.smithi012.stdout:218 write 0x6d380ec thru 0x6d474e4 (0xf3f9 bytes) 2024-09-11T05:21:48.570 INFO:teuthology.orchestra.run.smithi012.stdout:219 punch from 0x21a2da6 to 0x21a9295, (0x64ef bytes) 2024-09-11T05:21:48.570 INFO:teuthology.orchestra.run.smithi012.stdout:221 punch from 0x786d3bf to 0x78773d6, (0xa017 bytes) 2024-09-11T05:21:48.570 INFO:teuthology.orchestra.run.smithi012.stdout:222 read 0x17b3774 thru 0x17ba9ad (0x723a bytes) 2024-09-11T05:21:48.581 INFO:teuthology.orchestra.run.smithi012.stdout:223 write 0xac11ce9 thru 0xac14eea (0x3202 bytes) 2024-09-11T05:21:48.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:48.581+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:48.586 INFO:teuthology.orchestra.run.smithi012.stdout:224 write 0x57ebaaa thru 0x57f9c6e (0xe1c5 bytes) 2024-09-11T05:21:48.597 INFO:teuthology.orchestra.run.smithi012.stdout:225 writesame 0xac050ab thru 0xac12d94 data_size 0x1(0xdcea bytes) 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2725 3.0 3:006e61e3:::rbd_data.1179262aa3d7.0000000000000050:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same in=1b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0033352080000000001, 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033668729999999998, 2024-09-11T05:21:48.603 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2725 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599980+0000", 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599986+0000", 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599996+0000", 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.061e-05 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600001+0000", 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.079e-06 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600047+0000", 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5334000000000003e-05 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600143+0000", 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6178e-05 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.601427+0000", 2024-09-11T05:21:48.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012841790000000001 2024-09-11T05:21:48.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.608 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.608 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:21:48.608 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 1 2024-09-11T05:21:48.608 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:48.614 INFO:teuthology.orchestra.run.smithi012.stdout:226 trunc from 0xac14eeb to 0xc683c20 2024-09-11T05:21:48.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:21:48.620 INFO:teuthology.orchestra.run.smithi012.stdout:228 read 0xc60352 thru 0xc6488f (0x453e bytes) 2024-09-11T05:21:48.620 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.620 INFO:teuthology.orchestra.run.smithi012.stdout:230 write 0x7aa8fbe thru 0x7ab3fb3 (0xaff6 bytes) 2024-09-11T05:21:48.633 INFO:teuthology.orchestra.run.smithi012.stdout:231 trunc from 0xc683c20 to 0x7ec1013 2024-09-11T05:21:48.649 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.649 INFO:teuthology.orchestra.run.smithi012.stdout:235 writesame 0xfca040 thru 0xfced97 data_size 0x6e(0x4d58 bytes) 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:moved 0 / 82 (0%) 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:avg 10.25 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:oload 1000 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:max_change 3 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:max_change_osds 4 2024-09-11T05:21:48.663 INFO:teuthology.orchestra.run.smithi012.stdout:average_utilization 0.0003 2024-09-11T05:21:48.664 INFO:teuthology.orchestra.run.smithi012.stdout:overload_utilization 0.0029 2024-09-11T05:21:48.664 INFO:teuthology.orchestra.run.smithi012.stderr:no change 2024-09-11T05:21:48.677 INFO:teuthology.orchestra.run.smithi012.stdout:236 writesame 0xccac853 thru 0xccb820d data_size 0x1b(0xb9bb bytes) 2024-09-11T05:21:48.678 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.678 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:48.678 INFO:teuthology.orchestra.run.smithi012.stdout:239 write 0x52e6bae thru 0x52f5417 (0xe86a bytes) 2024-09-11T05:21:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:241 punch from 0x17559bd to 0x175c329, (0x696c bytes) 2024-09-11T05:21:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:243 write 0xa17b7a1 thru 0xa18244d (0x6cad bytes) 2024-09-11T05:21:48.682 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:48.680+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:48.686 INFO:teuthology.orchestra.run.smithi012.stdout:244 write 0xabc8110 thru 0xabd6591 (0xe482 bytes) 2024-09-11T05:21:48.691 INFO:teuthology.orchestra.run.smithi012.stdout:245 write 0x950eb43 thru 0x951d29e (0xe75c bytes) 2024-09-11T05:21:48.697 INFO:teuthology.orchestra.run.smithi012.stdout:250 read 0x653ee3a thru 0x654e499 (0xf660 bytes) 2024-09-11T05:21:48.697 INFO:teuthology.orchestra.run.smithi012.stdout:253 read 0x27ad877 thru 0x27b11f1 (0x397b bytes) 2024-09-11T05:21:48.697 INFO:teuthology.orchestra.run.smithi012.stdout:254 read 0x65e46d4 thru 0x65ee747 (0xa074 bytes) 2024-09-11T05:21:48.698 INFO:teuthology.orchestra.run.smithi012.stdout:256 clone 3 order 19 su 16384 sc 9 2024-09-11T05:21:48.739 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:48.739 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:48.739 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:48.739 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:48.739 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:48.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:21:48.782 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:48.781+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:48.883 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:48.883+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:48.896 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:1982 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write 704512~10259] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.105926+0000", 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.78944837099999998, 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0089803130000000002, 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 1982 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.105926+0000", 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.105926+0000", 2024-09-11T05:21:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.105928+0000", 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107145+0000", 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012170760000000001 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107169+0000", 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3699000000000001e-05 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107177+0000", 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8799999999999997e-06 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107250+0000", 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2721999999999999e-05 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107419+0000", 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016861799999999999 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107747+0000", 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00032834599999999998 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.113571+0000", 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0058238179999999997 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.114778+0000", 2024-09-11T05:21:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001206737 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.114851+0000", 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3004999999999996e-05 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.114906+0000", 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5547999999999997e-05 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2196 3.19 3:985e8a3c:::rbd_data.1179262aa3d7.0000000000000034:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.259906+0000", 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.63546870499999997, 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0024022739999999998, 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2196 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259906+0000", 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259906+0000", 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259908+0000", 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.429e-06 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259917+0000", 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1269999999999992e-06 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259938+0000", 2024-09-11T05:21:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1251999999999999e-05 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259951+0000", 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3112000000000001e-05 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260039+0000", 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7015999999999995e-05 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260141+0000", 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000102363 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260261+0000", 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011988400000000001 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261332+0000", 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010707570000000001 2024-09-11T05:21:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.262227+0000", 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00089501900000000004 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.262269+0000", 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2382999999999997e-05 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.262308+0000", 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8931999999999999e-05 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2197 3.4 3:25127f41:::rbd_data.1179262aa3d7.0000000000000035:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.259992+0000", 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.63538224499999996, 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0022791019999999999, 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.910 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2197 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259992+0000", 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259992+0000", 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259993+0000", 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4000000000000002e-07 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.259996+0000", 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2590000000000001e-06 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260004+0000", 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0499999999999992e-06 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260010+0000", 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8259999999999998e-06 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260067+0000", 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6929000000000003e-05 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260144+0000", 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7480999999999999e-05 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260261+0000", 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116661 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261349+0000", 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010883240000000001 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.262155+0000", 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000805644 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.262217+0000", 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1925000000000001e-05 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.262271+0000", 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4462999999999997e-05 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2217 3.8 e27/22 3:101b5d08:::rbd_data.1179262aa3d7.0000000000000017:head v 27'23, mlcod=27'21)", 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.277207+0000", 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.61816755400000001, 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030537020000000002, 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277207+0000", 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277207+0000", 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277208+0000", 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1880000000000001e-06 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277223+0000", 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4722000000000001e-05 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277244+0000", 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1257999999999999e-05 2024-09-11T05:21:48.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277253+0000", 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1619999999999997e-06 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277317+0000", 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3697999999999999e-05 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.277337+0000", 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0723000000000001e-05 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.280214+0000", 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0028766099999999999 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.280260+0000", 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6341000000000002e-05 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.920 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2219 3.8 e27/22 3:16d1b624:::rbd_data.1179262aa3d7.000000000000001b:head v 27'24, mlcod=27'21)", 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.278153+0000", 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.61722138999999998, 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048852629999999999, 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278153+0000", 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278153+0000", 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278154+0000", 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3099999999999997e-07 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278159+0000", 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.096e-06 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278169+0000", 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9469999999999998e-06 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278173+0000", 2024-09-11T05:21:48.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278230+0000", 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6965000000000001e-05 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278251+0000", 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0564000000000002e-05 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282996+0000", 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047449140000000002 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.283038+0000", 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2466999999999998e-05 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2237 3.8 e27/22 3:16d1b624:::rbd_data.1179262aa3d7.000000000000001b:head v 27'26, mlcod=27'23)", 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.292983+0000", 2024-09-11T05:21:48.925 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.60239166600000005, 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002697999, 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.292983+0000", 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.292983+0000", 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.292984+0000", 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.16e-07 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.292990+0000", 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.293001+0000", 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1025e-05 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.293008+0000", 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.293054+0000", 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5949999999999999e-05 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.293074+0000", 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9675999999999999e-05 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.295644+0000", 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025698190000000001 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.295681+0000", 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.701e-05 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2527 3.1a e27/22 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:head v 27'28, mlcod=27'26)", 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.376363+0000", 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.51901156800000003, 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0054494330000000001, 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.376363+0000", 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.376363+0000", 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.376365+0000", 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9489999999999999e-06 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.378985+0000", 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026199249999999999 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379002+0000", 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7754999999999999e-05 2024-09-11T05:21:48.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379011+0000", 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7879999999999995e-06 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379086+0000", 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5065e-05 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379112+0000", 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5846999999999998e-05 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.381765+0000", 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026525350000000001 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.381812+0000", 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7568999999999998e-05 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.934 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2578 3.4 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.429220+0000", 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.46615473400000002, 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0081629230000000007, 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2578 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.935 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429220+0000", 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429220+0000", 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429221+0000", 2024-09-11T05:21:48.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9800000000000002e-07 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429226+0000", 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429239+0000", 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3392e-05 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429247+0000", 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6190000000000002e-06 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429324+0000", 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7288999999999998e-05 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429405+0000", 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0854999999999998e-05 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.430408+0000", 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001002735 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437226+0000", 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0068181919999999998 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437250+0000", 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4420999999999999e-05 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437315+0000", 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4601e-05 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437382+0000", 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7521999999999995e-05 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:2578 3.4 e27/22 ondisk, result = 0)", 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.434273+0000", 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.46110089500000001, 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029652530000000002, 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.434273+0000", 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.434273+0000", 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.434275+0000", 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.434281+0000", 2024-09-11T05:21:48.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0179999999999998e-06 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.434295+0000", 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4477999999999999e-05 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.434306+0000", 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0457e-05 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437205+0000", 2024-09-11T05:21:48.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0028997129999999999 2024-09-11T05:21:48.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437215+0000", 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7550000000000006e-06 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437239+0000", 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3668000000000001e-05 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2597 3.4 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.945 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.454468+0000", 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.440906046, 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0038700599999999998, 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2597 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454468+0000", 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454468+0000", 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454470+0000", 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9e-06 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454489+0000", 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9014000000000001e-05 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454510+0000", 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0823e-05 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454523+0000", 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.343e-05 2024-09-11T05:21:48.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454611+0000", 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7596000000000006e-05 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454706+0000", 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5351000000000002e-05 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454817+0000", 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011068 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455632+0000", 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00081504099999999996 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458238+0000", 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026064159999999999 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458293+0000", 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4747000000000003e-05 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458338+0000", 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5062000000000003e-05 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.951 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2590 3.1a e27/22 3:5b4ca92b:::rbd_data.1179262aa3d7.000000000000005c:head v 27'30, mlcod=27'28)", 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.455148+0000", 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.44022587699999999, 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031174380000000002, 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455148+0000", 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455148+0000", 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455149+0000", 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455157+0000", 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.729e-06 2024-09-11T05:21:48.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455169+0000", 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2014000000000001e-05 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455176+0000", 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.092e-06 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455237+0000", 2024-09-11T05:21:48.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0863000000000003e-05 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455257+0000", 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9429999999999999e-05 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458224+0000", 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029675740000000002 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458266+0000", 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1699999999999997e-05 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2595 3.6 e27/22 3:63f20bec:::rbd_data.1179262aa3d7.0000000000000067:head v 27'53, mlcod=27'51)", 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.455213+0000", 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.44016093499999998, 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003057882, 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455213+0000", 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455213+0000", 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455214+0000", 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5199999999999997e-07 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455219+0000", 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9960000000000001e-06 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455228+0000", 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3489999999999998e-06 2024-09-11T05:21:48.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455234+0000", 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455298+0000", 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3641999999999998e-05 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455319+0000", 2024-09-11T05:21:48.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1254999999999999e-05 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458230+0000", 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002910719 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458271+0000", 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1585999999999998e-05 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2624 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head [truncate 1490944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.490870+0000", 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.40450407799999999, 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003897017, 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2624 2024-09-11T05:21:48.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490870+0000", 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490870+0000", 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490872+0000", 2024-09-11T05:21:48.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490879+0000", 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2280000000000001e-06 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490898+0000", 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8683000000000001e-05 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490907+0000", 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4890000000000001e-06 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490979+0000", 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1452999999999995e-05 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491077+0000", 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7788999999999995e-05 2024-09-11T05:21:48.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491208+0000", 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000131688 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491841+0000", 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00063230600000000001 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494662+0000", 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002821039 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494711+0000", 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494767+0000", 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6221000000000003e-05 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2623 3.8 e27/22 3:110018a8:::rbd_data.1179262aa3d7.000000000000002d:head v 27'28, mlcod=27'26)", 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.491281+0000", 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.40409352599999998, 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033215300000000001, 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491281+0000", 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491281+0000", 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491282+0000", 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.78e-07 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491289+0000", 2024-09-11T05:21:48.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5979999999999999e-06 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491301+0000", 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1598e-05 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491308+0000", 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3429999999999998e-06 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491365+0000", 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7107000000000001e-05 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491385+0000", 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9626000000000001e-05 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494565+0000", 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031795730000000002 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494602+0000", 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7707000000000003e-05 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2654 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.528415+0000", 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.36695918300000002, 2024-09-11T05:21:48.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003966341, 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2654 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528415+0000", 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528415+0000", 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528418+0000", 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4399999999999999e-06 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528429+0000", 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1005999999999999e-05 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528448+0000", 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9796000000000002e-05 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528462+0000", 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3651e-05 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528549+0000", 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7242000000000003e-05 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528640+0000", 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0704000000000004e-05 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528757+0000", 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000117259 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529410+0000", 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00065302999999999997 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532317+0000", 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029065060000000001 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532350+0000", 2024-09-11T05:21:48.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3528999999999997e-05 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532381+0000", 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1177999999999999e-05 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2653 3.8 e27/22 3:110018a8:::rbd_data.1179262aa3d7.000000000000002d:head v 27'30, mlcod=27'28)", 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.528770+0000", 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.36660439299999997, 2024-09-11T05:21:48.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0061789940000000002, 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528770+0000", 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528770+0000", 2024-09-11T05:21:48.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528771+0000", 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9299999999999996e-07 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528778+0000", 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528788+0000", 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0373999999999999e-05 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528795+0000", 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3260000000000001e-06 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528866+0000", 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1239e-05 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528887+0000", 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0859000000000001e-05 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534913+0000", 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0060259989999999998 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534949+0000", 2024-09-11T05:21:48.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6127999999999997e-05 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2655 3.1a e27/22 3:5b95b2d1:::rbd_data.1179262aa3d7.0000000000000056:head v 27'32, mlcod=27'30)", 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.36650770100000002, 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0061149840000000004, 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:21:48.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528872+0000", 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.561e-06 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528880+0000", 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7630000000000006e-06 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528886+0000", 2024-09-11T05:21:48.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0889999999999999e-06 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528937+0000", 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.113e-05 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528957+0000", 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0639e-05 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534942+0000", 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0059850140000000003 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534982+0000", 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9261000000000002e-05 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2725 3.0 3:006e61e3:::rbd_data.1179262aa3d7.0000000000000050:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same in=1b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.295395772, 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010092702, 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2725 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599980+0000", 2024-09-11T05:21:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599986+0000", 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599996+0000", 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.061e-05 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600001+0000", 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.079e-06 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600047+0000", 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5334000000000003e-05 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600143+0000", 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6178e-05 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.601427+0000", 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012841790000000001 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609994+0000", 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0085668789999999995 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.610005+0000", 2024-09-11T05:21:48.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0923e-05 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.610038+0000", 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3127000000000003e-05 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.610071+0000", 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3136999999999998e-05 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:2725 3.0 e27/22 ondisk, result = 0)", 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.606193+0000", 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.289181666, 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0038066010000000002, 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606193+0000", 2024-09-11T05:21:48.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606193+0000", 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606194+0000", 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606199+0000", 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4489999999999998e-06 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606211+0000", 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2115e-05 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606221+0000", 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4350000000000003e-06 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609983+0000", 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0037621550000000001 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609990+0000", 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.657e-06 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609999+0000", 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6250000000000002e-06 2024-09-11T05:21:48.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2748 3.6 e27/22 3:6686f4d9:::rbd_data.1179262aa3d7.0000000000000052:head v 27'57, mlcod=27'55)", 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.636155+0000", 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.25921927700000003, 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030633539999999999, 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:48.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636155+0000", 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636155+0000", 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636156+0000", 2024-09-11T05:21:48.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636163+0000", 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3730000000000004e-06 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636174+0000", 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0151e-05 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:48.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636181+0000", 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0890000000000002e-06 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636376+0000", 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019554899999999999 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636397+0000", 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1019999999999999e-05 2024-09-11T05:21:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.639182+0000", 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00278481 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.639218+0000", 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6259e-05 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.001 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:49.005 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:21:49.005 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:49.003+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:49.104 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:49.103+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:49.153 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:49.153 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:49.153 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:21:49.153 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:49.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:21:49.205 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:49.205+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:49.268 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:49.268 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:49.268 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:49.268 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:49.268 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:49.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:21:49.306 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:49.305+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:49.407 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:49.407+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:49.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:21:49.430 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:49.430 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:49.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:49.430 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4253.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 16.654259975999999, 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0041632789999999998, 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:49.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774978+0000", 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8799999999999999e-07 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774986+0000", 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3669999999999997e-06 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774997+0000", 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1274000000000001e-05 2024-09-11T05:21:49.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775005+0000", 2024-09-11T05:21:49.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6660000000000008e-06 2024-09-11T05:21:49.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775080+0000", 2024-09-11T05:21:49.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4821999999999996e-05 2024-09-11T05:21:49.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775102+0000", 2024-09-11T05:21:49.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1894000000000001e-05 2024-09-11T05:21:49.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779079+0000", 2024-09-11T05:21:49.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039771809999999998 2024-09-11T05:21:49.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779141+0000", 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1886999999999999e-05 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.438 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2004 3.4 e27/22 3:201bc152:::rbd_data.1179262aa3d7.000000000000003d:head v 27'30, mlcod=27'28)", 2024-09-11T05:21:49.438 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.134661+0000", 2024-09-11T05:21:49.439 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.294576105, 2024-09-11T05:21:49.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0009884850000000001, 2024-09-11T05:21:49.439 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.440 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134661+0000", 2024-09-11T05:21:49.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134661+0000", 2024-09-11T05:21:49.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134663+0000", 2024-09-11T05:21:49.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.319e-06 2024-09-11T05:21:49.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134675+0000", 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2075999999999999e-05 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134694+0000", 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9259e-05 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134705+0000", 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1551e-05 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134783+0000", 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7856999999999997e-05 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134812+0000", 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8291999999999999e-05 2024-09-11T05:21:49.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.135597+0000", 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00078563000000000005 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.135650+0000", 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2500999999999998e-05 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2006 3.9 e27/22 3:935a0507:::rbd_data.1179262aa3d7.0000000000000048:head v 27'21, mlcod=27'19)", 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.145509+0000", 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.2837288739999999, 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00076303799999999995, 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145509+0000", 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145509+0000", 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145510+0000", 2024-09-11T05:21:49.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.736e-06 2024-09-11T05:21:49.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145523+0000", 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2464e-05 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145540+0000", 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7229000000000001e-05 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145552+0000", 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.234e-05 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145617+0000", 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4880000000000002e-05 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.145637+0000", 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9741e-05 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.146228+0000", 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00059070599999999998 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.146272+0000", 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3942e-05 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2009 3.4 e27/22 3:201bc152:::rbd_data.1179262aa3d7.000000000000003d:head v 27'31, mlcod=27'29)", 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.148665+0000", 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.280571962, 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00087414899999999995, 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148665+0000", 2024-09-11T05:21:49.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148665+0000", 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148666+0000", 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.78e-07 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148674+0000", 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0129999999999993e-06 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148692+0000", 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7600000000000001e-05 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148700+0000", 2024-09-11T05:21:49.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3140000000000004e-06 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148783+0000", 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2989000000000001e-05 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148804+0000", 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0854999999999999e-05 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.149492+0000", 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00068842999999999997 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.149540+0000", 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7070000000000002e-05 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2118 3.4 e27/22 3:201bc152:::rbd_data.1179262aa3d7.000000000000003d:head v 27'32, mlcod=27'30)", 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.216386+0000", 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.2128513329999999, 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00076177700000000005, 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216386+0000", 2024-09-11T05:21:49.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216386+0000", 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216388+0000", 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.59e-06 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216399+0000", 2024-09-11T05:21:49.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1060000000000001e-05 2024-09-11T05:21:49.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216430+0000", 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1596e-05 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216442+0000", 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1613999999999999e-05 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216525+0000", 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3144000000000002e-05 2024-09-11T05:21:49.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.216547+0000", 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2351999999999999e-05 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.217098+0000", 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00055082299999999998 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.217148+0000", 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9598000000000002e-05 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2161 3.0 e27/22 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:head v 27'26, mlcod=27'24)", 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.237851+0000", 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.191386286, 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010963990000000001, 2024-09-11T05:21:49.462 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237851+0000", 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237851+0000", 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237853+0000", 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.606e-06 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237874+0000", 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1520000000000001e-05 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237893+0000", 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8912000000000001e-05 2024-09-11T05:21:49.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237902+0000", 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4379999999999995e-06 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238009+0000", 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107613 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238034+0000", 2024-09-11T05:21:49.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5167000000000001e-05 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238916+0000", 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000881857 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238947+0000", 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1285999999999998e-05 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2163 3.0 e27/22 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head v 27'27, mlcod=27'25)", 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.1895188130000001, 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001546069, 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.468 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:49.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:49.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:49.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7300000000000005e-07 2024-09-11T05:21:49.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239739+0000", 2024-09-11T05:21:49.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9219999999999999e-05 2024-09-11T05:21:49.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239750+0000", 2024-09-11T05:21:49.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1138000000000001e-05 2024-09-11T05:21:49.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239757+0000", 2024-09-11T05:21:49.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5850000000000002e-06 2024-09-11T05:21:49.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239814+0000", 2024-09-11T05:21:49.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6653000000000001e-05 2024-09-11T05:21:49.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239837+0000", 2024-09-11T05:21:49.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3003e-05 2024-09-11T05:21:49.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.241220+0000", 2024-09-11T05:21:49.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0013825630000000001 2024-09-11T05:21:49.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.241265+0000", 2024-09-11T05:21:49.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5133999999999999e-05 2024-09-11T05:21:49.476 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.477 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.477 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.478 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2197 3.4 e27/22 3:25127f41:::rbd_data.1179262aa3d7.0000000000000035:head v 27'34, mlcod=27'32)", 2024-09-11T05:21:49.478 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.260856+0000", 2024-09-11T05:21:49.478 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.168381855, 2024-09-11T05:21:49.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001107673, 2024-09-11T05:21:49.478 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.479 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260856+0000", 2024-09-11T05:21:49.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260856+0000", 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260857+0000", 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4130000000000001e-06 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260870+0000", 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.271e-05 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260900+0000", 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0008000000000001e-05 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260911+0000", 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1392e-05 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260996+0000", 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4647000000000005e-05 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261019+0000", 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2952e-05 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261909+0000", 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000890203 2024-09-11T05:21:49.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261963+0000", 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4348000000000002e-05 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2575 3.0 e27/22 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head v 27'28, mlcod=27'26)", 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.003638638, 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001441594, 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425600+0000", 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2160000000000001e-06 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425626+0000", 2024-09-11T05:21:49.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6004e-05 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425646+0000", 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9935000000000001e-05 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425655+0000", 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2799999999999992e-06 2024-09-11T05:21:49.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425716+0000", 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0395e-05 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425733+0000", 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7730000000000001e-05 2024-09-11T05:21:49.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.427006+0000", 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001272961 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.427040+0000", 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4072999999999997e-05 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2578 3.4 e27/22 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head v 27'35, mlcod=27'33)", 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.432205+0000", 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.99703271199999999, 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00101654, 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432205+0000", 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432205+0000", 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432206+0000", 2024-09-11T05:21:49.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6610000000000001e-06 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432243+0000", 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7154999999999999e-05 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432261+0000", 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7067000000000001e-05 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432270+0000", 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5629999999999998e-06 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432335+0000", 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4988999999999997e-05 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432356+0000", 2024-09-11T05:21:49.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1290000000000001e-05 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.433170+0000", 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00081354300000000001 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.433221+0000", 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1272e-05 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2597 3.4 e27/22 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head v 27'36, mlcod=27'34)", 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.97387049000000003, 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026880620000000002, 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455368+0000", 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2410000000000001e-06 2024-09-11T05:21:49.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455381+0000", 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3112000000000001e-05 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455404+0000", 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2263e-05 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455414+0000", 2024-09-11T05:21:49.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0259e-05 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455483+0000", 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-05 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455506+0000", 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.317e-05 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458008+0000", 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025021209999999999 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458055+0000", 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6795999999999997e-05 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2614 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'37, mlcod=27'35)", 2024-09-11T05:21:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.480141+0000", 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.94909636500000005, 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00077979700000000004, 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480141+0000", 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480141+0000", 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480142+0000", 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4529999999999999e-06 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480151+0000", 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9460000000000004e-06 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480168+0000", 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6688e-05 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480176+0000", 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9379999999999992e-06 2024-09-11T05:21:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480238+0000", 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2421000000000004e-05 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480264+0000", 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5055999999999999e-05 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480889+0000", 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00062564499999999998 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.480921+0000", 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1649999999999997e-05 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2624 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'38, mlcod=27'36)", 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.93780321499999997, 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030956740000000001, 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491435+0000", 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2300000000000001e-06 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491449+0000", 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3586e-05 2024-09-11T05:21:49.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491470+0000", 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0647999999999999e-05 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491486+0000", 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6767000000000001e-05 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491558+0000", 2024-09-11T05:21:49.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1538999999999994e-05 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491574+0000", 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5931999999999999e-05 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494482+0000", 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029085309999999998 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494530+0000", 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7441000000000002e-05 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2654 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'39, mlcod=27'37)", 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.90011587400000004, 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030637849999999999, 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.509 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529123+0000", 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.327e-06 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529132+0000", 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2189999999999993e-06 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529153+0000", 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1152e-05 2024-09-11T05:21:49.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529167+0000", 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3817e-05 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529249+0000", 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2127999999999997e-05 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529272+0000", 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3150999999999999e-05 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532138+0000", 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0028653530000000002 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532185+0000", 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7638e-05 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2720 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'41, mlcod=27'39)", 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.596618+0000", 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.83261960800000001, 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00083790100000000005, 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.514 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596618+0000", 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596618+0000", 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596620+0000", 2024-09-11T05:21:49.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.734e-06 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596645+0000", 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5051000000000001e-05 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596664+0000", 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9700000000000001e-05 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596676+0000", 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2038000000000001e-05 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596744+0000", 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7623e-05 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596765+0000", 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1447e-05 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.597410+0000", 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064486800000000005 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.597456+0000", 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5439999999999999e-05 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2725 3.0 e27/22 3:006e61e3:::rbd_data.1179262aa3d7.0000000000000050:head v 27'29, mlcod=27'27)", 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.82502666499999999, 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012950559999999999, 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604212+0000", 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3710000000000001e-06 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604244+0000", 2024-09-11T05:21:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1488000000000001e-05 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604264+0000", 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0477999999999999e-05 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604276+0000", 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.219e-05 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604348+0000", 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2158999999999998e-05 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604373+0000", 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4664e-05 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.522 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.605449+0000", 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010756310000000001 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.605506+0000", 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7074999999999998e-05 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2743 3.4 e27/22 3:201bc152:::rbd_data.1179262aa3d7.000000000000003d:head v 27'42, mlcod=27'40)", 2024-09-11T05:21:49.523 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.625966+0000", 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.80327133799999995, 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00089192999999999998, 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625966+0000", 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625966+0000", 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625967+0000", 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625999+0000", 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1411999999999997e-05 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626020+0000", 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1035000000000001e-05 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626030+0000", 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0543000000000001e-05 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626109+0000", 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8895999999999998e-05 2024-09-11T05:21:49.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626134+0000", 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5290999999999999e-05 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626812+0000", 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00067794700000000003 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626858+0000", 2024-09-11T05:21:49.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5541999999999999e-05 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2885 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'44, mlcod=27'42)", 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.678737+0000", 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.75050043, 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00094886199999999997, 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.528 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678737+0000", 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678737+0000", 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678738+0000", 2024-09-11T05:21:49.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3510000000000001e-06 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678752+0000", 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3438000000000001e-05 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678773+0000", 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1412000000000001e-05 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678782+0000", 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9309999999999997e-06 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678875+0000", 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2818000000000005e-05 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678896+0000", 2024-09-11T05:21:49.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1588000000000001e-05 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.679638+0000", 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00074195399999999996 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.679686+0000", 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7370000000000002e-05 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2905 3.9 e27/22 3:935a0507:::rbd_data.1179262aa3d7.0000000000000048:head v 27'22, mlcod=27'20)", 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.696040+0000", 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.73319691899999995, 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00080869500000000001, 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696040+0000", 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696040+0000", 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696042+0000", 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2589999999999999e-06 2024-09-11T05:21:49.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696076+0000", 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4384000000000001e-05 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696091+0000", 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5254e-05 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696101+0000", 2024-09-11T05:21:49.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696147+0000", 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6669000000000003e-05 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696163+0000", 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5153e-05 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696789+0000", 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00062619100000000001 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696849+0000", 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0432e-05 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2906 3.4 e27/22 3:25cbe4d0:::rbd_data.1179262aa3d7.0000000000000049:head v 27'45, mlcod=27'43)", 2024-09-11T05:21:49.537 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.696316+0000", 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.73292120800000005, 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00074292300000000004, 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696316+0000", 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696316+0000", 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696317+0000", 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6100000000000001e-07 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696332+0000", 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5574e-05 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696339+0000", 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9949999999999999e-06 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696345+0000", 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6869999999999999e-06 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696396+0000", 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0834000000000002e-05 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696414+0000", 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8459000000000001e-05 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.697028+0000", 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00061351899999999998 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.697059+0000", 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1294000000000002e-05 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.542 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:49.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:21:49.544 INFO:teuthology.orchestra.run.smithi012.stdout:leaving image image_client.0-clone2 intact 2024-09-11T05:21:49.544 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:49.542+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:49.642 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-11T05:21:49.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:49.644+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:49.644 INFO:teuthology.orchestra.run.smithi012.stdout:258 writesame 0xc7d052e thru 0xc7dc966 data_size 0x1(0xc439 bytes) 2024-09-11T05:21:49.665 INFO:teuthology.orchestra.run.smithi012.stdout:262 punch from 0xf02454 to 0xf04039, (0x1be5 bytes) 2024-09-11T05:21:49.665 INFO:teuthology.orchestra.run.smithi012.stdout:263 writesame 0xcbd5896 thru 0xcbe36c3 data_size 0x1(0xde2e bytes) 2024-09-11T05:21:49.687 INFO:teuthology.orchestra.run.smithi012.stdout:264 write 0xe7e2089 thru 0xe7ea940 (0x88b8 bytes) 2024-09-11T05:21:49.708 INFO:teuthology.orchestra.run.smithi012.stdout:265 trunc from 0xe7ea941 to 0x571a6eb 2024-09-11T05:21:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:49.712 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:49.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.713 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3126 3.1e 3:79cfec26:::rbd_data.1179fd824b6b.000000000000018c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:49.713 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.710691+0000", 2024-09-11T05:21:49.713 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.001523948, 2024-09-11T05:21:49.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0015540669999999999, 2024-09-11T05:21:49.714 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:21:49.714 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:49.714 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:49.714 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:49.715 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3126 2024-09-11T05:21:49.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.715 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710691+0000", 2024-09-11T05:21:49.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.716 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710691+0000", 2024-09-11T05:21:49.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710693+0000", 2024-09-11T05:21:49.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7970000000000001e-06 2024-09-11T05:21:49.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710708+0000", 2024-09-11T05:21:49.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4541e-05 2024-09-11T05:21:49.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710736+0000", 2024-09-11T05:21:49.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7983999999999998e-05 2024-09-11T05:21:49.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710748+0000", 2024-09-11T05:21:49.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1715e-05 2024-09-11T05:21:49.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.720 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.720 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710826+0000", 2024-09-11T05:21:49.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8199000000000001e-05 2024-09-11T05:21:49.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.721 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.710931+0000", 2024-09-11T05:21:49.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105005 2024-09-11T05:21:49.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:21:49.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711054+0000", 2024-09-11T05:21:49.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012323499999999999 2024-09-11T05:21:49.722 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.722 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.722 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:3134 3.15 e28/22 3:ad6f23f9:::rbd_data.1179fd824b6b.00000000000001cb:head v 28'25, mlcod=27'23)", 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.711107+0000", 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0011073190000000001, 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012203959999999999, 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:49.723 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711107+0000", 2024-09-11T05:21:49.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.725 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.725 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711107+0000", 2024-09-11T05:21:49.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711108+0000", 2024-09-11T05:21:49.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.299e-06 2024-09-11T05:21:49.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711124+0000", 2024-09-11T05:21:49.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5228999999999999e-05 2024-09-11T05:21:49.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711135+0000", 2024-09-11T05:21:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1653e-05 2024-09-11T05:21:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711143+0000", 2024-09-11T05:21:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7680000000000008e-06 2024-09-11T05:21:49.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711205+0000", 2024-09-11T05:21:49.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2148000000000002e-05 2024-09-11T05:21:49.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711230+0000", 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4352999999999999e-05 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3127 3.18 3:197c5bdc:::rbd_data.1179fd824b6b.000000000000018d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.711506+0000", 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.00070832399999999998, 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00088082299999999998, 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:49.731 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:49.732 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:49.732 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3127 2024-09-11T05:21:49.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.732 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711506+0000", 2024-09-11T05:21:49.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711506+0000", 2024-09-11T05:21:49.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711507+0000", 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711511+0000", 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999999e-06 2024-09-11T05:21:49.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711534+0000", 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2583999999999999e-05 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711566+0000", 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1958000000000001e-05 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711702+0000", 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00013624000000000001 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711776+0000", 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4071000000000003e-05 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711880+0000", 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010439599999999999 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.736 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3133 3.b 3:d3d13eda:::rbd_data.1179fd824b6b.000000000000019c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.711591+0000", 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.00062309300000000002, 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086284899999999995, 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:49.737 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3133 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711591+0000", 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711591+0000", 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711592+0000", 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8500000000000001e-07 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711595+0000", 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5030000000000002e-06 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711603+0000", 2024-09-11T05:21:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5789999999999998e-06 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711609+0000", 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4450000000000004e-06 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711661+0000", 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:49.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711774+0000", 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113047 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711895+0000", 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000121468 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.741 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:49.742 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:21:49.742 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 4 2024-09-11T05:21:49.742 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:49.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:21:49.743 INFO:teuthology.orchestra.run.smithi012.stdout:266 read 0x122f639 thru 0x123e2a4 (0xec6c bytes) 2024-09-11T05:21:49.743 INFO:teuthology.orchestra.run.smithi012.stdout:272 read 0x3de9dd2 thru 0x3df4e74 (0xb0a3 bytes) 2024-09-11T05:21:49.744 INFO:teuthology.orchestra.run.smithi012.stdout:274 clone 4 order 20 su 65536 sc 14 2024-09-11T05:21:49.745 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:49.743+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:49.846 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:49.845+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:49.890 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:49.890 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:49.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:21:49.947 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:49.947+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:50.007 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:50.007 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:50.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2488 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356392+0000", 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.649625594, 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0075670199999999998, 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2488 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356392+0000", 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356392+0000", 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356392+0000", 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356393+0000", 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.049e-06 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356396+0000", 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-06 2024-09-11T05:21:50.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356399+0000", 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5009999999999999e-06 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.363675+0000", 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0072759449999999998 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.363787+0000", 2024-09-11T05:21:50.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112544 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.363959+0000", 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171609 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2489 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 2113536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356402+0000", 2024-09-11T05:21:50.012 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6496155729999999, 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0076691889999999999, 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2489 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356402+0000", 2024-09-11T05:21:50.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356402+0000", 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356402+0000", 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356403+0000", 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6899999999999996e-07 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356406+0000", 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0290000000000001e-06 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356409+0000", 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5550000000000001e-06 2024-09-11T05:21:50.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.363991+0000", 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0075822399999999996 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364029+0000", 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8458999999999999e-05 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364071+0000", 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1721000000000003e-05 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2490 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356412+0000", 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6496057880000001, 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0078799679999999993, 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2490 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356412+0000", 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356412+0000", 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356412+0000", 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.04e-07 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356413+0000", 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4099999999999997e-07 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356416+0000", 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9629999999999998e-06 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356418+0000", 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364120+0000", 2024-09-11T05:21:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0077018160000000002 2024-09-11T05:21:50.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364208+0000", 2024-09-11T05:21:50.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7859e-05 2024-09-11T05:21:50.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364292+0000", 2024-09-11T05:21:50.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3666999999999997e-05 2024-09-11T05:21:50.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.022 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.023 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2491 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 2441216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.023 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356421+0000", 2024-09-11T05:21:50.023 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.649596104, 2024-09-11T05:21:50.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0079538040000000001, 2024-09-11T05:21:50.023 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.024 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.024 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.024 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2491 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356421+0000", 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356421+0000", 2024-09-11T05:21:50.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356421+0000", 2024-09-11T05:21:50.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:21:50.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356427+0000", 2024-09-11T05:21:50.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:21:50.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356431+0000", 2024-09-11T05:21:50.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4060000000000001e-06 2024-09-11T05:21:50.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356434+0000", 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3400000000000002e-06 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364304+0000", 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0078697520000000007 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364339+0000", 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4795000000000001e-05 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364375+0000", 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6356000000000002e-05 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.032 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2492 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.032 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356438+0000", 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.649579519, 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0081413079999999999, 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2492 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356438+0000", 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356438+0000", 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356438+0000", 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356439+0000", 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.15e-06 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356442+0000", 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356445+0000", 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5519999999999999e-06 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364411+0000", 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.007966051 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364497+0000", 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6111000000000003e-05 2024-09-11T05:21:50.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364579+0000", 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2126999999999995e-05 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2493 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 2768896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356453+0000", 2024-09-11T05:21:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.649564282, 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0082130380000000006, 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2493 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356453+0000", 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356453+0000", 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356454+0000", 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1699999999999998e-07 2024-09-11T05:21:50.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356456+0000", 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7199999999999998e-06 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356463+0000", 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2960000000000004e-06 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356467+0000", 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364592+0000", 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0081251299999999995 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364628+0000", 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5148999999999998e-05 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364666+0000", 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8504999999999998e-05 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2494 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 2932736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356474+0000", 2024-09-11T05:21:50.042 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.649543285, 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0083934500000000002, 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2494 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356474+0000", 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356474+0000", 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356475+0000", 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2199999999999999e-07 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356485+0000", 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0614999999999999e-05 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356492+0000", 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7780000000000002e-06 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356497+0000", 2024-09-11T05:21:50.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364706+0000", 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0082089380000000007 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364785+0000", 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9438999999999996e-05 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364868+0000", 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2196999999999999e-05 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2495 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3096576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356505+0000", 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6495125229999998, 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0084660699999999992, 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2495 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356505+0000", 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356505+0000", 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356505+0000", 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4799999999999999e-07 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356508+0000", 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2730000000000001e-06 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356514+0000", 2024-09-11T05:21:50.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1299999999999998e-06 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356519+0000", 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.677e-06 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364880+0000", 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0083603800000000006 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364931+0000", 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1211000000000001e-05 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.364971+0000", 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9950999999999997e-05 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2496 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3260416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.052 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356526+0000", 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6494916530000001, 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0086496060000000007, 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2496 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356526+0000", 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356526+0000", 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356526+0000", 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356528+0000", 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356534+0000", 2024-09-11T05:21:50.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356540+0000", 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365007+0000", 2024-09-11T05:21:50.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0084670409999999998 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365094+0000", 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6680000000000004e-05 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365175+0000", 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1500000000000002e-05 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2497 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3424256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356546+0000", 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.649470961, 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0087369730000000003, 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.058 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2497 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356546+0000", 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356546+0000", 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356547+0000", 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4099999999999999e-07 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356549+0000", 2024-09-11T05:21:50.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.99e-06 2024-09-11T05:21:50.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356555+0000", 2024-09-11T05:21:50.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:21:50.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356560+0000", 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8960000000000002e-06 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365201+0000", 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0086412060000000002 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365237+0000", 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5370000000000002e-05 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365283+0000", 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6669999999999999e-05 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2498 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3588096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.063 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356566+0000", 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6494509640000001, 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0089250739999999999, 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2498 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356566+0000", 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356566+0000", 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356567+0000", 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6300000000000001e-07 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356569+0000", 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.978e-06 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356575+0000", 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0739999999999998e-06 2024-09-11T05:21:50.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356580+0000", 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9690000000000002e-06 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365319+0000", 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0087396430000000001 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365402+0000", 2024-09-11T05:21:50.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2682000000000006e-05 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365491+0000", 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9364999999999996e-05 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2499 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3751936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356586+0000", 2024-09-11T05:21:50.068 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6494314430000001, 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0090036270000000002, 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2499 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356586+0000", 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356586+0000", 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356586+0000", 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6100000000000001e-07 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356588+0000", 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0190000000000001e-06 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356594+0000", 2024-09-11T05:21:50.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7969999999999997e-06 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356599+0000", 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9559999999999996e-06 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365517+0000", 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0089182500000000008 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365553+0000", 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5234999999999997e-05 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365590+0000", 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6909000000000002e-05 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2500 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3915776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356607+0000", 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6494108629999999, 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0091798049999999992, 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2500 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356607+0000", 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356607+0000", 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356607+0000", 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.41e-07 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356609+0000", 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9479999999999998e-06 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356615+0000", 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356619+0000", 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7570000000000004e-06 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365621+0000", 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0090013460000000003 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365702+0000", 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1534999999999998e-05 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.077 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365786+0000", 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4054000000000005e-05 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2501 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 4079616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.356639+0000", 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.6493787229999999, 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0092304589999999999, 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2501 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356639+0000", 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356639+0000", 2024-09-11T05:21:50.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356639+0000", 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8299999999999998e-07 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356641+0000", 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.716e-06 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356645+0000", 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.425e-06 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.356648+0000", 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.134e-06 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365798+0000", 2024-09-11T05:21:50.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0091502059999999993 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365833+0000", 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4826999999999997e-05 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.365869+0000", 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5868000000000003e-05 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2579 3.1e 3:79cdb383:::rbd_data.1179262aa3d7.0000000000000077:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.429486+0000", 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.5765309250000001, 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0090926719999999996, 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2579 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429486+0000", 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429486+0000", 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429488+0000", 2024-09-11T05:21:50.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.08e-06 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429493+0000", 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3900000000000001e-06 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429505+0000", 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1756999999999999e-05 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429512+0000", 2024-09-11T05:21:50.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:21:50.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429563+0000", 2024-09-11T05:21:50.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0726000000000002e-05 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429649+0000", 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6561e-05 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.430852+0000", 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012029129999999999 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.438442+0000", 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0075892069999999997 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.438488+0000", 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6254999999999997e-05 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.438528+0000", 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0448999999999998e-05 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.438579+0000", 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0800000000000002e-05 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2840 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3948544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.089 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.651569+0000", 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.354448791, 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0075959579999999999, 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2840 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651569+0000", 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651569+0000", 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651569+0000", 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651571+0000", 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.12e-06 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651578+0000", 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0849999999999999e-06 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651583+0000", 2024-09-11T05:21:50.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.659003+0000", 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0074198650000000003 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.659084+0000", 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1179000000000003e-05 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.659165+0000", 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0761999999999997e-05 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2841 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 4112384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.651589+0000", 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.354428132, 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0076677769999999998, 2024-09-11T05:21:50.094 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2841 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651589+0000", 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651589+0000", 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651590+0000", 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4999999999999998e-07 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651592+0000", 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.086e-06 2024-09-11T05:21:50.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651598+0000", 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.651602+0000", 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8450000000000002e-06 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.659182+0000", 2024-09-11T05:21:50.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0075795400000000001 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.659219+0000", 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6857999999999998e-05 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.659257+0000", 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8169e-05 2024-09-11T05:21:50.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3098 3.1e 3:79cfec26:::rbd_data.1179fd824b6b.000000000000018c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.35436027399999998, 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013181033, 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.099 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3098 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:50.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651659+0000", 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0990000000000001e-06 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651667+0000", 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0029999999999994e-06 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651687+0000", 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9669000000000001e-05 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651699+0000", 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651753+0000", 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3752999999999998e-05 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651853+0000", 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100216 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653599+0000", 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017458230000000001 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664569+0000", 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010970570000000001 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664624+0000", 2024-09-11T05:21:50.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037999999999997e-05 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664711+0000", 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6629e-05 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664838+0000", 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012700100000000001 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3099 3.18 3:197c5bdc:::rbd_data.1179fd824b6b.000000000000018d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.35260807399999999, 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012482269000000001, 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3099 2024-09-11T05:21:50.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653410+0000", 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0300000000000001e-06 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653417+0000", 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3770000000000001e-06 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653431+0000", 2024-09-11T05:21:50.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.385e-05 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653438+0000", 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8820000000000001e-06 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653503+0000", 2024-09-11T05:21:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4694000000000001e-05 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653612+0000", 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109036 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.656159+0000", 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002546436 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665824+0000", 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0096652730000000003 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665834+0000", 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9389999999999992e-06 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665863+0000", 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9526000000000002e-05 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665892+0000", 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8226e-05 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3109 3.b 3:d3d13eda:::rbd_data.1179fd824b6b.000000000000019c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.670671+0000", 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.33534601000000003, 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010314063, 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:50.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3109 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670671+0000", 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:50.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670671+0000", 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670673+0000", 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.809e-06 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670681+0000", 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0839999999999992e-06 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670700+0000", 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670709+0000", 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1020000000000003e-06 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670776+0000", 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6874999999999999e-05 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670922+0000", 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000146329 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672665+0000", 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017429399999999999 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:50.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.678559+0000", 2024-09-11T05:21:50.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0058931799999999996 2024-09-11T05:21:50.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.680872+0000", 2024-09-11T05:21:50.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0023130410000000001 2024-09-11T05:21:50.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:50.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.680938+0000", 2024-09-11T05:21:50.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6427999999999995e-05 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.680985+0000", 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7370999999999998e-05 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:50.120 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:50.120 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:50.121 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:50.121+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:50.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:21:50.222 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:50.222+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:50.226 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:21:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:50.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:21:50.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:21:50.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:50.322+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:50.337 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:50.337 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:50.337 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:21:50.337 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:21:50.337 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:50.345 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:21:50.395 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:50.413 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:50.423 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:50.422+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:50.426 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:21:50.432 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:50.451 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:50.452 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:50.456 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:50.456 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:21:50.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:21:50.456 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:21:50.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:10 3.1c e25/22 3:3831950c:::rbd_directory:head v 25'1, mlcod=0'0)", 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:44.407392+0000", 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0476015729999997, 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024661319999999998, 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407392+0000", 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407392+0000", 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407392+0000", 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8000000000000002e-07 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407398+0000", 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:21:50.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407409+0000", 2024-09-11T05:21:50.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1066e-05 2024-09-11T05:21:50.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407416+0000", 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2259999999999999e-06 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407465+0000", 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9106e-05 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.407483+0000", 2024-09-11T05:21:50.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7524e-05 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.409827+0000", 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023436249999999998 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.409858+0000", 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1517999999999999e-05 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.463 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:13 3.e e25/22 3:7343f3fe:::rbd_object_map.1179d519140e:head v 25'1, mlcod=0'0)", 2024-09-11T05:21:50.463 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:50.463 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0331576890000003, 2024-09-11T05:21:50.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057493450000000003, 2024-09-11T05:21:50.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.464 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.464 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:50.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:50.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6600000000000003e-07 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421840+0000", 2024-09-11T05:21:50.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.002e-06 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421850+0000", 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.028e-05 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421861+0000", 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0513000000000001e-05 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421924+0000", 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3546000000000004e-05 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421942+0000", 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7589e-05 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.427542+0000", 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056002400000000003 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.427585+0000", 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2908999999999999e-05 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.469 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:2272 3.1c e27/22 3:38df307e:::rbd_data.1179262aa3d7.000000000000003c:head v 27'43, mlcod=27'41)", 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.329397+0000", 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.1255964629999999, 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022232990000000002, 2024-09-11T05:21:50.470 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329397+0000", 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329397+0000", 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329398+0000", 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5000000000000001e-07 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329410+0000", 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329423+0000", 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3454e-05 2024-09-11T05:21:50.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329431+0000", 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329484+0000", 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2871000000000003e-05 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.329503+0000", 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9406e-05 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.331587+0000", 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020833750000000002 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.331620+0000", 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3698000000000002e-05 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2523 3.14 3:2b103c72:::rbd_data.1179262aa3d7.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.095422347, 2024-09-11T05:21:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013316906999999999, 2024-09-11T05:21:50.476 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:50.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:50.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2523 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359573+0000", 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6840000000000001e-06 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361466+0000", 2024-09-11T05:21:50.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001893287 2024-09-11T05:21:50.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361482+0000", 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5519000000000002e-05 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361495+0000", 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3370000000000001e-05 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361560+0000", 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4745000000000004e-05 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361729+0000", 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016939400000000001 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.364709+0000", 2024-09-11T05:21:50.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029801099999999998 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372342+0000", 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0076326930000000003 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372776+0000", 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433609 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372834+0000", 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8417e-05 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372888+0000", 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079000000000002e-05 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2525 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.0914815299999998, 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019154353999999998, 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2525 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363513+0000", 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9800000000000002e-07 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365409+0000", 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001896191 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365427+0000", 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7388e-05 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365435+0000", 2024-09-11T05:21:50.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6090000000000001e-06 2024-09-11T05:21:50.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365491+0000", 2024-09-11T05:21:50.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6289000000000003e-05 2024-09-11T05:21:50.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365647+0000", 2024-09-11T05:21:50.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015579999999999999 2024-09-11T05:21:50.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:50.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371139+0000", 2024-09-11T05:21:50.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054914359999999997 2024-09-11T05:21:50.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.380804+0000", 2024-09-11T05:21:50.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096655219999999993 2024-09-11T05:21:50.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:50.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382549+0000", 2024-09-11T05:21:50.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017446199999999999 2024-09-11T05:21:50.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382614+0000", 2024-09-11T05:21:50.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4807000000000005e-05 2024-09-11T05:21:50.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382666+0000", 2024-09-11T05:21:50.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2694000000000001e-05 2024-09-11T05:21:50.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:2523 3.14 e27/22 ondisk, result = 0)", 2024-09-11T05:21:50.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.369080+0000", 2024-09-11T05:21:50.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.0859132640000002, 2024-09-11T05:21:50.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032666050000000001, 2024-09-11T05:21:50.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.495 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:50.495 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369080+0000", 2024-09-11T05:21:50.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369080+0000", 2024-09-11T05:21:50.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369081+0000", 2024-09-11T05:21:50.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8899999999999998e-07 2024-09-11T05:21:50.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369086+0000", 2024-09-11T05:21:50.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7809999999999996e-06 2024-09-11T05:21:50.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369097+0000", 2024-09-11T05:21:50.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1419e-05 2024-09-11T05:21:50.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369103+0000", 2024-09-11T05:21:50.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9479999999999996e-06 2024-09-11T05:21:50.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372331+0000", 2024-09-11T05:21:50.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032278200000000002 2024-09-11T05:21:50.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372338+0000", 2024-09-11T05:21:50.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7429999999999996e-06 2024-09-11T05:21:50.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372347+0000", 2024-09-11T05:21:50.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9050000000000003e-06 2024-09-11T05:21:50.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.503 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.503 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2527 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.503 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:50.504 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.085802267, 2024-09-11T05:21:50.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014529937, 2024-09-11T05:21:50.504 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.504 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.504 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:50.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:50.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.505 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2527 2024-09-11T05:21:50.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:50.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:50.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369192+0000", 2024-09-11T05:21:50.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-11T05:21:50.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371078+0000", 2024-09-11T05:21:50.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001885861 2024-09-11T05:21:50.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371090+0000", 2024-09-11T05:21:50.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1979e-05 2024-09-11T05:21:50.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371097+0000", 2024-09-11T05:21:50.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.002e-06 2024-09-11T05:21:50.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371161+0000", 2024-09-11T05:21:50.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3348000000000004e-05 2024-09-11T05:21:50.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371329+0000", 2024-09-11T05:21:50.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016788799999999999 2024-09-11T05:21:50.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:50.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.375139+0000", 2024-09-11T05:21:50.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003810173 2024-09-11T05:21:50.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383559+0000", 2024-09-11T05:21:50.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084199949999999996 2024-09-11T05:21:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383654+0000", 2024-09-11T05:21:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5092000000000004e-05 2024-09-11T05:21:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383686+0000", 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1965999999999999e-05 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383721+0000", 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5392999999999998e-05 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2590 3.1a 3:5b4ca92b:::rbd_data.1179262aa3d7.000000000000005c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.0005194369999999, 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051783389999999997, 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2590 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454475+0000", 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454489+0000", 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801000000000001e-05 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454500+0000", 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.066e-05 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454507+0000", 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3799999999999996e-06 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454565+0000", 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7917999999999997e-05 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454649+0000", 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3963999999999998e-05 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454751+0000", 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102326 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.458547+0000", 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037954780000000001 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459574+0000", 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010266780000000001 2024-09-11T05:21:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459622+0000", 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8380000000000001e-05 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459652+0000", 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0474e-05 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:2591 3.1d e27/22 3:bd0573bf:::rbd_data.1179262aa3d7.000000000000005d:head v 27'16, mlcod=27'14)", 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.454816+0000", 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.0001779129999999, 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047699999999999999, 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454816+0000", 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454816+0000", 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454817+0000", 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0249999999999999e-06 2024-09-11T05:21:50.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454824+0000", 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454833+0000", 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454839+0000", 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.19e-06 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454910+0000", 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0981000000000004e-05 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454934+0000", 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4366999999999999e-05 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459541+0000", 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046064859999999999 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459586+0000", 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4882999999999997e-05 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.526 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:2596 3.f e27/22 3:f1df8521:::rbd_data.1179262aa3d7.0000000000000068:head v 27'34, mlcod=27'32)", 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.454867+0000", 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.0001264999999999, 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047604489999999999, 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454867+0000", 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454867+0000", 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454867+0000", 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000002e-07 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454872+0000", 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454881+0000", 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6410000000000008e-06 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454887+0000", 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9750000000000004e-06 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454950+0000", 2024-09-11T05:21:50.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3184999999999999e-05 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454969+0000", 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9111e-05 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459586+0000", 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046167839999999996 2024-09-11T05:21:50.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459627+0000", 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1607000000000003e-05 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2655 3.1a 3:5b95b2d1:::rbd_data.1179262aa3d7.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:50.531 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.926539378, 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067417809999999996, 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2655 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528455+0000", 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528459+0000", 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528470+0000", 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0210000000000001e-05 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528477+0000", 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2099999999999996e-06 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528530+0000", 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2809000000000002e-05 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528615+0000", 2024-09-11T05:21:50.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5845000000000002e-05 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528735+0000", 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011913699999999999 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.529264+0000", 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052902400000000001 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535140+0000", 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058759420000000003 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535171+0000", 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1377999999999997e-05 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535196+0000", 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4939999999999998e-05 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.537 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:2692 3.f e27/22 3:f5baf11a:::rbd_data.1179262aa3d7.0000000000000033:head v 27'36, mlcod=27'34)", 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.564727+0000", 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.890266226, 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043779450000000003, 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564727+0000", 2024-09-11T05:21:50.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564727+0000", 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564728+0000", 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1999999999999998e-07 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564741+0000", 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3134e-05 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564754+0000", 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2363e-05 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564761+0000", 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9979999999999997e-06 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564815+0000", 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4432000000000003e-05 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.564835+0000", 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0352000000000001e-05 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.569073+0000", 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042373860000000001 2024-09-11T05:21:50.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.569105+0000", 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2360000000000002e-05 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:2754 3.1 e27/22 3:833836e8:::rbd_data.1179262aa3d7.000000000000003e:head v 27'24, mlcod=27'22)", 2024-09-11T05:21:50.542 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.641347+0000", 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.8136469449999999, 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028806280000000001, 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641347+0000", 2024-09-11T05:21:50.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641347+0000", 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641347+0000", 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.61e-07 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641353+0000", 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4639999999999997e-06 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641363+0000", 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0699999999999999e-05 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641370+0000", 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9439999999999999e-06 2024-09-11T05:21:50.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641410+0000", 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9700999999999998e-05 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.641422+0000", 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2262000000000001e-05 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.644195+0000", 2024-09-11T05:21:50.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027726690000000002 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.644227+0000", 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2227000000000002e-05 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:2871 3.1 e27/22 3:877fdc06:::rbd_data.1179262aa3d7.0000000000000001:head v 27'25, mlcod=27'23)", 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.661867+0000", 2024-09-11T05:21:50.547 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7931264410000001, 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030823090000000001, 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661867+0000", 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661867+0000", 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661868+0000", 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8800000000000002e-07 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661878+0000", 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0315e-05 2024-09-11T05:21:50.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661888+0000", 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6639999999999993e-06 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661895+0000", 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6930000000000001e-06 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661944+0000", 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9904999999999997e-05 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.661959+0000", 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.471e-05 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.664912+0000", 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00295335 2024-09-11T05:21:50.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.664949+0000", 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6884000000000001e-05 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.552 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3107 3.1a 3:5b3318f8:::rbd_data.1179fd824b6b.000000000000019a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.78529853299999997, 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0083332600000000003, 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3107 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.553 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669696+0000", 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5269999999999999e-06 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669703+0000", 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7190000000000004e-06 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669715+0000", 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2184000000000001e-05 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669721+0000", 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669768+0000", 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6665999999999997e-05 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669863+0000", 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4823999999999999e-05 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.671208+0000", 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013450059999999999 2024-09-11T05:21:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677941+0000", 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067329379999999999 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677951+0000", 2024-09-11T05:21:50.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0732e-05 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677983+0000", 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1582999999999999e-05 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.678028+0000", 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5290999999999997e-05 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:3107 3.1a e28/22 ondisk, result = 0)", 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.675335+0000", 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.779658619, 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026107890000000001, 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.675335+0000", 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.675335+0000", 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.675336+0000", 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4399999999999999e-07 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.675340+0000", 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0509999999999998e-06 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.675350+0000", 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8849999999999994e-06 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.675358+0000", 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8540000000000003e-06 2024-09-11T05:21:50.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677931+0000", 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025729780000000001 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677936+0000", 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7600000000000002e-06 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677946+0000", 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5170000000000005e-06 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:3123 3.1d e28/22 3:bf77eef7:::rbd_data.1179fd824b6b.00000000000001cc:head v 28'17, mlcod=27'15)", 2024-09-11T05:21:50.564 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.692562+0000", 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.76243186699999999, 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022714369999999998, 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692562+0000", 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692562+0000", 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692562+0000", 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.23e-07 2024-09-11T05:21:50.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692573+0000", 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0399e-05 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692582+0000", 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5710000000000004e-06 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692588+0000", 2024-09-11T05:21:50.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.339e-06 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692641+0000", 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3409000000000003e-05 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.692663+0000", 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1461999999999999e-05 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.694788+0000", 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021252369999999999 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.694833+0000", 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5296999999999997e-05 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3131 3.1a 3:5b3318f8:::rbd_data.1179fd824b6b.000000000000019a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:50.569 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.710760+0000", 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.74423362500000001, 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022653500000000002, 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3131 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710760+0000", 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710760+0000", 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710761+0000", 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.141e-06 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710766+0000", 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.366e-06 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710780+0000", 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3699e-05 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710788+0000", 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7919999999999993e-06 2024-09-11T05:21:50.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710849+0000", 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1248999999999996e-05 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.710943+0000", 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3560000000000005e-05 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:50.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.711056+0000", 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113507 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.711686+0000", 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062974600000000004 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.712948+0000", 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012615809999999999 2024-09-11T05:21:50.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.712985+0000", 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7697000000000002e-05 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.713025+0000", 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0012000000000002e-05 2024-09-11T05:21:50.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.576 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.576 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:3322 3.f e28/22 3:f1a175e9:::rbd_data.1179fd824b6b.00000000000000ad:head v 28'40, mlcod=28'38)", 2024-09-11T05:21:50.576 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.727826+0000", 2024-09-11T05:21:50.576 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.72716715300000001, 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025723180000000001, 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727826+0000", 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727826+0000", 2024-09-11T05:21:50.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727827+0000", 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727831+0000", 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6110000000000004e-06 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727839+0000", 2024-09-11T05:21:50.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1149999999999996e-06 2024-09-11T05:21:50.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727844+0000", 2024-09-11T05:21:50.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3510000000000001e-06 2024-09-11T05:21:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727900+0000", 2024-09-11T05:21:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5723000000000002e-05 2024-09-11T05:21:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.727918+0000", 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8740999999999999e-05 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.730356+0000", 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024377790000000002 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.730399+0000", 2024-09-11T05:21:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2454999999999999e-05 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:3324 3.1d e28/22 3:bc65d3e1:::rbd_data.1179fd824b6b.00000000000000af:head v 28'19, mlcod=28'17)", 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.729381+0000", 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.72561264299999995, 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00364972, 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729381+0000", 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729381+0000", 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729382+0000", 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4399999999999999e-07 2024-09-11T05:21:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729388+0000", 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7630000000000003e-06 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729402+0000", 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458000000000001e-05 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729411+0000", 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5910000000000002e-06 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729470+0000", 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8461000000000002e-05 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.729492+0000", 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1991999999999999e-05 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.732986+0000", 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034940050000000001 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.733031+0000", 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4706000000000002e-05 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:50.587 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:50.588 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:50.588 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:50.589 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:50.589 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:50.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:21:50.590 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:50.586+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:50.590 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone3 from 0x571a6eb (overlap 0x571a6eb) to 0x22d75f7 2024-09-11T05:21:50.590 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:50.590 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:50.591 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:50.592 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:50.689 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:50.688+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:50.757 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:21:50.783 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-11T05:21:50.798 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:50.798+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:50.891 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:50.890+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:50.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:21:50.999 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:50.999+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:51.033 INFO:teuthology.orchestra.run.smithi012.stdout:276 punch from 0x2de3d6 to 0x2e8c56, (0xa880 bytes) 2024-09-11T05:21:51.037 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:51.037 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:51.048 INFO:teuthology.orchestra.run.smithi012.stdout:279 write 0xa4a1abc thru 0xa4ac08c (0xa5d1 bytes) 2024-09-11T05:21:51.051 INFO:teuthology.orchestra.run.smithi012.stdout:280 read 0x19fb206 thru 0x1a06a03 (0xb7fe bytes) 2024-09-11T05:21:51.053 INFO:teuthology.orchestra.run.smithi012.stdout:281 trunc from 0xa4ac08d to 0x93b66d7 2024-09-11T05:21:51.064 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:51.064 INFO:teuthology.orchestra.run.smithi012.stdout:283 read 0x1e3bcd0 thru 0x1e4339a (0x76cb bytes) 2024-09-11T05:21:51.064 INFO:teuthology.orchestra.run.smithi012.stdout:284 read 0x51cddc5 thru 0x51d3cfc (0x5f38 bytes) 2024-09-11T05:21:51.064 INFO:teuthology.orchestra.run.smithi012.stdout:286 read 0x34eccea thru 0x34eea82 (0x1d99 bytes) 2024-09-11T05:21:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:51.071 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:21:51.075 INFO:teuthology.orchestra.run.smithi012.stdout:288 write 0xe96353e thru 0xe96a323 (0x6de6 bytes) 2024-09-11T05:21:51.077 INFO:teuthology.orchestra.run.smithi012.stdout:289 read 0x6e349f3 thru 0x6e3b1dd (0x67eb bytes) 2024-09-11T05:21:51.078 INFO:teuthology.orchestra.run.smithi012.stdout:290 punch from 0x22cf7d7 to 0x22da4bc, (0xace5 bytes) 2024-09-11T05:21:51.087 INFO:teuthology.orchestra.run.smithi012.stdout:291 trunc from 0xe96a324 to 0x64d89ee 2024-09-11T05:21:51.097 INFO:teuthology.orchestra.run.smithi012.stdout:293 read 0x273d72a thru 0x2743c6e (0x6545 bytes) 2024-09-11T05:21:51.111 INFO:teuthology.orchestra.run.smithi012.stdout:295 write 0xe3c65d7 thru 0xe3d5bdc (0xf606 bytes) 2024-09-11T05:21:51.112 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:51.112+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:51.117 INFO:teuthology.orchestra.run.smithi012.stdout:296 writesame 0xc4cfde8 thru 0xc4d10d0 data_size 0x1(0x12e9 bytes) 2024-09-11T05:21:51.124 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:51.124 INFO:teuthology.orchestra.run.smithi012.stdout:299 write 0x229a6db thru 0x22a47b6 (0xa0dc bytes) 2024-09-11T05:21:51.137 INFO:teuthology.orchestra.run.smithi012.stdout:300 write 0xcefe0cd thru 0xceff9cb (0x18ff bytes) 2024-09-11T05:21:51.139 INFO:teuthology.orchestra.run.smithi012.stdout:301 write 0x33d767c thru 0x33de053 (0x69d8 bytes) 2024-09-11T05:21:51.147 INFO:teuthology.orchestra.run.smithi012.stdout:302 writesame 0xc7707d5 thru 0xc779541 data_size 0xd(0x8d6d bytes) 2024-09-11T05:21:51.149 INFO:teuthology.orchestra.run.smithi012.stdout:303 write 0x95fe245 thru 0x95ffee7 (0x1ca3 bytes) 2024-09-11T05:21:51.152 INFO:teuthology.orchestra.run.smithi012.stdout:304 read 0x442ab33 thru 0x4430133 (0x5601 bytes) 2024-09-11T05:21:51.152 INFO:teuthology.orchestra.run.smithi012.stdout:305 punch from 0xa5de9d2 to 0xa5eb13d, (0xc76b bytes) 2024-09-11T05:21:51.152 INFO:teuthology.orchestra.run.smithi012.stdout:306 read 0x24fd86a thru 0x2501e63 (0x45fa bytes) 2024-09-11T05:21:51.152 INFO:teuthology.orchestra.run.smithi012.stdout:307 write 0xdefd357 thru 0xdf0b5e1 (0xe28b bytes) 2024-09-11T05:21:51.156 INFO:teuthology.orchestra.run.smithi012.stdout:308 write 0x5769545 thru 0x57771fd (0xdcb9 bytes) 2024-09-11T05:21:51.161 INFO:teuthology.orchestra.run.smithi012.stdout:309 read 0xbe19af5 thru 0xbe27729 (0xdc35 bytes) 2024-09-11T05:21:51.161 INFO:teuthology.orchestra.run.smithi012.stdout:310 write 0x894a865 thru 0x894b260 (0x9fc bytes) 2024-09-11T05:21:51.170 INFO:teuthology.orchestra.run.smithi012.stdout:312 trunc from 0xe3d5bdd to 0x8a80a0f 2024-09-11T05:21:51.185 INFO:teuthology.orchestra.run.smithi012.stdout:313 clone 5 order 19 su 32768 sc 13 2024-09-11T05:21:51.194 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:51.193+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:51.219 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:51.219 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:51.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:21:51.311 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:51.311+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:51.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:21:51.395 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:51.395+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:51.497 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:51.496+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:51.510 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone4 from 0x8a80a0f (overlap 0x571a6eb) to 0x4e6496d 2024-09-11T05:21:51.536 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:51.537 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:51.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:21:51.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:51.598+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:51.691 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-11T05:21:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:51.698 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:51.698+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:51.705 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:21:51.799 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:51.799+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:51.804 INFO:teuthology.orchestra.run.smithi012.stdout:314 read 0x735cd14 thru 0x735ea4c (0x1d39 bytes) 2024-09-11T05:21:51.805 INFO:teuthology.orchestra.run.smithi012.stdout:315 read 0x4e7ce95 thru 0x4e868f0 (0x9a5c bytes) 2024-09-11T05:21:51.806 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:51.806 INFO:teuthology.orchestra.run.smithi012.stdout:317 write 0x15de8ec thru 0x15ea412 (0xbb27 bytes) 2024-09-11T05:21:51.819 INFO:teuthology.orchestra.run.smithi012.stdout:318 write 0x792eb8b thru 0x7934de1 (0x6257 bytes) 2024-09-11T05:21:51.836 INFO:teuthology.orchestra.run.smithi012.stdout:319 write 0xe6eef06 thru 0xe6ef7dc (0x8d7 bytes) 2024-09-11T05:21:51.839 INFO:teuthology.orchestra.run.smithi012.stdout:320 writesame 0xcf696fc thru 0xcf6c9e9 data_size 0x35(0x32ee bytes) 2024-09-11T05:21:51.842 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:51.842 INFO:teuthology.orchestra.run.smithi012.stdout:323 write 0x98c652b thru 0x98d41bf (0xdc95 bytes) 2024-09-11T05:21:51.846 INFO:teuthology.orchestra.run.smithi012.stdout:324 write 0xbef8718 thru 0xbf05136 (0xca1f bytes) 2024-09-11T05:21:51.850 INFO:teuthology.orchestra.run.smithi012.stdout:327 write 0x71b93bc thru 0x71c500e (0xbc53 bytes) 2024-09-11T05:21:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:51.858 INFO:teuthology.orchestra.run.smithi012.stdout:328 trunc from 0xe6ef7dd to 0xac87329 2024-09-11T05:21:51.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:21:51.869 INFO:teuthology.orchestra.run.smithi012.stdout:330 punch from 0x4fbd9a4 to 0x4fcd1c4, (0xf820 bytes) 2024-09-11T05:21:51.869 INFO:teuthology.orchestra.run.smithi012.stdout:331 punch from 0x853d5b6 to 0x8543bb4, (0x65fe bytes) 2024-09-11T05:21:51.869 INFO:teuthology.orchestra.run.smithi012.stdout:332 write 0x69f4c78 thru 0x69f753b (0x28c4 bytes) 2024-09-11T05:21:51.872 INFO:teuthology.orchestra.run.smithi012.stdout:334 read 0x34c21de thru 0x34c3dcb (0x1bee bytes) 2024-09-11T05:21:51.872 INFO:teuthology.orchestra.run.smithi012.stdout:335 read 0x321fa61 thru 0x3224c4b (0x51eb bytes) 2024-09-11T05:21:51.873 INFO:teuthology.orchestra.run.smithi012.stdout:336 trunc from 0xac87329 to 0x9e6dec1 2024-09-11T05:21:51.880 INFO:teuthology.orchestra.run.smithi012.stdout:337 punch from 0x3d78a88 to 0x3d821ee, (0x9766 bytes) 2024-09-11T05:21:51.880 INFO:teuthology.orchestra.run.smithi012.stdout:339 write 0x8684d7e thru 0x8692154 (0xd3d7 bytes) 2024-09-11T05:21:51.885 INFO:teuthology.orchestra.run.smithi012.stdout:340 write 0x94866ac thru 0x9486b92 (0x4e7 bytes) 2024-09-11T05:21:51.889 INFO:teuthology.orchestra.run.smithi012.stdout:341 writesame 0x93a2e6d thru 0x93a498c data_size 0x38(0x1b20 bytes) 2024-09-11T05:21:51.891 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:51.892 INFO:teuthology.orchestra.run.smithi012.stdout:343 trunc from 0x9e6dec1 to 0x8c1a230 2024-09-11T05:21:51.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:51.900+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:51.926 INFO:teuthology.orchestra.run.smithi012.stdout:344 read 0x455f843 thru 0x456ee37 (0xf5f5 bytes) 2024-09-11T05:21:51.926 INFO:teuthology.orchestra.run.smithi012.stdout:345 punch from 0x3b98f08 to 0x3ba0290, (0x7388 bytes) 2024-09-11T05:21:51.926 INFO:teuthology.orchestra.run.smithi012.stdout:346 write 0x86ddd3b thru 0x86e4e8f (0x7155 bytes) 2024-09-11T05:21:51.933 INFO:teuthology.orchestra.run.smithi012.stdout:347 write 0x60c3ca5 thru 0x60d3bb8 (0xff14 bytes) 2024-09-11T05:21:51.943 INFO:teuthology.orchestra.run.smithi012.stdout:348 punch from 0x49f68cf to 0x4a00e30, (0xa561 bytes) 2024-09-11T05:21:51.953 INFO:teuthology.orchestra.run.smithi012.stdout:349 writesame 0xd2ad6aa thru 0xd2b3e1a data_size 0x7(0x6771 bytes) 2024-09-11T05:21:51.953 INFO:teuthology.orchestra.run.smithi012.stdout:351 trunc from 0xd2b3e1b to 0xca9e09d 2024-09-11T05:21:51.958 INFO:teuthology.orchestra.run.smithi012.stdout:352 writesame 0x3d7e983 thru 0x3d870c4 data_size 0x57(0x8742 bytes) 2024-09-11T05:21:51.965 INFO:teuthology.orchestra.run.smithi012.stdout:353 read 0x960fd80 thru 0x9618113 (0x8394 bytes) 2024-09-11T05:21:51.965 INFO:teuthology.orchestra.run.smithi012.stdout:354 write 0x91df5e2 thru 0x91eb49d (0xbebc bytes) 2024-09-11T05:21:51.969 INFO:teuthology.orchestra.run.smithi012.stdout:355 write 0x64ffdec thru 0x6500bf4 (0xe09 bytes) 2024-09-11T05:21:51.979 INFO:teuthology.orchestra.run.smithi012.stdout:357 write 0xd7677a7 thru 0xd771f46 (0xa7a0 bytes) 2024-09-11T05:21:51.984 INFO:teuthology.orchestra.run.smithi012.stdout:358 writesame 0xe57f2e thru 0xe58a1a data_size 0x1(0xaed bytes) 2024-09-11T05:21:51.994 INFO:teuthology.orchestra.run.smithi012.stdout:362 writesame 0xd3c3272 thru 0xd3ce5f0 data_size 0x35(0xb37f bytes) 2024-09-11T05:21:51.998 INFO:teuthology.orchestra.run.smithi012.stdout:364 punch from 0xa613401 to 0xa6203c0, (0xcfbf bytes) 2024-09-11T05:21:51.998 INFO:teuthology.orchestra.run.smithi012.stdout:365 write 0xc9ea929 thru 0xc9f75ea (0xccc2 bytes) 2024-09-11T05:21:52.001 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:52.000+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:52.001 INFO:teuthology.orchestra.run.smithi012.stdout:366 write 0x8501f59 thru 0x85115e0 (0xf688 bytes) 2024-09-11T05:21:52.006 INFO:teuthology.orchestra.run.smithi012.stdout:367 write 0x593d0e6 thru 0x594c647 (0xf562 bytes) 2024-09-11T05:21:52.012 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.012 INFO:teuthology.orchestra.run.smithi012.stdout:369 write 0x8bace9a thru 0x8bbb922 (0xea89 bytes) 2024-09-11T05:21:52.015 INFO:teuthology.orchestra.run.smithi012.stdout:370 write 0xa0c5e80 thru 0xa0cf275 (0x93f6 bytes) 2024-09-11T05:21:52.020 INFO:teuthology.orchestra.run.smithi012.stdout:371 trunc from 0xd771f47 to 0xc5eb5fc 2024-09-11T05:21:52.026 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:52.027 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:52.034 INFO:teuthology.orchestra.run.smithi012.stdout:372 write 0x8ba2940 thru 0x8baa281 (0x7942 bytes) 2024-09-11T05:21:52.035 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:21:52.043 INFO:teuthology.orchestra.run.smithi012.stdout:374 write 0xe47ab70 thru 0xe47dc9d (0x312e bytes) 2024-09-11T05:21:52.045 INFO:teuthology.orchestra.run.smithi012.stdout:375 punch from 0x5912a83 to 0x5913502, (0xa7f bytes) 2024-09-11T05:21:52.045 INFO:teuthology.orchestra.run.smithi012.stdout:376 write 0x8f52144 thru 0x8f60e16 (0xecd3 bytes) 2024-09-11T05:21:52.053 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.053 INFO:teuthology.orchestra.run.smithi012.stdout:380 punch from 0xdbbc37 to 0xdc5944, (0x9d0d bytes) 2024-09-11T05:21:52.053 INFO:teuthology.orchestra.run.smithi012.stdout:381 read 0xf29203 thru 0xf320fb (0x8ef9 bytes) 2024-09-11T05:21:52.054 INFO:teuthology.orchestra.run.smithi012.stdout:382 write 0xb1bc636 thru 0xb1cadd1 (0xe79c bytes) 2024-09-11T05:21:52.059 INFO:teuthology.orchestra.run.smithi012.stdout:383 punch from 0xb711e99 to 0xb71ad9b, (0x8f02 bytes) 2024-09-11T05:21:52.060 INFO:teuthology.orchestra.run.smithi012.stdout:384 read 0x9568ebb thru 0x956cf06 (0x404c bytes) 2024-09-11T05:21:52.060 INFO:teuthology.orchestra.run.smithi012.stdout:385 write 0x9ead75b thru 0x9eafef2 (0x2798 bytes) 2024-09-11T05:21:52.063 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.064 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.064 INFO:teuthology.orchestra.run.smithi012.stdout:390 punch from 0x8a5b8cf to 0x8a60b5f, (0x5290 bytes) 2024-09-11T05:21:52.064 INFO:teuthology.orchestra.run.smithi012.stdout:391 read 0xa014c6a thru 0xa01aae2 (0x5e79 bytes) 2024-09-11T05:21:52.064 INFO:teuthology.orchestra.run.smithi012.stdout:392 read 0x94e39cf thru 0x94ec765 (0x8d97 bytes) 2024-09-11T05:21:52.064 INFO:teuthology.orchestra.run.smithi012.stdout:393 read 0x90b6639 thru 0x90b7cfc (0x16c4 bytes) 2024-09-11T05:21:52.065 INFO:teuthology.orchestra.run.smithi012.stdout:394 read 0xa0345c8 thru 0xa041790 (0xd1c9 bytes) 2024-09-11T05:21:52.065 INFO:teuthology.orchestra.run.smithi012.stdout:395 read 0x4b5ed50 thru 0x4b6d0f2 (0xe3a3 bytes) 2024-09-11T05:21:52.065 INFO:teuthology.orchestra.run.smithi012.stdout:396 writesame 0x35224ab thru 0x3524b01 data_size 0xd(0x2657 bytes) 2024-09-11T05:21:52.067 INFO:teuthology.orchestra.run.smithi012.stdout:397 read 0x28aa686 thru 0x28b2f9a (0x8915 bytes) 2024-09-11T05:21:52.068 INFO:teuthology.orchestra.run.smithi012.stdout:399 read 0x9e8fdf6 thru 0x9e9f960 (0xfb6b bytes) 2024-09-11T05:21:52.069 INFO:teuthology.orchestra.run.smithi012.stdout:400 write 0xc25ec49 thru 0xc265daf (0x7167 bytes) 2024-09-11T05:21:52.077 INFO:teuthology.orchestra.run.smithi012.stdout:401 writesame 0xee2d9f6 thru 0xee3c815 data_size 0xa0(0xee20 bytes) 2024-09-11T05:21:52.077 INFO:teuthology.orchestra.run.smithi012.stdout:402 writesame 0xaf0de9e thru 0xaf16e69 data_size 0x2(0x8fcc bytes) 2024-09-11T05:21:52.090 INFO:teuthology.orchestra.run.smithi012.stdout:403 read 0xbccfa37 thru 0xbcdf684 (0xfc4e bytes) 2024-09-11T05:21:52.090 INFO:teuthology.orchestra.run.smithi012.stdout:404 read 0xb156518 thru 0xb15a217 (0x3d00 bytes) 2024-09-11T05:21:52.090 INFO:teuthology.orchestra.run.smithi012.stdout:405 punch from 0xee0a2ac to 0xee0afd6, (0xd2a bytes) 2024-09-11T05:21:52.090 INFO:teuthology.orchestra.run.smithi012.stdout:406 read 0xb6be59d thru 0xb6cacf8 (0xc75c bytes) 2024-09-11T05:21:52.091 INFO:teuthology.orchestra.run.smithi012.stdout:407 read 0xe81669b thru 0xe822de0 (0xc746 bytes) 2024-09-11T05:21:52.091 INFO:teuthology.orchestra.run.smithi012.stdout:408 writesame 0x3a52ad8 thru 0x3a5479c data_size 0x5(0x1cc5 bytes) 2024-09-11T05:21:52.102 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:52.102+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:52.110 INFO:teuthology.orchestra.run.smithi012.stdout:409 trunc from 0xee3c816 to 0x1e8147c 2024-09-11T05:21:52.168 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:52.168 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:52.168 INFO:teuthology.orchestra.run.smithi012.stdout:410 trunc from 0x1e8147c to 0x80b4012 2024-09-11T05:21:52.173 INFO:teuthology.orchestra.run.smithi012.stdout:411 read 0x6d2657c thru 0x6d278cd (0x1352 bytes) 2024-09-11T05:21:52.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:21:52.179 INFO:teuthology.orchestra.run.smithi012.stdout:412 write 0x86545fd thru 0x8657dde (0x37e2 bytes) 2024-09-11T05:21:52.182 INFO:teuthology.orchestra.run.smithi012.stdout:413 write 0x3b5bc5e thru 0x3b61df3 (0x6196 bytes) 2024-09-11T05:21:52.186 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.186 INFO:teuthology.orchestra.run.smithi012.stdout:415 read 0x1710e7a thru 0x171158f (0x716 bytes) 2024-09-11T05:21:52.186 INFO:teuthology.orchestra.run.smithi012.stdout:416 read 0x85955a2 thru 0x85982a8 (0x2d07 bytes) 2024-09-11T05:21:52.187 INFO:teuthology.orchestra.run.smithi012.stdout:417 punch from 0x2b1e666 to 0x2b217d8, (0x3172 bytes) 2024-09-11T05:21:52.187 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.187 INFO:teuthology.orchestra.run.smithi012.stdout:419 write 0x4a00048 thru 0x4a00955 (0x90e bytes) 2024-09-11T05:21:52.189 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.189 INFO:teuthology.orchestra.run.smithi012.stdout:422 read 0x85cbef5 thru 0x85d90fa (0xd206 bytes) 2024-09-11T05:21:52.189 INFO:teuthology.orchestra.run.smithi012.stdout:423 punch from 0x6b944d to 0x6c41c5, (0xad78 bytes) 2024-09-11T05:21:52.189 INFO:teuthology.orchestra.run.smithi012.stdout:425 punch from 0x6bef4ce to 0x6bf4d48, (0x587a bytes) 2024-09-11T05:21:52.189 INFO:teuthology.orchestra.run.smithi012.stdout:428 punch from 0x713eb4a to 0x7149484, (0xa93a bytes) 2024-09-11T05:21:52.194 INFO:teuthology.orchestra.run.smithi012.stdout:429 write 0x8a7a2c7 thru 0x8a87dfb (0xdb35 bytes) 2024-09-11T05:21:52.198 INFO:teuthology.orchestra.run.smithi012.stdout:430 write 0x4faa0d0 thru 0x4fb87e6 (0xe717 bytes) 2024-09-11T05:21:52.202 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:52.202+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:52.206 INFO:teuthology.orchestra.run.smithi012.stdout:431 write 0x7b71483 thru 0x7b7c9ed (0xb56b bytes) 2024-09-11T05:21:52.211 INFO:teuthology.orchestra.run.smithi012.stdout:432 punch from 0x8a29428 to 0x8a2e2e4, (0x4ebc bytes) 2024-09-11T05:21:52.211 INFO:teuthology.orchestra.run.smithi012.stdout:434 read 0x2821093 thru 0x28257db (0x4749 bytes) 2024-09-11T05:21:52.211 INFO:teuthology.orchestra.run.smithi012.stdout:435 writesame 0x57ee77d thru 0x57fd7bd data_size 0x1(0xf041 bytes) 2024-09-11T05:21:52.244 INFO:teuthology.orchestra.run.smithi012.stdout:436 write 0xd8b9b44 thru 0xd8bd514 (0x39d1 bytes) 2024-09-11T05:21:52.253 INFO:teuthology.orchestra.run.smithi012.stdout:437 write 0xe77321b thru 0xe77db6a (0xa950 bytes) 2024-09-11T05:21:52.257 INFO:teuthology.orchestra.run.smithi012.stdout:438 write 0xd368aab thru 0xd368be8 (0x13e bytes) 2024-09-11T05:21:52.261 INFO:teuthology.orchestra.run.smithi012.stdout:439 write 0x738e6bc thru 0x738ed39 (0x67e bytes) 2024-09-11T05:21:52.264 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.264 INFO:teuthology.orchestra.run.smithi012.stdout:447 read 0x7f5f8b5 thru 0x7f66e82 (0x75ce bytes) 2024-09-11T05:21:52.264 INFO:teuthology.orchestra.run.smithi012.stdout:448 read 0x9aab320 thru 0x9ab1ae4 (0x67c5 bytes) 2024-09-11T05:21:52.264 INFO:teuthology.orchestra.run.smithi012.stdout:449 write 0xaa85c0 thru 0xaa97ed (0x122e bytes) 2024-09-11T05:21:52.269 INFO:teuthology.orchestra.run.smithi012.stdout:450 read 0x5f0dbe7 thru 0x5f191fa (0xb614 bytes) 2024-09-11T05:21:52.269 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.269 INFO:teuthology.orchestra.run.smithi012.stdout:455 read 0x3e42fa0 thru 0x3e4eb62 (0xbbc3 bytes) 2024-09-11T05:21:52.270 INFO:teuthology.orchestra.run.smithi012.stdout:456 read 0x309711b thru 0x30a28d0 (0xb7b6 bytes) 2024-09-11T05:21:52.273 INFO:teuthology.orchestra.run.smithi012.stdout:458 trunc from 0xe77db6b to 0xab75196 2024-09-11T05:21:52.286 INFO:teuthology.orchestra.run.smithi012.stdout:459 writesame 0x803f8b4 thru 0x804ef49 data_size 0x7e(0xf696 bytes) 2024-09-11T05:21:52.292 INFO:teuthology.orchestra.run.smithi012.stdout:460 write 0xfa15cc thru 0xfa5504 (0x3f39 bytes) 2024-09-11T05:21:52.296 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.298 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:52.298 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:52.301 INFO:teuthology.orchestra.run.smithi012.stdout:462 trunc from 0xab75196 to 0x630a0f8 2024-09-11T05:21:52.304 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:52.303+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:52.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:21:52.316 INFO:teuthology.orchestra.run.smithi012.stdout:463 writesame 0x3f9aa39 thru 0x3fa589e data_size 0x15(0xae66 bytes) 2024-09-11T05:21:52.330 INFO:teuthology.orchestra.run.smithi012.stdout:464 writesame 0x7fdab18 thru 0x7fdb46f data_size 0x1a(0x958 bytes) 2024-09-11T05:21:52.334 INFO:teuthology.orchestra.run.smithi012.stdout:466 trunc from 0x7fdb470 to 0xb9799ad 2024-09-11T05:21:52.350 INFO:teuthology.orchestra.run.smithi012.stdout:467 writesame 0xe4d8ccd thru 0xe4dffc2 data_size 0x6d(0x72f6 bytes) 2024-09-11T05:21:52.350 INFO:teuthology.orchestra.run.smithi012.stdout:470 punch from 0x966febe to 0x967dcae, (0xddf0 bytes) 2024-09-11T05:21:52.350 INFO:teuthology.orchestra.run.smithi012.stdout:471 write 0xdb2ab21 thru 0xdb37b7a (0xd05a bytes) 2024-09-11T05:21:52.357 INFO:teuthology.orchestra.run.smithi012.stdout:473 read 0x2c0101b thru 0x2c0b47c (0xa462 bytes) 2024-09-11T05:21:52.357 INFO:teuthology.orchestra.run.smithi012.stdout:477 read 0x79affdd thru 0x79b85b7 (0x85db bytes) 2024-09-11T05:21:52.357 INFO:teuthology.orchestra.run.smithi012.stdout:480 punch from 0x93fc2e4 to 0x9408c73, (0xc98f bytes) 2024-09-11T05:21:52.357 INFO:teuthology.orchestra.run.smithi012.stdout:483 trunc from 0xe4dffc3 to 0xe45c9c3 2024-09-11T05:21:52.361 INFO:teuthology.orchestra.run.smithi012.stdout:485 write 0x783b26 thru 0x785f96 (0x2471 bytes) 2024-09-11T05:21:52.365 INFO:teuthology.orchestra.run.smithi012.stdout:486 write 0xe20283e thru 0xe2117de (0xefa1 bytes) 2024-09-11T05:21:52.371 INFO:teuthology.orchestra.run.smithi012.stdout:487 punch from 0xf0f832 to 0xf19c43, (0xa411 bytes) 2024-09-11T05:21:52.372 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.372 INFO:teuthology.orchestra.run.smithi012.stdout:489 read 0xbf2ce68 thru 0xbf2f859 (0x29f2 bytes) 2024-09-11T05:21:52.372 INFO:teuthology.orchestra.run.smithi012.stdout:491 trunc from 0xe45c9c3 to 0xea66834 2024-09-11T05:21:52.389 INFO:teuthology.orchestra.run.smithi012.stdout:494 trunc from 0xea66834 to 0x33f7328 2024-09-11T05:21:52.405 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:52.404+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:52.411 INFO:teuthology.orchestra.run.smithi012.stdout:495 punch from 0x205dff2 to 0x2060523, (0x2531 bytes) 2024-09-11T05:21:52.417 INFO:teuthology.orchestra.run.smithi012.stdout:497 trunc from 0x33f7328 to 0x8377b3d 2024-09-11T05:21:52.424 INFO:teuthology.orchestra.run.smithi012.stdout:499 read 0x47f0335 thru 0x47f4155 (0x3e21 bytes) 2024-09-11T05:21:52.424 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.424 INFO:teuthology.orchestra.run.smithi012.stdout:503 read 0x6407406 thru 0x64167b7 (0xf3b2 bytes) 2024-09-11T05:21:52.431 INFO:teuthology.orchestra.run.smithi012.stdout:505 writesame 0x9f6baf3 thru 0x9f79ae9 data_size 0x1(0xdff7 bytes) 2024-09-11T05:21:52.431 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.431 INFO:teuthology.orchestra.run.smithi012.stdout:507 writesame 0x4ec28c9 thru 0x4ec3d9a data_size 0xd(0x14d2 bytes) 2024-09-11T05:21:52.434 INFO:teuthology.orchestra.run.smithi012.stdout:508 punch from 0x2f9b54 to 0x30068d, (0x6b39 bytes) 2024-09-11T05:21:52.441 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:52.441 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:52.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:21:52.444 INFO:teuthology.orchestra.run.smithi012.stdout:511 write 0xcc5e1af thru 0xcc630f9 (0x4f4b bytes) 2024-09-11T05:21:52.449 INFO:teuthology.orchestra.run.smithi012.stdout:512 write 0x8b3b723 thru 0x8b3d693 (0x1f71 bytes) 2024-09-11T05:21:52.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:21:52.454 INFO:teuthology.orchestra.run.smithi012.stdout:513 punch from 0x2b752b2 to 0x2b80e97, (0xbbe5 bytes) 2024-09-11T05:21:52.454 INFO:teuthology.orchestra.run.smithi012.stdout:514 read 0xc57110a thru 0xc5790ed (0x7fe4 bytes) 2024-09-11T05:21:52.458 INFO:teuthology.orchestra.run.smithi012.stdout:515 trunc from 0xcc630fa to 0xa96daf0 2024-09-11T05:21:52.471 INFO:teuthology.orchestra.run.smithi012.stdout:516 writesame 0xb214732 thru 0xb21777e data_size 0x1(0x304d bytes) 2024-09-11T05:21:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:517 write 0xbda1166 thru 0xbda3085 (0x1f20 bytes) 2024-09-11T05:21:52.480 INFO:teuthology.orchestra.run.smithi012.stdout:519 write 0x84f969b thru 0x8501250 (0x7bb6 bytes) 2024-09-11T05:21:52.483 INFO:teuthology.orchestra.run.smithi012.stdout:520 write 0x52dfc0c thru 0x52e2bbc (0x2fb1 bytes) 2024-09-11T05:21:52.486 INFO:teuthology.orchestra.run.smithi012.stdout:521 write 0x7abea8b thru 0x7ac838e (0x9904 bytes) 2024-09-11T05:21:52.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:52.506+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:522 trunc from 0xbda3086 to 0x38f328c 2024-09-11T05:21:52.520 INFO:teuthology.orchestra.run.smithi012.stdout:523 read 0x2cdc936 thru 0x2ce13f9 (0x4ac4 bytes) 2024-09-11T05:21:52.520 INFO:teuthology.orchestra.run.smithi012.stdout:524 write 0x2950a36 thru 0x2956d19 (0x62e4 bytes) 2024-09-11T05:21:52.524 INFO:teuthology.orchestra.run.smithi012.stdout:525 punch from 0x387fd7c to 0x3880514, (0x798 bytes) 2024-09-11T05:21:52.525 INFO:teuthology.orchestra.run.smithi012.stdout:526 trunc from 0x38f328c to 0x479535e 2024-09-11T05:21:52.531 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.531 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.531 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.531 INFO:teuthology.orchestra.run.smithi012.stdout:533 punch from 0xb11b65 to 0xb14016, (0x24b1 bytes) 2024-09-11T05:21:52.544 INFO:teuthology.orchestra.run.smithi012.stdout:536 write 0xaae3481 thru 0xaaed61b (0xa19b bytes) 2024-09-11T05:21:52.547 INFO:teuthology.orchestra.run.smithi012.stdout:538 read 0x973f5d9 thru 0x9748090 (0x8ab8 bytes) 2024-09-11T05:21:52.547 INFO:teuthology.orchestra.run.smithi012.stdout:540 punch from 0xa0cc3ce to 0xa0da816, (0xe448 bytes) 2024-09-11T05:21:52.547 INFO:teuthology.orchestra.run.smithi012.stdout:541 write 0x6262317 thru 0x626313b (0xe25 bytes) 2024-09-11T05:21:52.551 INFO:teuthology.orchestra.run.smithi012.stdout:542 write 0x71be9af thru 0x71c9901 (0xaf53 bytes) 2024-09-11T05:21:52.559 INFO:teuthology.orchestra.run.smithi012.stdout:543 write 0x7b93c41 thru 0x7b971a2 (0x3562 bytes) 2024-09-11T05:21:52.561 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.570 INFO:teuthology.orchestra.run.smithi012.stdout:546 write 0xdf3840d thru 0xdf46d65 (0xe959 bytes) 2024-09-11T05:21:52.577 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:52.577 INFO:teuthology.orchestra.run.smithi012.stdout:550 write 0x1d8f1f9 thru 0x1d96929 (0x7731 bytes) 2024-09-11T05:21:52.578 INFO:teuthology.orchestra.run.smithi012.stdout:551 writesame 0x223b1c5 thru 0x223c2a9 data_size 0x5(0x10e5 bytes) 2024-09-11T05:21:52.584 INFO:teuthology.orchestra.run.smithi012.stdout:554 trunc from 0xdf46d66 to 0xb9f9ebb 2024-09-11T05:21:52.587 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:52.588 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:52.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:21:52.596 INFO:teuthology.orchestra.run.smithi012.stdout:555 write 0xac421df thru 0xac51993 (0xf7b5 bytes) 2024-09-11T05:21:52.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:21:52.603 INFO:teuthology.orchestra.run.smithi012.stdout:557 writesame 0x2dfe0f8 thru 0x2e0b4bd data_size 0x1(0xd3c6 bytes) 2024-09-11T05:21:52.624 INFO:teuthology.orchestra.run.smithi012.stdout:558 read 0xa6674e4 thru 0xa676a30 (0xf54d bytes) 2024-09-11T05:21:52.624 INFO:teuthology.orchestra.run.smithi012.stdout:561 write 0x1f6ccc4 thru 0x1f7a419 (0xd756 bytes) 2024-09-11T05:21:52.624 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:52.624+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:52.626 INFO:teuthology.orchestra.run.smithi012.stdout:562 write 0x8685950 thru 0x868c1ce (0x687f bytes) 2024-09-11T05:21:52.630 INFO:teuthology.orchestra.run.smithi012.stdout:563 clone 6 order 23 su 262144 sc 3 2024-09-11T05:21:52.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:52.708+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:52.714 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:52.714 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:52.723 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:21:52.725 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:52.744 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:52.763 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:52.781 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:52.781 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:52.798 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:52.809 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:52.808+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:52.814 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:52.815 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:52.832 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:52.836 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:52.836 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:52.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:1982 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write 704512~10259] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.105926+0000", 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.7292448, 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0089803130000000002, 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.837 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 1982 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.105926+0000", 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.105926+0000", 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.105928+0000", 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107145+0000", 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012170760000000001 2024-09-11T05:21:52.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107169+0000", 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3699000000000001e-05 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107177+0000", 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8799999999999997e-06 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107250+0000", 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2721999999999999e-05 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107419+0000", 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016861799999999999 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.107747+0000", 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00032834599999999998 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.113571+0000", 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0058238179999999997 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.114778+0000", 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001206737 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.114851+0000", 2024-09-11T05:21:52.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3004999999999996e-05 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.114906+0000", 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5547999999999997e-05 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2219 3.8 e27/22 3:16d1b624:::rbd_data.1179262aa3d7.000000000000001b:head v 27'24, mlcod=27'21)", 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.278153+0000", 2024-09-11T05:21:52.843 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.5570178190000004, 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048852629999999999, 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278153+0000", 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278153+0000", 2024-09-11T05:21:52.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278154+0000", 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3099999999999997e-07 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278159+0000", 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.096e-06 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278169+0000", 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9469999999999998e-06 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278173+0000", 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278230+0000", 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6965000000000001e-05 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.278251+0000", 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0564000000000002e-05 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.282996+0000", 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047449140000000002 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.283038+0000", 2024-09-11T05:21:52.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2466999999999998e-05 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2527 3.1a e27/22 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:head v 27'28, mlcod=27'26)", 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.376363+0000", 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4588079970000001, 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0054494330000000001, 2024-09-11T05:21:52.848 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.376363+0000", 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.376363+0000", 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.376365+0000", 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9489999999999999e-06 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.378985+0000", 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026199249999999999 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379002+0000", 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7754999999999999e-05 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379011+0000", 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7879999999999995e-06 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379086+0000", 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5065e-05 2024-09-11T05:21:52.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.379112+0000", 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5846999999999998e-05 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.381765+0000", 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026525350000000001 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.381812+0000", 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7568999999999998e-05 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2578 3.4 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.429220+0000", 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4059511630000001, 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0081629230000000007, 2024-09-11T05:21:52.853 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2578 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429220+0000", 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429220+0000", 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429221+0000", 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9800000000000002e-07 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429226+0000", 2024-09-11T05:21:52.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429239+0000", 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3392e-05 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429247+0000", 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6190000000000002e-06 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429324+0000", 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7288999999999998e-05 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.429405+0000", 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0854999999999998e-05 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.430408+0000", 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001002735 2024-09-11T05:21:52.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437226+0000", 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0068181919999999998 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437250+0000", 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4420999999999999e-05 2024-09-11T05:21:52.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437315+0000", 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4601e-05 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.437382+0000", 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7521999999999995e-05 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2597 3.4 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.454468+0000", 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.3807024749999997, 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0038700599999999998, 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2597 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.860 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454468+0000", 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454468+0000", 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454470+0000", 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9e-06 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454489+0000", 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9014000000000001e-05 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454510+0000", 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0823e-05 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454523+0000", 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.343e-05 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454611+0000", 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7596000000000006e-05 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454706+0000", 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5351000000000002e-05 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.454817+0000", 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011068 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455632+0000", 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00081504099999999996 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458238+0000", 2024-09-11T05:21:52.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026064159999999999 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458293+0000", 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4747000000000003e-05 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458338+0000", 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5062000000000003e-05 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2590 3.1a e27/22 3:5b4ca92b:::rbd_data.1179262aa3d7.000000000000005c:head v 27'30, mlcod=27'28)", 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.455148+0000", 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.3800223059999999, 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031174380000000002, 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455148+0000", 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455148+0000", 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455149+0000", 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455157+0000", 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.729e-06 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455169+0000", 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2014000000000001e-05 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455176+0000", 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.092e-06 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455237+0000", 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0863000000000003e-05 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455257+0000", 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9429999999999999e-05 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458224+0000", 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029675740000000002 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458266+0000", 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1699999999999997e-05 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.870 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2624 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head [truncate 1490944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.490870+0000", 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.3443005069999998, 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003897017, 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2624 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490870+0000", 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490870+0000", 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490872+0000", 2024-09-11T05:21:52.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490879+0000", 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2280000000000001e-06 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490898+0000", 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8683000000000001e-05 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490907+0000", 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4890000000000001e-06 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.490979+0000", 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1452999999999995e-05 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491077+0000", 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7788999999999995e-05 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491208+0000", 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000131688 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491841+0000", 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00063230600000000001 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494662+0000", 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002821039 2024-09-11T05:21:52.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494711+0000", 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494767+0000", 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6221000000000003e-05 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2623 3.8 e27/22 3:110018a8:::rbd_data.1179262aa3d7.000000000000002d:head v 27'28, mlcod=27'26)", 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.491281+0000", 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.3438899549999999, 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033215300000000001, 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491281+0000", 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491281+0000", 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491282+0000", 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.78e-07 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491289+0000", 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5979999999999999e-06 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491301+0000", 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1598e-05 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491308+0000", 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3429999999999998e-06 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491365+0000", 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7107000000000001e-05 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491385+0000", 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9626000000000001e-05 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494565+0000", 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031795730000000002 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494602+0000", 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7707000000000003e-05 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2654 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.528415+0000", 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.3067556119999999, 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003966341, 2024-09-11T05:21:52.881 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2654 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528415+0000", 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528415+0000", 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528418+0000", 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4399999999999999e-06 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528429+0000", 2024-09-11T05:21:52.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1005999999999999e-05 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528448+0000", 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9796000000000002e-05 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528462+0000", 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3651e-05 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528549+0000", 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7242000000000003e-05 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528640+0000", 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0704000000000004e-05 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528757+0000", 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000117259 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529410+0000", 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00065302999999999997 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532317+0000", 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029065060000000001 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532350+0000", 2024-09-11T05:21:52.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3528999999999997e-05 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532381+0000", 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1177999999999999e-05 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2653 3.8 e27/22 3:110018a8:::rbd_data.1179262aa3d7.000000000000002d:head v 27'30, mlcod=27'28)", 2024-09-11T05:21:52.887 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.528770+0000", 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.3064008219999996, 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0061789940000000002, 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528770+0000", 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528770+0000", 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528771+0000", 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9299999999999996e-07 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528778+0000", 2024-09-11T05:21:52.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528788+0000", 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0373999999999999e-05 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528795+0000", 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3260000000000001e-06 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528866+0000", 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1239e-05 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528887+0000", 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0859000000000001e-05 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534913+0000", 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0060259989999999998 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534949+0000", 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6127999999999997e-05 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2655 3.1a e27/22 3:5b95b2d1:::rbd_data.1179262aa3d7.0000000000000056:head v 27'32, mlcod=27'30)", 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.30630413, 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0061149840000000004, 2024-09-11T05:21:52.892 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528867+0000", 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528872+0000", 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.561e-06 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528880+0000", 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7630000000000006e-06 2024-09-11T05:21:52.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528886+0000", 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0889999999999999e-06 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528937+0000", 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.113e-05 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.528957+0000", 2024-09-11T05:21:52.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0639e-05 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534942+0000", 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0059850140000000003 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.534982+0000", 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9261000000000002e-05 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.896 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2725 3.0 3:006e61e3:::rbd_data.1179262aa3d7.0000000000000050:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same in=1b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.2351922010000003, 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010092702, 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2725 2024-09-11T05:21:52.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599979+0000", 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599980+0000", 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599986+0000", 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.599996+0000", 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.061e-05 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600001+0000", 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.079e-06 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600047+0000", 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5334000000000003e-05 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.600143+0000", 2024-09-11T05:21:52.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6178e-05 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.601427+0000", 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012841790000000001 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609994+0000", 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0085668789999999995 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.610005+0000", 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0923e-05 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.610038+0000", 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3127000000000003e-05 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.610071+0000", 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3136999999999998e-05 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:2725 3.0 e27/22 ondisk, result = 0)", 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.606193+0000", 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.2289780950000004, 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0038066010000000002, 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:52.903 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606193+0000", 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606193+0000", 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606194+0000", 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606199+0000", 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4489999999999998e-06 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606211+0000", 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2115e-05 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.606221+0000", 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4350000000000003e-06 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609983+0000", 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0037621550000000001 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609990+0000", 2024-09-11T05:21:52.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.657e-06 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.609999+0000", 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6250000000000002e-06 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2748 3.6 e27/22 3:6686f4d9:::rbd_data.1179262aa3d7.0000000000000052:head v 27'57, mlcod=27'55)", 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.636155+0000", 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.199015706, 2024-09-11T05:21:52.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030633539999999999, 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636155+0000", 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636155+0000", 2024-09-11T05:21:52.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636156+0000", 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636163+0000", 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3730000000000004e-06 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636174+0000", 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0151e-05 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636181+0000", 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0890000000000002e-06 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636376+0000", 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019554899999999999 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.636397+0000", 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1019999999999999e-05 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.639182+0000", 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00278481 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.639218+0000", 2024-09-11T05:21:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6259e-05 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:2985 3.0 3:014574f2:::rbd_header.1179fd824b6b:head [call rbd.set_stripe_unit_count in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.468118+0000", 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.3670529839999999, 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0037897220000000001, 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 2985 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468118+0000", 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468118+0000", 2024-09-11T05:21:52.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468118+0000", 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8199999999999999e-07 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468123+0000", 2024-09-11T05:21:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8080000000000004e-06 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468132+0000", 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0790000000000007e-06 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468138+0000", 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2599999999999996e-06 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468177+0000", 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9483999999999997e-05 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468231+0000", 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3971999999999998e-05 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468373+0000", 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014238200000000001 2024-09-11T05:21:52.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.469582+0000", 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001208581 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.471850+0000", 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0022679190000000002 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.471883+0000", 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3337999999999998e-05 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.471907+0000", 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4216999999999999e-05 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3106 3.0 3:061be309:::rbd_data.1179fd824b6b.0000000000000199:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.669538+0000", 2024-09-11T05:21:52.918 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.1656330530000001, 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.007226863, 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3106 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669538+0000", 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669538+0000", 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669540+0000", 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3549999999999999e-06 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669552+0000", 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1834999999999999e-05 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669575+0000", 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3110999999999999e-05 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669586+0000", 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1494999999999999e-05 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669663+0000", 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6249999999999997e-05 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.669831+0000", 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016845 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.670795+0000", 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00096394600000000003 2024-09-11T05:21:52.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.676614+0000", 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.005818681 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.676658+0000", 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4502999999999997e-05 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.676716+0000", 2024-09-11T05:21:52.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7686999999999998e-05 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.676765+0000", 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8550000000000001e-05 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3307 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:5 [read 589824~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:52.924 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.719665+0000", 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.115505368, 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031598770000000002, 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3307 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719665+0000", 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719665+0000", 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719666+0000", 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719667+0000", 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719674+0000", 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719680+0000", 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:21:52.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.722651+0000", 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029714149999999998 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.722730+0000", 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8572999999999995e-05 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.722825+0000", 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5445999999999994e-05 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3308 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:5 [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.719688+0000", 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.1154822640000002, 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003354405, 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3308 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719688+0000", 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719688+0000", 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719689+0000", 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719691+0000", 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2630000000000002e-06 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719697+0000", 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719702+0000", 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6290000000000001e-06 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.722857+0000", 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003155064 2024-09-11T05:21:52.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.722937+0000", 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9911000000000001e-05 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.723043+0000", 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010628699999999999 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3309 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:5 [read 884736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.719735+0000", 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.11543539, 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034797610000000001, 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3309 2024-09-11T05:21:52.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719735+0000", 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719735+0000", 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719736+0000", 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3e-07 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719739+0000", 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.377e-06 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719747+0000", 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1319999999999994e-06 2024-09-11T05:21:52.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719753+0000", 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0299999999999999e-06 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.723071+0000", 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033179469999999999 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.723142+0000", 2024-09-11T05:21:52.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0914000000000006e-05 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.723215+0000", 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2731000000000005e-05 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3310 3.4 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:5 [read 1032192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.719763+0000", 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.115408011, 2024-09-11T05:21:52.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003623762, 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3310 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719763+0000", 2024-09-11T05:21:52.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719763+0000", 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719763+0000", 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719765+0000", 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9580000000000001e-06 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719771+0000", 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1990000000000003e-06 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.719776+0000", 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.69e-06 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.723242+0000", 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034660580000000002 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.723311+0000", 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9431999999999995e-05 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.723386+0000", 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5032999999999998e-05 2024-09-11T05:21:52.942 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:52.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:52.943 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:52.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:21:52.945 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:52.946 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:52.944+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:53.045 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:53.045+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:53.092 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:53.092 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:53.092 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:21:53.092 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:53.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:21:53.146 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:53.145+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:53.208 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:53.208 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:53.208 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:53.208 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:53.208 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:53.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:21:53.260 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:53.260+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4253.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:53.325 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 20.548749831999999, 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0041632789999999998, 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774978+0000", 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8799999999999999e-07 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774986+0000", 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3669999999999997e-06 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774997+0000", 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1274000000000001e-05 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775005+0000", 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6660000000000008e-06 2024-09-11T05:21:53.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775080+0000", 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4821999999999996e-05 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775102+0000", 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1894000000000001e-05 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779079+0000", 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039771809999999998 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779141+0000", 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1886999999999999e-05 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2004 3.4 e27/22 3:201bc152:::rbd_data.1179262aa3d7.000000000000003d:head v 27'30, mlcod=27'28)", 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.134661+0000", 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.1890659609999998, 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0009884850000000001, 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134661+0000", 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134661+0000", 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134663+0000", 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.319e-06 2024-09-11T05:21:53.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134675+0000", 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2075999999999999e-05 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134694+0000", 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9259e-05 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134705+0000", 2024-09-11T05:21:53.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1551e-05 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134783+0000", 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7856999999999997e-05 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.134812+0000", 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8291999999999999e-05 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.135597+0000", 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00078563000000000005 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.135650+0000", 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2500999999999998e-05 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2009 3.4 e27/22 3:201bc152:::rbd_data.1179262aa3d7.000000000000003d:head v 27'31, mlcod=27'29)", 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.148665+0000", 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.1750618179999996, 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00087414899999999995, 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148665+0000", 2024-09-11T05:21:53.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148665+0000", 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148666+0000", 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.78e-07 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148674+0000", 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0129999999999993e-06 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148692+0000", 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7600000000000001e-05 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148700+0000", 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3140000000000004e-06 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148783+0000", 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2989000000000001e-05 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.148804+0000", 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0854999999999999e-05 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.149492+0000", 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00068842999999999997 2024-09-11T05:21:53.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.149540+0000", 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7070000000000002e-05 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2161 3.0 e27/22 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:head v 27'26, mlcod=27'24)", 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.237851+0000", 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.085876142, 2024-09-11T05:21:53.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010963990000000001, 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237851+0000", 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237851+0000", 2024-09-11T05:21:53.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237853+0000", 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.606e-06 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237874+0000", 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1520000000000001e-05 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237893+0000", 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8912000000000001e-05 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.237902+0000", 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4379999999999995e-06 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238009+0000", 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107613 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238034+0000", 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5167000000000001e-05 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238916+0000", 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000881857 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.238947+0000", 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1285999999999998e-05 2024-09-11T05:21:53.344 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2163 3.0 e27/22 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head v 27'27, mlcod=27'25)", 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.0840086690000001, 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001546069, 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:53.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7300000000000005e-07 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239739+0000", 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9219999999999999e-05 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239750+0000", 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1138000000000001e-05 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239757+0000", 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5850000000000002e-06 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239814+0000", 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6653000000000001e-05 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239837+0000", 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3003e-05 2024-09-11T05:21:53.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.241220+0000", 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0013825630000000001 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.241265+0000", 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5133999999999999e-05 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2197 3.4 e27/22 3:25127f41:::rbd_data.1179262aa3d7.0000000000000035:head v 27'34, mlcod=27'32)", 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.260856+0000", 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.0628717109999997, 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001107673, 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260856+0000", 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260856+0000", 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260857+0000", 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4130000000000001e-06 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260870+0000", 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.271e-05 2024-09-11T05:21:53.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260900+0000", 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0008000000000001e-05 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260911+0000", 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1392e-05 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.260996+0000", 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4647000000000005e-05 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261019+0000", 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2952e-05 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261909+0000", 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000890203 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.261963+0000", 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4348000000000002e-05 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2575 3.0 e27/22 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head v 27'28, mlcod=27'26)", 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.8981284939999998, 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001441594, 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:53.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425600+0000", 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2160000000000001e-06 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425626+0000", 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6004e-05 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425646+0000", 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9935000000000001e-05 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425655+0000", 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2799999999999992e-06 2024-09-11T05:21:53.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425716+0000", 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0395e-05 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425733+0000", 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7730000000000001e-05 2024-09-11T05:21:53.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.427006+0000", 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001272961 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.427040+0000", 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4072999999999997e-05 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2578 3.4 e27/22 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head v 27'35, mlcod=27'33)", 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.432205+0000", 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.8915225680000001, 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00101654, 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432205+0000", 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432205+0000", 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432206+0000", 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6610000000000001e-06 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432243+0000", 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7154999999999999e-05 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432261+0000", 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7067000000000001e-05 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432270+0000", 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5629999999999998e-06 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432335+0000", 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4988999999999997e-05 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.432356+0000", 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1290000000000001e-05 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.433170+0000", 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00081354300000000001 2024-09-11T05:21:53.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.433221+0000", 2024-09-11T05:21:53.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1272e-05 2024-09-11T05:21:53.364 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.364 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2597 3.4 e27/22 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head v 27'36, mlcod=27'34)", 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.8683603460000002, 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026880620000000002, 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.365 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455368+0000", 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2410000000000001e-06 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455381+0000", 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3112000000000001e-05 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455404+0000", 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2263e-05 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455414+0000", 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0259e-05 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455483+0000", 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-05 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455506+0000", 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.317e-05 2024-09-11T05:21:53.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458008+0000", 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025021209999999999 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458055+0000", 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6795999999999997e-05 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2624 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'38, mlcod=27'36)", 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.8322930710000005, 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030956740000000001, 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491435+0000", 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2300000000000001e-06 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491449+0000", 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3586e-05 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491470+0000", 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0647999999999999e-05 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491486+0000", 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6767000000000001e-05 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491558+0000", 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1538999999999994e-05 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491574+0000", 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5931999999999999e-05 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494482+0000", 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029085309999999998 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494530+0000", 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7441000000000002e-05 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2654 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'39, mlcod=27'37)", 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:53.374 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.7946057299999998, 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030637849999999999, 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529123+0000", 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.327e-06 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529132+0000", 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2189999999999993e-06 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529153+0000", 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1152e-05 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529167+0000", 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3817e-05 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529249+0000", 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2127999999999997e-05 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529272+0000", 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3150999999999999e-05 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532138+0000", 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0028653530000000002 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532185+0000", 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7638e-05 2024-09-11T05:21:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2720 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'41, mlcod=27'39)", 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.596618+0000", 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.7271094639999998, 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00083790100000000005, 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596618+0000", 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596618+0000", 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596620+0000", 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.734e-06 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596645+0000", 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5051000000000001e-05 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596664+0000", 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9700000000000001e-05 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596676+0000", 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2038000000000001e-05 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596744+0000", 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7623e-05 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.596765+0000", 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1447e-05 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.597410+0000", 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064486800000000005 2024-09-11T05:21:53.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.597456+0000", 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5439999999999999e-05 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2725 3.0 e27/22 3:006e61e3:::rbd_data.1179262aa3d7.0000000000000050:head v 27'29, mlcod=27'27)", 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.7195165210000001, 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012950559999999999, 2024-09-11T05:21:53.383 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604212+0000", 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3710000000000001e-06 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604244+0000", 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1488000000000001e-05 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604264+0000", 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0477999999999999e-05 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604276+0000", 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.219e-05 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604348+0000", 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2158999999999998e-05 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604373+0000", 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4664e-05 2024-09-11T05:21:53.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.605449+0000", 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010756310000000001 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.605506+0000", 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7074999999999998e-05 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2743 3.4 e27/22 3:201bc152:::rbd_data.1179262aa3d7.000000000000003d:head v 27'42, mlcod=27'40)", 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.625966+0000", 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.6977611939999999, 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00089192999999999998, 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625966+0000", 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625966+0000", 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625967+0000", 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.625999+0000", 2024-09-11T05:21:53.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1411999999999997e-05 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626020+0000", 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1035000000000001e-05 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626030+0000", 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0543000000000001e-05 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626109+0000", 2024-09-11T05:21:53.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8895999999999998e-05 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626134+0000", 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5290999999999999e-05 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626812+0000", 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00067794700000000003 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.626858+0000", 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5541999999999999e-05 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2885 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'44, mlcod=27'42)", 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.678737+0000", 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.6449902859999996, 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00094886199999999997, 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.392 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678737+0000", 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678737+0000", 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678738+0000", 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3510000000000001e-06 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678752+0000", 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3438000000000001e-05 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678773+0000", 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1412000000000001e-05 2024-09-11T05:21:53.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678782+0000", 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9309999999999997e-06 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678875+0000", 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2818000000000005e-05 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.678896+0000", 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1588000000000001e-05 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.679638+0000", 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00074195399999999996 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.679686+0000", 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7370000000000002e-05 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2905 3.9 e27/22 3:935a0507:::rbd_data.1179262aa3d7.0000000000000048:head v 27'22, mlcod=27'20)", 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.696040+0000", 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.6276867749999999, 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00080869500000000001, 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696040+0000", 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696040+0000", 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696042+0000", 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2589999999999999e-06 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696076+0000", 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4384000000000001e-05 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696091+0000", 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5254e-05 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696101+0000", 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:21:53.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696147+0000", 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6669000000000003e-05 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696163+0000", 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5153e-05 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696789+0000", 2024-09-11T05:21:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00062619100000000001 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.696849+0000", 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0432e-05 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2985 3.0 e28/22 3:014574f2:::rbd_header.1179fd824b6b:head v 28'32, mlcod=27'30)", 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.468434+0000", 2024-09-11T05:21:53.401 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.8552929520000001, 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033032560000000001, 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468434+0000", 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468434+0000", 2024-09-11T05:21:53.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468435+0000", 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3499999999999996e-07 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468440+0000", 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7559999999999999e-06 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468449+0000", 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1349999999999998e-06 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468455+0000", 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1650000000000003e-06 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468517+0000", 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1995999999999994e-05 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468540+0000", 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2699000000000001e-05 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.471688+0000", 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003148386 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.471738+0000", 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9583999999999998e-05 2024-09-11T05:21:53.405 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:3000 3.0 e28/22 3:014574f2:::rbd_header.1179fd824b6b:head v 28'34, mlcod=28'32)", 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.481881+0000", 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.8418462600000001, 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0022520399999999999, 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481881+0000", 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481881+0000", 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481882+0000", 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:21:53.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481886+0000", 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9300000000000002e-06 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481895+0000", 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9069999999999996e-06 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481900+0000", 2024-09-11T05:21:53.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481946+0000", 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6384000000000002e-05 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481969+0000", 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2299000000000001e-05 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.484102+0000", 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0021336850000000002 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.484133+0000", 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0534999999999998e-05 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:3106 3.0 e28/22 3:061be309:::rbd_data.1179fd824b6b.0000000000000199:head v 28'38, mlcod=28'36)", 2024-09-11T05:21:53.410 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.672434+0000", 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.6512935039999999, 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001274332, 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672434+0000", 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672434+0000", 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672435+0000", 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6589999999999999e-06 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672467+0000", 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1260999999999998e-05 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672494+0000", 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7552e-05 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672504+0000", 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0045e-05 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672606+0000", 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000101399 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672631+0000", 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5181000000000002e-05 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.673663+0000", 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010321849999999999 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.673708+0000", 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5049999999999997e-05 2024-09-11T05:21:53.414 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:3130 3.0 e28/22 3:061be309:::rbd_data.1179fd824b6b.0000000000000199:head v 28'40, mlcod=28'38)", 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.711160+0000", 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.6125675579999998, 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00090769899999999998, 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711160+0000", 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711160+0000", 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711161+0000", 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.393e-06 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711171+0000", 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8740000000000007e-06 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711193+0000", 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2506000000000001e-05 2024-09-11T05:21:53.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711204+0000", 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0233e-05 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711272+0000", 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8015999999999994e-05 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.711294+0000", 2024-09-11T05:21:53.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1824e-05 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.712018+0000", 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00072486600000000001 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.712067+0000", 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8986999999999997e-05 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.419 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.420 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:53.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:21:53.421 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:53.420+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:53.438 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:21:53.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:53.521+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:53.529 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone5 from 0xb9f9ebb (overlap 0x1e8147c) to 0x0 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:10907 3.15 e32/22 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:head v 32'47, mlcod=32'45)", 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.557200+0000", 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0068097799999999997, 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0068378969999999999, 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557200+0000", 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557200+0000", 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557201+0000", 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557717+0000", 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00051647599999999998 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557748+0000", 2024-09-11T05:21:53.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1056000000000002e-05 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557756+0000", 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6899999999999992e-06 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557851+0000", 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5353000000000007e-05 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.557874+0000", 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2456999999999999e-05 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:10908 3.15 e32/22 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:head v 32'49, mlcod=32'45)", 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.558193+0000", 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.005816641, 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0058831070000000003, 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.568 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558193+0000", 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558193+0000", 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558194+0000", 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5400000000000001e-07 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558200+0000", 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.618e-06 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558209+0000", 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1580000000000005e-06 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558215+0000", 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4030000000000004e-06 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558638+0000", 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000423218 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.558650+0000", 2024-09-11T05:21:53.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2125e-05 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:10989 3.18 3:19221f1c:::rbd_data.117977dc529b.000000000000000e:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.560201+0000", 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0038084220000000001, 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039300519999999999, 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 10989 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560201+0000", 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560201+0000", 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560203+0000", 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0899999999999999e-06 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560208+0000", 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6019999999999999e-06 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560219+0000", 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1168e-05 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560227+0000", 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4769999999999997e-06 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560283+0000", 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6338000000000002e-05 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560368+0000", 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4460000000000001e-05 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.560620+0000", 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025276699999999999 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563461+0000", 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002840853 2024-09-11T05:21:53.576 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:10992 3.15 e32/22 3:aa49408d:::rbd_data.117977dc529b.0000000000000012:head v 32'50, mlcod=32'45)", 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.561487+0000", 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0025227790000000002, 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026874389999999998, 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561487+0000", 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561487+0000", 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561488+0000", 2024-09-11T05:21:53.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1399999999999995e-07 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561494+0000", 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561508+0000", 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4025e-05 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561516+0000", 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5059999999999998e-06 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561588+0000", 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2082000000000005e-05 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561607+0000", 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9541000000000001e-05 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.580 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.15 epoch 32/22 rep_tid 708 entries 32'51 (0'0) error 3:aec06161:::rbd_data.117977dc529b.0000000000000018:head by client.4473.0:10995 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 32'45)", 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.562193+0000", 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0018171490000000001, 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0020222500000000002, 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562193+0000", 2024-09-11T05:21:53.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562193+0000", 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562193+0000", 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1900000000000002e-07 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562201+0000", 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9750000000000007e-06 2024-09-11T05:21:53.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562222+0000", 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0237999999999998e-05 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562237+0000", 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5051999999999999e-05 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562325+0000", 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7928000000000002e-05 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.583 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.584 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:21:53.584 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 5 2024-09-11T05:21:53.584 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:53.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:21:53.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:53.626+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:53.683 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:21:53.683 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:21:53.683 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-11T05:21:53.683 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T05:21:53.683 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T05:21:53.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-11T05:21:53.711 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-11T05:21:53.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:53.723+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:53.757 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:53.757 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:53.757 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:53.757 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:53.757 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:53.772 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:21:53.812 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T05:21:53.812 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:53.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:53.858+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:53.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:53.924+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:53.942 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:53.942 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:53.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:53.942 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:53.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.942 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3098 3.1e 3:79cfec26:::rbd_data.1179fd824b6b.000000000000018c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:53.942 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.2894252110000002, 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013181033, 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3098 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651659+0000", 2024-09-11T05:21:53.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0990000000000001e-06 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651667+0000", 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0029999999999994e-06 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651687+0000", 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9669000000000001e-05 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651699+0000", 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651753+0000", 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3752999999999998e-05 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651853+0000", 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100216 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653599+0000", 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017458230000000001 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664569+0000", 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010970570000000001 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664624+0000", 2024-09-11T05:21:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037999999999997e-05 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664711+0000", 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6629e-05 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664838+0000", 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012700100000000001 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3099 3.18 3:197c5bdc:::rbd_data.1179fd824b6b.000000000000018d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.2876730109999999, 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012482269000000001, 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.949 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3099 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653410+0000", 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0300000000000001e-06 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653417+0000", 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3770000000000001e-06 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653431+0000", 2024-09-11T05:21:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.385e-05 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653438+0000", 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8820000000000001e-06 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653503+0000", 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4694000000000001e-05 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653612+0000", 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109036 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.656159+0000", 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002546436 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665824+0000", 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0096652730000000003 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665834+0000", 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9389999999999992e-06 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665863+0000", 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9526000000000002e-05 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665892+0000", 2024-09-11T05:21:53.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8226e-05 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14763 3.8 3:101b5d08:::rbd_data.1179262aa3d7.0000000000000017:5 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814449+0000", 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.126633149, 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011364358999999999, 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.955 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14763 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814449+0000", 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814449+0000", 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814450+0000", 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.89e-07 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814452+0000", 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814457+0000", 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8660000000000002e-06 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814462+0000", 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8810000000000004e-06 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.825662+0000", 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011199868 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.825727+0000", 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4817e-05 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.825814+0000", 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6563000000000005e-05 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.959 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14775 3.8 3:16d1b624:::rbd_data.1179262aa3d7.000000000000001b:5 [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814802+0000", 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12628072000000001, 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01135361, 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14775 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814802+0000", 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814802+0000", 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814802+0000", 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0999999999999998e-07 2024-09-11T05:21:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814806+0000", 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3639999999999999e-06 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814814+0000", 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8550000000000008e-06 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814821+0000", 2024-09-11T05:21:53.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3720000000000001e-06 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826006+0000", 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011185334999999999 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826074+0000", 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7935000000000006e-05 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826155+0000", 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1138999999999997e-05 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14779 3.8 3.10bad808 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814853+0000", 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12622919699999999, 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011398761, 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.964 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14779 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814853+0000", 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814853+0000", 2024-09-11T05:21:53.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814854+0000", 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814868+0000", 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4178999999999999e-05 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814875+0000", 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1069999999999999e-06 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814880+0000", 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5790000000000003e-06 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826243+0000", 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011362962000000001 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826252+0000", 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5399999999999996e-06 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14780 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814888+0000", 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12619439199999999, 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011393922000000001, 2024-09-11T05:21:53.968 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14780 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814888+0000", 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814888+0000", 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814888+0000", 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6499999999999999e-07 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814891+0000", 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:21:53.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814897+0000", 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8030000000000002e-06 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814901+0000", 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826275+0000", 2024-09-11T05:21:53.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011373995 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826282+0000", 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3439999999999997e-06 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14782 3.8 3.10bad808 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814908+0000", 2024-09-11T05:21:53.972 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12617462800000001, 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011402613000000001, 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14782 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814908+0000", 2024-09-11T05:21:53.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814908+0000", 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814908+0000", 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814910+0000", 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8759999999999999e-06 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814916+0000", 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814921+0000", 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.921e-06 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826302+0000", 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011381257000000001 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826310+0000", 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1110000000000008e-06 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14783 3.8 3.10bad808 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814927+0000", 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12615573199999999, 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011411871000000001, 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14783 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.977 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814927+0000", 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814927+0000", 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814927+0000", 2024-09-11T05:21:53.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7e-07 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814929+0000", 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9589999999999998e-06 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814935+0000", 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814940+0000", 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9520000000000002e-06 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826332+0000", 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011391986999999999 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826338+0000", 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6540000000000002e-06 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.980 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14784 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12613627299999999, 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011485377, 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14784 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814948+0000", 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9130000000000001e-06 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814954+0000", 2024-09-11T05:21:53.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814959+0000", 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826424+0000", 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011464396999999999 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826431+0000", 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8849999999999999e-06 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14787 3.18 3.1f928b58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814966+0000", 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12611644699999999, 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011401522000000001, 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.985 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14787 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814966+0000", 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814966+0000", 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814966+0000", 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814968+0000", 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0729999999999999e-06 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814975+0000", 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3350000000000003e-06 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814980+0000", 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9710000000000003e-06 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826361+0000", 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011381094 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826367+0000", 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6730000000000003e-06 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14789 3.18 3.1f928b58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814987+0000", 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12609531399999999, 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011405112, 2024-09-11T05:21:53.989 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14789 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814987+0000", 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814987+0000", 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814988+0000", 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9299999999999998e-07 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814990+0000", 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:21:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814996+0000", 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2949999999999999e-06 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815001+0000", 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826386+0000", 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011384465 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826392+0000", 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5060000000000001e-06 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14791 3.8 3.10bad808 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.993 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815007+0000", 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12607545000000001, 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011461624, 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14791 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815007+0000", 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815007+0000", 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815007+0000", 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815009+0000", 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2290000000000002e-06 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815016+0000", 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0449999999999997e-06 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815020+0000", 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8500000000000002e-06 2024-09-11T05:21:53.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826460+0000", 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01143979 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826468+0000", 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3219999999999993e-06 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:53.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14810 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815145+0000", 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12593690199999999, 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011378128, 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14810 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.998 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815145+0000", 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815145+0000", 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815146+0000", 2024-09-11T05:21:53.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815148+0000", 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.875e-06 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815154+0000", 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8690000000000001e-06 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815158+0000", 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.685e-06 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826518+0000", 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011359444 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826524+0000", 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.728e-06 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14814 3.8 3.10bad808 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815187+0000", 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12589566299999999, 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011361738, 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14814 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815187+0000", 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815187+0000", 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815187+0000", 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815189+0000", 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0040000000000002e-06 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815195+0000", 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.874e-06 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815200+0000", 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1989999999999997e-06 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826543+0000", 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011343295999999999 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826548+0000", 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.011e-06 2024-09-11T05:21:54.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14815 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815206+0000", 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12587599299999999, 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011382985999999999, 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14815 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815206+0000", 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815206+0000", 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815207+0000", 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815209+0000", 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2359999999999999e-06 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815215+0000", 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2750000000000001e-06 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815220+0000", 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2299999999999999e-06 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826581+0000", 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011360689 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826589+0000", 2024-09-11T05:21:54.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14819 3.8 3.10bad808 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815248+0000", 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.125834642, 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011370293, 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:54.010 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14819 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815248+0000", 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815248+0000", 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815248+0000", 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815250+0000", 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1349999999999999e-06 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815257+0000", 2024-09-11T05:21:54.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815263+0000", 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826613+0000", 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011350544000000001 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826618+0000", 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14828 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815288+0000", 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12579462299999999, 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011369133, 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:54.014 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14828 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815288+0000", 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815288+0000", 2024-09-11T05:21:54.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815288+0000", 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6699999999999999e-07 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815290+0000", 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815296+0000", 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.331e-06 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815301+0000", 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9849999999999997e-06 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826649+0000", 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011347733 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826657+0000", 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7079999999999997e-06 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14832 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815357+0000", 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12572561600000001, 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011364117, 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:54.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14832 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815357+0000", 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:54.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815357+0000", 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815357+0000", 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.65e-07 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815368+0000", 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0705e-05 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815375+0000", 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0029999999999997e-06 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815380+0000", 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5779999999999998e-06 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826713+0000", 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011332409 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826721+0000", 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0569999999999993e-06 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14836 3.8 3.10bad808 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815388+0000", 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12569423299999999, 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011358036, 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:54.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14836 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815388+0000", 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:54.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815388+0000", 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815389+0000", 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6600000000000002e-07 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815391+0000", 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2129999999999998e-06 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815397+0000", 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815402+0000", 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0209999999999999e-06 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826741+0000", 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011339177000000001 2024-09-11T05:21:54.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826746+0000", 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6609999999999999e-06 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14850 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.12557138200000001, 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011534898999999999, 2024-09-11T05:21:54.026 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14850 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815514+0000", 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.21e-06 2024-09-11T05:21:54.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815520+0000", 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3450000000000002e-06 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815525+0000", 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0969999999999996e-06 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.827038+0000", 2024-09-11T05:21:54.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011512638 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.827046+0000", 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1450000000000008e-06 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:54.030 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:54.031 INFO:teuthology.orchestra.run.smithi012.stdout:564 read 0x4c5c66a thru 0x4c66883 (0xa21a bytes) 2024-09-11T05:21:54.031 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.031 INFO:teuthology.orchestra.run.smithi012.stdout:566 write 0x5c673d3 thru 0x5c75532 (0xe160 bytes) 2024-09-11T05:21:54.031 INFO:teuthology.orchestra.run.smithi012.stdout:567 write 0x7cf4054 thru 0x7cfe23f (0xa1ec bytes) 2024-09-11T05:21:54.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:21:54.033 INFO:teuthology.orchestra.run.smithi012.stdout:568 punch from 0xf56655 to 0xf61bc4, (0xb56f bytes) 2024-09-11T05:21:54.033 INFO:teuthology.orchestra.run.smithi012.stdout:569 punch from 0x288b5e3 to 0x2894f37, (0x9954 bytes) 2024-09-11T05:21:54.033 INFO:teuthology.orchestra.run.smithi012.stdout:572 punch from 0x3ae99cf to 0x3af6340, (0xc971 bytes) 2024-09-11T05:21:54.033 INFO:teuthology.orchestra.run.smithi012.stdout:573 punch from 0xaf1ff17 to 0xaf1ffba, (0xa3 bytes) 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:574 trunc from 0xb9f9ebb to 0x1fe2a3b 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:575 writesame 0x66e140d thru 0x66ef0f5 data_size 0x7(0xdce9 bytes) 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:580 read 0x58699ef thru 0x5872b04 (0x9116 bytes) 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:582 punch from 0x272d95d to 0x272eabd, (0x1160 bytes) 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:583 trunc from 0x66ef0f6 to 0x62f8a1a 2024-09-11T05:21:54.034 INFO:teuthology.orchestra.run.smithi012.stdout:584 trunc from 0x62f8a1a to 0x13e3aac 2024-09-11T05:21:54.035 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:54.035+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:54.136 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:54.136+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:54.143 INFO:teuthology.orchestra.run.smithi012.stdout:585 write 0xbca5ea7 thru 0xbca7ee6 (0x2040 bytes) 2024-09-11T05:21:54.147 INFO:teuthology.orchestra.run.smithi012.stdout:586 punch from 0x5839d80 to 0x583bc8f, (0x1f0f bytes) 2024-09-11T05:21:54.147 INFO:teuthology.orchestra.run.smithi012.stdout:587 write 0xb9fc5a1 thru 0xba04133 (0x7b93 bytes) 2024-09-11T05:21:54.151 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.156 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:54.156 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:21:54.156 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:54.163 INFO:teuthology.orchestra.run.smithi012.stdout:589 trunc from 0xbca7ee7 to 0xa57167 2024-09-11T05:21:54.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:21:54.181 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.201 INFO:teuthology.orchestra.run.smithi012.stdout:592 write 0xe386807 thru 0xe39075a (0x9f54 bytes) 2024-09-11T05:21:54.218 INFO:teuthology.orchestra.run.smithi012.stdout:593 trunc from 0xe39075b to 0x253539f 2024-09-11T05:21:54.228 INFO:teuthology.orchestra.run.smithi012.stdout:594 read 0x82f42 thru 0x86d0a (0x3dc9 bytes) 2024-09-11T05:21:54.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:54.237+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:54.242 INFO:teuthology.orchestra.run.smithi012.stdout:595 writesame 0x8e98ce8 thru 0x8e9cf93 data_size 0x22(0x42ac bytes) 2024-09-11T05:21:54.242 INFO:teuthology.orchestra.run.smithi012.stdout:596 write 0x4335ebb thru 0x433b21c (0x5362 bytes) 2024-09-11T05:21:54.246 INFO:teuthology.orchestra.run.smithi012.stdout:597 trunc from 0x8e9cf94 to 0xa61f57d 2024-09-11T05:21:54.251 INFO:teuthology.orchestra.run.smithi012.stdout:598 writesame 0x39f4da1 thru 0x39f88bd data_size 0x1(0x3b1d bytes) 2024-09-11T05:21:54.260 INFO:teuthology.orchestra.run.smithi012.stdout:599 read 0x901fd85 thru 0x902905c (0x92d8 bytes) 2024-09-11T05:21:54.261 INFO:teuthology.orchestra.run.smithi012.stdout:600 read 0x2382fe7 thru 0x238db25 (0xab3f bytes) 2024-09-11T05:21:54.261 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.261 INFO:teuthology.orchestra.run.smithi012.stdout:602 read 0x5aa2c04 thru 0x5aaaf9b (0x8398 bytes) 2024-09-11T05:21:54.261 INFO:teuthology.orchestra.run.smithi012.stdout:604 writesame 0x5b7345 thru 0x5c34f7 data_size 0x1(0xc1b3 bytes) 2024-09-11T05:21:54.274 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:21:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:21:54.275 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:54.276 INFO:teuthology.orchestra.run.smithi012.stdout:605 write 0x5d20b8b thru 0x5d2d2cc (0xc742 bytes) 2024-09-11T05:21:54.280 INFO:teuthology.orchestra.run.smithi012.stdout:606 trunc from 0xa61f57d to 0xb7faf71 2024-09-11T05:21:54.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:21:54.287 INFO:teuthology.orchestra.run.smithi012.stdout:607 write 0x82b3a0d thru 0x82bde31 (0xa425 bytes) 2024-09-11T05:21:54.290 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.290 INFO:teuthology.orchestra.run.smithi012.stdout:609 read 0xaa7317c thru 0xaa7b054 (0x7ed9 bytes) 2024-09-11T05:21:54.290 INFO:teuthology.orchestra.run.smithi012.stdout:610 read 0x511781 thru 0x515bd3 (0x4453 bytes) 2024-09-11T05:21:54.291 INFO:teuthology.orchestra.run.smithi012.stdout:611 trunc from 0xb7faf71 to 0xbf59d24 2024-09-11T05:21:54.296 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.296 INFO:teuthology.orchestra.run.smithi012.stdout:614 writesame 0x25bba2d thru 0x25c3274 data_size 0xc(0x7848 bytes) 2024-09-11T05:21:54.300 INFO:teuthology.orchestra.run.smithi012.stdout:615 writesame 0x5865ab7 thru 0x5866c74 data_size 0x3(0x11be bytes) 2024-09-11T05:21:54.303 INFO:teuthology.orchestra.run.smithi012.stdout:616 punch from 0xf40657 to 0xf489ac, (0x8355 bytes) 2024-09-11T05:21:54.304 INFO:teuthology.orchestra.run.smithi012.stdout:617 read 0x42ffeeb thru 0x430fd21 (0xfe37 bytes) 2024-09-11T05:21:54.314 INFO:teuthology.orchestra.run.smithi012.stdout:618 write 0xe9ca73d thru 0xe9ce2d8 (0x3b9c bytes) 2024-09-11T05:21:54.317 INFO:teuthology.orchestra.run.smithi012.stdout:619 write 0x4475498 thru 0x44758fe (0x467 bytes) 2024-09-11T05:21:54.318 INFO:teuthology.orchestra.run.smithi012.stdout:620 write 0xe27027e thru 0xe27a5a0 (0xa323 bytes) 2024-09-11T05:21:54.320 INFO:teuthology.orchestra.run.smithi012.stdout:621 read 0x292cf25 thru 0x2932746 (0x5822 bytes) 2024-09-11T05:21:54.329 INFO:teuthology.orchestra.run.smithi012.stdout:622 trunc from 0xe9ce2d9 to 0x6ab0c73 2024-09-11T05:21:54.340 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:54.337+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:54.353 INFO:teuthology.orchestra.run.smithi012.stdout:623 write 0x9dbfd55 thru 0x9dc23c8 (0x2674 bytes) 2024-09-11T05:21:54.356 INFO:teuthology.orchestra.run.smithi012.stdout:624 writesame 0x5bc3136 thru 0x5bcdc76 data_size 0x1(0xab41 bytes) 2024-09-11T05:21:54.376 INFO:teuthology.orchestra.run.smithi012.stdout:626 writesame 0x769b8aa thru 0x76a38eb data_size 0x1(0x8042 bytes) 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:13 3.e e25/22 3:7343f3fe:::rbd_object_map.1179d519140e:head v 25'1, mlcod=0'0)", 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.9726678910000004, 2024-09-11T05:21:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057493450000000003, 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:54.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6600000000000003e-07 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421840+0000", 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.002e-06 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421850+0000", 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.028e-05 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421861+0000", 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0513000000000001e-05 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421924+0000", 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3546000000000004e-05 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421942+0000", 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7589e-05 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.427542+0000", 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056002400000000003 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.427585+0000", 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2908999999999999e-05 2024-09-11T05:21:54.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2523 3.14 3:2b103c72:::rbd_data.1179262aa3d7.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0349325489999996, 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013316906999999999, 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2523 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:54.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359573+0000", 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6840000000000001e-06 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361466+0000", 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001893287 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361482+0000", 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5519000000000002e-05 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361495+0000", 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3370000000000001e-05 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361560+0000", 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4745000000000004e-05 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361729+0000", 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016939400000000001 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.364709+0000", 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029801099999999998 2024-09-11T05:21:54.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372342+0000", 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0076326930000000003 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372776+0000", 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433609 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372834+0000", 2024-09-11T05:21:54.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8417e-05 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372888+0000", 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079000000000002e-05 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2525 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0309917320000004, 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019154353999999998, 2024-09-11T05:21:54.407 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2525 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363513+0000", 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9800000000000002e-07 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365409+0000", 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001896191 2024-09-11T05:21:54.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365427+0000", 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7388e-05 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365435+0000", 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6090000000000001e-06 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365491+0000", 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6289000000000003e-05 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365647+0000", 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015579999999999999 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371139+0000", 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054914359999999997 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.380804+0000", 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096655219999999993 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382549+0000", 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017446199999999999 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382614+0000", 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4807000000000005e-05 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382666+0000", 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2694000000000001e-05 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.413 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2527 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0253124690000002, 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014529937, 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2527 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369192+0000", 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371078+0000", 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001885861 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371090+0000", 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1979e-05 2024-09-11T05:21:54.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371097+0000", 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.002e-06 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371161+0000", 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3348000000000004e-05 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371329+0000", 2024-09-11T05:21:54.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016788799999999999 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.375139+0000", 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003810173 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383559+0000", 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084199949999999996 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383654+0000", 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5092000000000004e-05 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383686+0000", 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1965999999999999e-05 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383721+0000", 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5392999999999998e-05 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2590 3.1a 3:5b4ca92b:::rbd_data.1179262aa3d7.000000000000005c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.9400296390000005, 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051783389999999997, 2024-09-11T05:21:54.420 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2590 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454475+0000", 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-11T05:21:54.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454489+0000", 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801000000000001e-05 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454500+0000", 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.066e-05 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454507+0000", 2024-09-11T05:21:54.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3799999999999996e-06 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454565+0000", 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7917999999999997e-05 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454649+0000", 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3963999999999998e-05 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454751+0000", 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102326 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.458547+0000", 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037954780000000001 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459574+0000", 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010266780000000001 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459622+0000", 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8380000000000001e-05 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459652+0000", 2024-09-11T05:21:54.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0474e-05 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2655 3.1a 3:5b95b2d1:::rbd_data.1179262aa3d7.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.8660495800000003, 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067417809999999996, 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.427 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2655 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:54.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528455+0000", 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528459+0000", 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:21:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528470+0000", 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0210000000000001e-05 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528477+0000", 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2099999999999996e-06 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528530+0000", 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2809000000000002e-05 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528615+0000", 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5845000000000002e-05 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528735+0000", 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011913699999999999 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.529264+0000", 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052902400000000001 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535140+0000", 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058759420000000003 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535171+0000", 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1377999999999997e-05 2024-09-11T05:21:54.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535196+0000", 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4939999999999998e-05 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3107 3.1a 3:5b3318f8:::rbd_data.1179fd824b6b.000000000000019a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.7248087349999999, 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0083332600000000003, 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3107 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669696+0000", 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5269999999999999e-06 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669703+0000", 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7190000000000004e-06 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669715+0000", 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2184000000000001e-05 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669721+0000", 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-09-11T05:21:54.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669768+0000", 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6665999999999997e-05 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669863+0000", 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4823999999999999e-05 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.671208+0000", 2024-09-11T05:21:54.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013450059999999999 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677941+0000", 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067329379999999999 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677951+0000", 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0732e-05 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677983+0000", 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1582999999999999e-05 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.678028+0000", 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5290999999999997e-05 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:11549 3.14 3:29aa68ec:::rbd_data.117977dc529b.0000000000000026:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.592483+0000", 2024-09-11T05:21:54.439 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80202090500000001, 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056916470000000002, 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11549 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.592483+0000", 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.592483+0000", 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.592484+0000", 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3600000000000002e-07 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593622+0000", 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011380889999999999 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593636+0000", 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4287999999999999e-05 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593644+0000", 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4630000000000001e-06 2024-09-11T05:21:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593768+0000", 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012390799999999999 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593853+0000", 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4433999999999998e-05 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.594090+0000", 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237235 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.596861+0000", 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027705770000000002 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.598083+0000", 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001222852 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.598136+0000", 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2816999999999999e-05 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.598174+0000", 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8148000000000001e-05 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12197 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66064916699999998, 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050822769999999996, 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12197 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:21:54.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733857+0000", 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9240000000000001e-06 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733863+0000", 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8590000000000001e-06 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733868+0000", 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8489999999999997e-06 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738770+0000", 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049025559999999998 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738839+0000", 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8793000000000004e-05 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738937+0000", 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7854000000000002e-05 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12198 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66063060399999995, 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050661059999999999, 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12198 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733875+0000", 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9719999999999999e-06 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733882+0000", 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.071e-06 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733886+0000", 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7759999999999997e-06 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738834+0000", 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049473989999999999 2024-09-11T05:21:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738882+0000", 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8148e-05 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738939+0000", 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7351e-05 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12199 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66061218600000005, 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052374530000000004, 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12199 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733894+0000", 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733900+0000", 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1e-06 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733905+0000", 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6450000000000004e-06 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738970+0000", 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050656779999999997 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739036+0000", 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5457999999999996e-05 2024-09-11T05:21:54.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739129+0000", 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3227999999999996e-05 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12206 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733945+0000", 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66055823599999997, 2024-09-11T05:21:54.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051847760000000003, 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12206 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733945+0000", 2024-09-11T05:21:54.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733945+0000", 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733946+0000", 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999998e-07 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733948+0000", 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4380000000000002e-06 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733955+0000", 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733965+0000", 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428000000000001e-05 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738969+0000", 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050034299999999997 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739035+0000", 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6885999999999996e-05 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739130+0000", 2024-09-11T05:21:54.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4782000000000002e-05 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12208 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 1146880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733994+0000", 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66050974500000004, 2024-09-11T05:21:54.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052443139999999999, 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12208 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733994+0000", 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733994+0000", 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733995+0000", 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6700000000000003e-07 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733997+0000", 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.142e-06 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734003+0000", 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734008+0000", 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8509999999999998e-06 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739154+0000", 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051460619999999999 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739189+0000", 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4916000000000002e-05 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739238+0000", 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9317999999999998e-05 2024-09-11T05:21:54.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12209 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 1146880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66048976699999995, 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053092189999999996, 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12209 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734021+0000", 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5830000000000003e-06 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734028+0000", 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4059999999999999e-06 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734034+0000", 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2440000000000001e-06 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739164+0000", 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051305140000000001 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739231+0000", 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7273000000000005e-05 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739323+0000", 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1735000000000002e-05 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12211 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734040+0000", 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66046352600000002, 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054081859999999997, 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12211 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734040+0000", 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734040+0000", 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734041+0000", 2024-09-11T05:21:54.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734043+0000", 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734050+0000", 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734059+0000", 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739354+0000", 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052947280000000003 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739391+0000", 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7141000000000002e-05 2024-09-11T05:21:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739448+0000", 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7076e-05 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12213 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734102+0000", 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.660401766, 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052405239999999999, 2024-09-11T05:21:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12213 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734102+0000", 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734102+0000", 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734103+0000", 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7599999999999997e-07 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734105+0000", 2024-09-11T05:21:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4889999999999998e-06 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734113+0000", 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8299999999999996e-06 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734118+0000", 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739254+0000", 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051358200000000001 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739290+0000", 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6177999999999998e-05 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739342+0000", 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2216000000000003e-05 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12215 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.66037890700000001, 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055120500000000001, 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.483 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12215 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9200000000000001e-07 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734128+0000", 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:21:54.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734133+0000", 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734138+0000", 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739471+0000", 2024-09-11T05:21:54.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053332910000000004 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739543+0000", 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2512e-05 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739637+0000", 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3469999999999998e-05 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16596 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.085451+0000", 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.309052677, 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035633092999999998, 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.488 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16596 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.085451+0000", 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.085451+0000", 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.085453+0000", 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8220000000000001e-06 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.097972+0000", 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01251961 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098001+0000", 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8776e-05 2024-09-11T05:21:54.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098014+0000", 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3059e-05 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098102+0000", 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7797e-05 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098279+0000", 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000177147 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.099045+0000", 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076592299999999995 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.114143+0000", 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015098115 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120993+0000", 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068501969999999997 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.121042+0000", 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8474999999999999e-05 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.121084+0000", 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2172000000000002e-05 2024-09-11T05:21:54.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16683 3.14 3:28b1ec8f:::rbd_data.1179c3639760.0000000000000006:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.140988001, 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071994340000000002, 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16683 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0100000000000004e-07 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253521+0000", 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253531+0000", 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0370999999999999e-05 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253537+0000", 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253583+0000", 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6385999999999999e-05 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253680+0000", 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6497999999999997e-05 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.254851+0000", 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00117169 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260585+0000", 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057331559999999997 2024-09-11T05:21:54.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260604+0000", 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9093000000000002e-05 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260662+0000", 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7995000000000003e-05 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260715+0000", 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3483999999999998e-05 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16685 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.261258+0000", 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.133245689, 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060508389999999997, 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.500 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16685 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261258+0000", 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261258+0000", 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261259+0000", 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.141e-06 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261265+0000", 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261276+0000", 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1191e-05 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261281+0000", 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261327+0000", 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5277e-05 2024-09-11T05:21:54.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261383+0000", 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6317000000000003e-05 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.262254+0000", 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00087115900000000004 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267151+0000", 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048965099999999998 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267197+0000", 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6307000000000002e-05 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267260+0000", 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3006e-05 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267309+0000", 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8902e-05 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.506 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:54.508 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:21:54.509 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:54.507+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:627 write 0xa224ea5 thru 0xa230591 (0xb6ed bytes) 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:628 writesame 0xc0a3c1c thru 0xc0a79d1 data_size 0x3(0x3db6 bytes) 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:630 write 0x891a323 thru 0x8920d97 (0x6a75 bytes) 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:631 write 0xb2b323d thru 0xb2b4f2b (0x1cef bytes) 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:632 read 0x1af4b84 thru 0x1b026f5 (0xdb72 bytes) 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:634 write 0x12fd3e0 thru 0x1302e8a (0x5aab bytes) 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:635 writesame 0xe0e65b8 thru 0xe0e7836 data_size 0x1(0x127f bytes) 2024-09-11T05:21:54.510 INFO:teuthology.orchestra.run.smithi012.stdout:636 writesame 0x43323a thru 0x43b1c6 data_size 0x1(0x7f8d bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:637 punch from 0x2da617e to 0x2dae2e5, (0x8167 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:638 writesame 0x8ef7091 thru 0x8f00078 data_size 0x28(0x8fe8 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:639 writesame 0x9c330a7 thru 0x9c3d77c data_size 0x5(0xa6d6 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:641 writesame 0xe0ae1dd thru 0xe0bc695 data_size 0x1(0xe4b9 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:642 write 0x4431874 thru 0x44383cb (0x6b58 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:643 write 0x42dfaf8 thru 0x42e83ac (0x88b5 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:644 write 0x62a88fa thru 0x62a90bc (0x7c3 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:645 read 0x96d875 thru 0x96effa (0x1786 bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:647 read 0x8cbfca5 thru 0x8cc02d1 (0x62d bytes) 2024-09-11T05:21:54.511 INFO:teuthology.orchestra.run.smithi012.stdout:648 trunc from 0xe0e7837 to 0x86c3bbd 2024-09-11T05:21:54.512 INFO:teuthology.orchestra.run.smithi012.stdout:649 writesame 0xb5f4152 thru 0xb602b06 data_size 0x93(0xe9b5 bytes) 2024-09-11T05:21:54.512 INFO:teuthology.orchestra.run.smithi012.stdout:651 read 0x4fd7e96 thru 0x4fdeee9 (0x7054 bytes) 2024-09-11T05:21:54.512 INFO:teuthology.orchestra.run.smithi012.stdout:653 punch from 0x603d1c4 to 0x604be2c, (0xec68 bytes) 2024-09-11T05:21:54.512 INFO:teuthology.orchestra.run.smithi012.stdout:655 flatten 2024-09-11T05:21:54.519 INFO:teuthology.orchestra.run.smithi012.stdout:656 writesame 0x2041b78 thru 0x204508b data_size 0x4(0x3514 bytes) 2024-09-11T05:21:54.521 INFO:teuthology.orchestra.run.smithi012.stdout:658 read 0xff3a06 thru 0x100054b (0xcb46 bytes) 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:659 read 0x6e02cda thru 0x6e05a6b (0x2d92 bytes) 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:661 punch from 0x1cd0c0f to 0x1cdb6e4, (0xaad5 bytes) 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:662 read 0x1de515f thru 0x1de81ce (0x3070 bytes) 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:664 read 0x2914389 thru 0x2915d95 (0x1a0d bytes) 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:666 punch from 0x35b7e77 to 0x35c1bb6, (0x9d3f bytes) 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:668 write 0x40c7b6e thru 0x40d139f (0x9832 bytes) 2024-09-11T05:21:54.523 INFO:teuthology.orchestra.run.smithi012.stdout:669 write 0x878285b thru 0x8790f18 (0xe6be bytes) 2024-09-11T05:21:54.524 INFO:teuthology.orchestra.run.smithi012.stdout:672 read 0x4fb715 thru 0x4fbd03 (0x5ef bytes) 2024-09-11T05:21:54.525 INFO:teuthology.orchestra.run.smithi012.stdout:674 read 0x8fa8103 thru 0x8fb7b94 (0xfa92 bytes) 2024-09-11T05:21:54.525 INFO:teuthology.orchestra.run.smithi012.stdout:676 read 0xaa8d0dc thru 0xaa9bdaa (0xeccf bytes) 2024-09-11T05:21:54.525 INFO:teuthology.orchestra.run.smithi012.stdout:678 read 0x68e6062 thru 0x68ee179 (0x8118 bytes) 2024-09-11T05:21:54.525 INFO:teuthology.orchestra.run.smithi012.stdout:679 write 0x1401dee thru 0x1402fa3 (0x11b6 bytes) 2024-09-11T05:21:54.526 INFO:teuthology.orchestra.run.smithi012.stdout:682 read 0xb3cb145 thru 0xb3cbe3d (0xcf9 bytes) 2024-09-11T05:21:54.527 INFO:teuthology.orchestra.run.smithi012.stdout:684 punch from 0x9382ac7 to 0x9383103, (0x63c bytes) 2024-09-11T05:21:54.527 INFO:teuthology.orchestra.run.smithi012.stdout:686 read 0xb3b96d8 thru 0xb3c05b6 (0x6edf bytes) 2024-09-11T05:21:54.527 INFO:teuthology.orchestra.run.smithi012.stdout:687 write 0x95a34dd thru 0x95ac9f7 (0x951b bytes) 2024-09-11T05:21:54.529 INFO:teuthology.orchestra.run.smithi012.stdout:689 read 0xd3240e thru 0xd32c71 (0x864 bytes) 2024-09-11T05:21:54.529 INFO:teuthology.orchestra.run.smithi012.stdout:691 writesame 0x74d279d thru 0x74dabaf data_size 0x1(0x8413 bytes) 2024-09-11T05:21:54.554 INFO:teuthology.orchestra.run.smithi012.stdout:692 trunc from 0xb602b07 to 0x37bbdf5 2024-09-11T05:21:54.567 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.571 INFO:teuthology.orchestra.run.smithi012.stdout:694 trunc from 0x37bbdf5 to 0x6e41b1b 2024-09-11T05:21:54.577 INFO:teuthology.orchestra.run.smithi012.stdout:695 read 0x41ceeab thru 0x41d36c0 (0x4816 bytes) 2024-09-11T05:21:54.577 INFO:teuthology.orchestra.run.smithi012.stdout:696 read 0x3e8867b thru 0x3e8a1bc (0x1b42 bytes) 2024-09-11T05:21:54.577 INFO:teuthology.orchestra.run.smithi012.stdout:697 trunc from 0x6e41b1b to 0x74f4ba3 2024-09-11T05:21:54.595 INFO:teuthology.orchestra.run.smithi012.stdout:698 write 0xd91cacb thru 0xd922af9 (0x602f bytes) 2024-09-11T05:21:54.598 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.598 INFO:teuthology.orchestra.run.smithi012.stdout:700 write 0xa223111 thru 0xa228cea (0x5bda bytes) 2024-09-11T05:21:54.601 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.608 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:54.608+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:54.610 INFO:teuthology.orchestra.run.smithi012.stdout:702 trunc from 0xd922afa to 0x552a27a 2024-09-11T05:21:54.633 INFO:teuthology.orchestra.run.smithi012.stdout:703 writesame 0xb19085a thru 0xb196103 data_size 0x61(0x58aa bytes) 2024-09-11T05:21:54.633 INFO:teuthology.orchestra.run.smithi012.stdout:705 read 0x3b05fd4 thru 0x3b13733 (0xd760 bytes) 2024-09-11T05:21:54.633 INFO:teuthology.orchestra.run.smithi012.stdout:706 writesame 0x2640acf thru 0x264d425 data_size 0x53(0xc957 bytes) 2024-09-11T05:21:54.634 INFO:teuthology.orchestra.run.smithi012.stdout:708 read 0x8b2cb5 thru 0x8b315f (0x4ab bytes) 2024-09-11T05:21:54.637 INFO:teuthology.orchestra.run.smithi012.stdout:709 read 0x69b68a8 thru 0x69bb021 (0x477a bytes) 2024-09-11T05:21:54.637 INFO:teuthology.orchestra.run.smithi012.stdout:710 punch from 0x98dd64c to 0x98eb2aa, (0xdc5e bytes) 2024-09-11T05:21:54.637 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.637 INFO:teuthology.orchestra.run.smithi012.stdout:715 read 0x3aee356 thru 0x3af26f9 (0x43a4 bytes) 2024-09-11T05:21:54.639 INFO:teuthology.orchestra.run.smithi012.stdout:718 trunc from 0xb196104 to 0xc975d81 2024-09-11T05:21:54.644 INFO:teuthology.orchestra.run.smithi012.stdout:720 read 0x63b1a2b thru 0x63c109d (0xf673 bytes) 2024-09-11T05:21:54.644 INFO:teuthology.orchestra.run.smithi012.stdout:721 read 0x280edfd thru 0x281671f (0x7923 bytes) 2024-09-11T05:21:54.650 INFO:teuthology.orchestra.run.smithi012.stdout:723 write 0xdbac803 thru 0xdbb1ce8 (0x54e6 bytes) 2024-09-11T05:21:54.653 INFO:teuthology.orchestra.run.smithi012.stdout:724 write 0x38f3444 thru 0x38f4927 (0x14e4 bytes) 2024-09-11T05:21:54.659 INFO:teuthology.orchestra.run.smithi012.stdout:725 writesame 0xded287a thru 0xdedbc69 data_size 0x30(0x93f0 bytes) 2024-09-11T05:21:54.659 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:54.659 INFO:teuthology.orchestra.run.smithi012.stdout:728 read 0x28e29ad thru 0x28e8863 (0x5eb7 bytes) 2024-09-11T05:21:54.660 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:54.660 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:54.660 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:21:54.661 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:54.661 INFO:teuthology.orchestra.run.smithi012.stdout:729 trunc from 0xdedbc6a to 0xbc776fc 2024-09-11T05:21:54.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:21:54.672 INFO:teuthology.orchestra.run.smithi012.stdout:731 punch from 0x9e976e5 to 0x9ea4406, (0xcd21 bytes) 2024-09-11T05:21:54.680 INFO:teuthology.orchestra.run.smithi012.stdout:732 write 0xdd51f0d thru 0xdd5353d (0x1631 bytes) 2024-09-11T05:21:54.684 INFO:teuthology.orchestra.run.smithi012.stdout:733 read 0xc695394 thru 0xc6a0d69 (0xb9d6 bytes) 2024-09-11T05:21:54.684 INFO:teuthology.orchestra.run.smithi012.stdout:734 writesame 0x397d0c thru 0x398a93 data_size 0x4(0xd88 bytes) 2024-09-11T05:21:54.687 INFO:teuthology.orchestra.run.smithi012.stdout:735 read 0xb712aff thru 0xb715e74 (0x3376 bytes) 2024-09-11T05:21:54.687 INFO:teuthology.orchestra.run.smithi012.stdout:736 write 0x6002b84 thru 0x6003bc4 (0x1041 bytes) 2024-09-11T05:21:54.689 INFO:teuthology.orchestra.run.smithi012.stdout:737 write 0x472f353 thru 0x4739bdb (0xa889 bytes) 2024-09-11T05:21:54.691 INFO:teuthology.orchestra.run.smithi012.stdout:738 write 0x1c29651 thru 0x1c2d870 (0x4220 bytes) 2024-09-11T05:21:54.692 INFO:teuthology.orchestra.run.smithi012.stdout:739 write 0x8c04085 thru 0x8c13226 (0xf1a2 bytes) 2024-09-11T05:21:54.695 INFO:teuthology.orchestra.run.smithi012.stdout:740 clone 7 order 18 su 1024 sc 12 2024-09-11T05:21:54.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:54.708+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:54.774 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:54.774 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:54.775 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:21:54.775 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:21:54.775 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:54.783 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:21:54.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:54.809+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:54.888 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:54.888 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:11555 3.c 3:3472c1bf:::rbd_data.117977dc529b.0000000000000025:head [delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.593664+0000", 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2937128840000001, 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013122533, 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11555 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593664+0000", 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593664+0000", 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593665+0000", 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1900000000000001e-07 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593672+0000", 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0180000000000004e-06 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593695+0000", 2024-09-11T05:21:54.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2983e-05 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593701+0000", 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.595082+0000", 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001381317 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.595188+0000", 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105375 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 3", 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.595433+0000", 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024524099999999999 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.598205+0000", 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027719989999999998 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606693+0000", 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084879410000000006 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606748+0000", 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5262e-05 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606787+0000", 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8448999999999997e-05 2024-09-11T05:21:54.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13147 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 458752~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762697+0000", 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1246805559999999, 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012660841000000001, 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13147 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762697+0000", 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762697+0000", 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762697+0000", 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762699+0000", 2024-09-11T05:21:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1430000000000001e-06 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762705+0000", 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.879e-06 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762710+0000", 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7110000000000003e-06 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775261+0000", 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012550804 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775303+0000", 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2929999999999997e-05 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775357+0000", 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3959000000000003e-05 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13161 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 360448~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762716+0000", 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1246613649999999, 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012796642, 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.900 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13161 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762716+0000", 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762716+0000", 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762716+0000", 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2300000000000002e-07 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762720+0000", 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129999999999999e-06 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762726+0000", 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9699999999999996e-06 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762731+0000", 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775388+0000", 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012657497 2024-09-11T05:21:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775448+0000", 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9645000000000002e-05 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775512+0000", 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4549999999999997e-05 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13177 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 917504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762737+0000", 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1246403279999999, 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012894097, 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13177 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762737+0000", 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762737+0000", 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762737+0000", 2024-09-11T05:21:54.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762739+0000", 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.103e-06 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762745+0000", 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8019999999999997e-06 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762750+0000", 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.848e-06 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775538+0000", 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012788037 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775585+0000", 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6539999999999998e-05 2024-09-11T05:21:54.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775631+0000", 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6350000000000002e-05 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13181 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 638976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762756+0000", 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.124621096, 2024-09-11T05:21:54.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013102079000000001, 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13181 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762756+0000", 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762756+0000", 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762756+0000", 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762759+0000", 2024-09-11T05:21:54.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1210000000000001e-06 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762764+0000", 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8429999999999998e-06 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762769+0000", 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6079999999999998e-06 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775680+0000", 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012910726000000001 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775763+0000", 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3526e-05 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775858+0000", 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4848999999999999e-05 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13192 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 638976~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762776+0000", 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1246012759999999, 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013240256000000001, 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.914 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13192 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762776+0000", 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762776+0000", 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762776+0000", 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762779+0000", 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0979999999999998e-06 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762786+0000", 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3099999999999997e-06 2024-09-11T05:21:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762791+0000", 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775897+0000", 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013106072 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.775960+0000", 2024-09-11T05:21:54.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3396000000000001e-05 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776016+0000", 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5899999999999997e-05 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.918 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13202 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 1277952~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.919 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762797+0000", 2024-09-11T05:21:54.919 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1245801209999999, 2024-09-11T05:21:54.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013368847999999999, 2024-09-11T05:21:54.919 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13202 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762797+0000", 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762797+0000", 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762797+0000", 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762799+0000", 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0379999999999998e-06 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762807+0000", 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2949999999999996e-06 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762812+0000", 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0599999999999998e-06 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776041+0000", 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013228726 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776099+0000", 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8538000000000001e-05 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776166+0000", 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6780999999999996e-05 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13211 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 1376256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762819+0000", 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1245585010000001, 2024-09-11T05:21:54.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013482073000000001, 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13211 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762819+0000", 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762819+0000", 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762819+0000", 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4799999999999998e-07 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762821+0000", 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2330000000000001e-06 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762828+0000", 2024-09-11T05:21:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.533e-06 2024-09-11T05:21:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762833+0000", 2024-09-11T05:21:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3190000000000002e-06 2024-09-11T05:21:54.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776204+0000", 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013370432999999999 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776258+0000", 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4620999999999998e-05 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776301+0000", 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2385999999999997e-05 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13214 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 1097728~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.931 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762841+0000", 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.124536049, 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013606671000000001, 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13214 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762841+0000", 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762841+0000", 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762841+0000", 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762844+0000", 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.131e-06 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762850+0000", 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762855+0000", 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9280000000000001e-06 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776344+0000", 2024-09-11T05:21:54.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01348916 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776394+0000", 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0353999999999999e-05 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776448+0000", 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3279999999999998e-05 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.936 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13225 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 1097728~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762861+0000", 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1245161420000001, 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013761992000000001, 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.937 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13225 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762861+0000", 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762861+0000", 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762861+0000", 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762863+0000", 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.886e-06 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762869+0000", 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9359999999999996e-06 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762874+0000", 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5950000000000001e-06 2024-09-11T05:21:54.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776478+0000", 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013604218 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776555+0000", 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7149000000000003e-05 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776623+0000", 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7855999999999995e-05 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13228 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 1556480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762880+0000", 2024-09-11T05:21:54.942 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1244973220000001, 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013904962999999999, 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13228 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762880+0000", 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762880+0000", 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762880+0000", 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762887+0000", 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5919999999999997e-06 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762893+0000", 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3090000000000001e-06 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762898+0000", 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776652+0000", 2024-09-11T05:21:54.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013753962999999999 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776720+0000", 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8458000000000001e-05 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776785+0000", 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4325000000000005e-05 2024-09-11T05:21:54.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13254 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 1556480~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762904+0000", 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1244729440000001, 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014059008, 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.948 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13254 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762904+0000", 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762904+0000", 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762905+0000", 2024-09-11T05:21:54.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:21:54.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762906+0000", 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.846e-06 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762912+0000", 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9599999999999997e-06 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762917+0000", 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7230000000000004e-06 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776813+0000", 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013895696000000001 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776881+0000", 2024-09-11T05:21:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8355999999999994e-05 2024-09-11T05:21:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776963+0000", 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2053999999999997e-05 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13262 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 425984~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762930+0000", 2024-09-11T05:21:54.956 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1244466719999999, 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014223293999999999, 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13262 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.957 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762930+0000", 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762930+0000", 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762931+0000", 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762933+0000", 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2699999999999999e-06 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762940+0000", 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6159999999999998e-06 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762945+0000", 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.776992+0000", 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014046746000000001 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777063+0000", 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0946999999999997e-05 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777154+0000", 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1199000000000006e-05 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13277 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 327680~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762951+0000", 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.124426532, 2024-09-11T05:21:54.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014425369, 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13277 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762951+0000", 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762951+0000", 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762951+0000", 2024-09-11T05:21:54.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762953+0000", 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8789999999999999e-06 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762960+0000", 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2529999999999998e-06 2024-09-11T05:21:54.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762965+0000", 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8010000000000003e-06 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777209+0000", 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014243818 2024-09-11T05:21:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777284+0000", 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5241999999999996e-05 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777376+0000", 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1916000000000006e-05 2024-09-11T05:21:54.967 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13310 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 32768~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762971+0000", 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.124406365, 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014593366999999999, 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.968 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13310 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762971+0000", 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762971+0000", 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762971+0000", 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.96e-07 2024-09-11T05:21:54.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762973+0000", 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0200000000000001e-06 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762979+0000", 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1349999999999997e-06 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762984+0000", 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7840000000000003e-06 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777408+0000", 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014423698 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777474+0000", 2024-09-11T05:21:54.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6426000000000004e-05 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777564+0000", 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9907999999999994e-05 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13317 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 131072~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.762992+0000", 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1243850790000001, 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014766670000000001, 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.974 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13317 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762992+0000", 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762992+0000", 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762992+0000", 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9299999999999999e-07 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.762995+0000", 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.131e-06 2024-09-11T05:21:54.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763007+0000", 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2255e-05 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763013+0000", 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3849999999999999e-06 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777599+0000", 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014585717999999999 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777671+0000", 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1626999999999997e-05 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777759+0000", 2024-09-11T05:21:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8160999999999998e-05 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13362 3.16 3:6a0ece1f:::rbd_data.1179262aa3d7.000000000000001d:5 [read 81920~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.763020+0000", 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1243573520000001, 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014937743999999999, 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13362 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763020+0000", 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763020+0000", 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763020+0000", 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2199999999999999e-07 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763023+0000", 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9950000000000001e-06 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763058+0000", 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4989e-05 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763065+0000", 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1339999999999998e-06 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777788+0000", 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014723023 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777859+0000", 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0627e-05 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777958+0000", 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8554000000000005e-05 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13365 3.16 3:6de6b685:::rbd_data.1179262aa3d7.000000000000001a:5 [read 81920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.763087+0000", 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.124290574, 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015024756, 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.984 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13365 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763087+0000", 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763087+0000", 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763087+0000", 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6199999999999998e-07 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763090+0000", 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3780000000000001e-06 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763098+0000", 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4619999999999999e-06 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.763103+0000", 2024-09-11T05:21:54.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0660000000000003e-06 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.777993+0000", 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014890113999999999 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.778041+0000", 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8192000000000002e-05 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.778111+0000", 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9981999999999995e-05 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16594 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 7077888] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.082481+0000", 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.804895955, 2024-09-11T05:21:54.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038578363999999997, 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16594 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.082481+0000", 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.082481+0000", 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.082482+0000", 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7299999999999996e-07 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.092140+0000", 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096578619999999997 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.092165+0000", 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5032999999999999e-05 2024-09-11T05:21:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.092176+0000", 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1219e-05 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.092240+0000", 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4284999999999999e-05 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.092356+0000", 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000116271 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.092793+0000", 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000436735 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:54.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120346+0000", 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027552719999999999 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120941+0000", 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00059482000000000003 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.121004+0000", 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3764999999999997e-05 2024-09-11T05:21:54.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.121060+0000", 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5081000000000003e-05 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16802 3.c 3:30e10a1e:::rbd_data.1179c3639760.000000000000001c:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.449498+0000", 2024-09-11T05:21:54.996 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.43787930600000002, 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027294155, 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16802 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449498+0000", 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449498+0000", 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449499+0000", 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1480000000000001e-06 2024-09-11T05:21:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449504+0000", 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000001e-06 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449515+0000", 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0967e-05 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449522+0000", 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449569+0000", 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7487999999999997e-05 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.449618+0000", 2024-09-11T05:21:55.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8560000000000003e-05 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 3", 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.454018+0000", 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043999369999999996 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.476644+0000", 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022625718999999999 2024-09-11T05:21:55.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.476715+0000", 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1789e-05 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.476756+0000", 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0929000000000001e-05 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:55.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.476792+0000", 2024-09-11T05:21:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5550999999999999e-05 2024-09-11T05:21:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:55.003 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:55.003 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:55.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:21:55.005 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:55.004+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:55.006 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:21:55.105 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:55.104+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:55.111 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:55.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:55.111 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:21:55.112 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:55.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:21:55.133 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:55.150 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:55.150 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:55.166 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:55.166 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:55.182 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:55.199 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:55.200 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:55.205 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:55.206+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:55.217 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:55.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:55.234 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:55.250 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:55.251 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:55.264 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:55.265 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:55.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:21:55.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:55.307+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:55.377 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:55.377 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:55.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:21:55.408 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:55.408+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:55.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:21:55.492 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:55.492 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:55.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:21:55.545 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:55.545+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:55.607 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:55.607 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:55.610 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:55.610+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:55.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:21:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-11T05:21:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:741 write 0x71a1946 thru 0x71a1fa3 (0x65e bytes) 2024-09-11T05:21:55.676 INFO:teuthology.orchestra.run.smithi012.stdout:742 read 0x52cef04 thru 0x52db11e (0xc21b bytes) 2024-09-11T05:21:55.686 INFO:teuthology.orchestra.run.smithi012.stdout:745 trunc from 0xdd5353e to 0x4eb9bec 2024-09-11T05:21:55.710 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:55.710+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:55.711 INFO:teuthology.orchestra.run.smithi012.stdout:747 write 0x29753bf thru 0x297e806 (0x9448 bytes) 2024-09-11T05:21:55.760 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:55.760 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:55.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:21:55.811 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:55.811+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:55.912 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:55.912+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:55.920 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:55.920 INFO:teuthology.orchestra.run.smithi012.stdout:751 write 0xdaf2 thru 0x1b131 (0xd640 bytes) 2024-09-11T05:21:55.930 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:55.930 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:55.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:21:56.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:56.013+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:56.088 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:56.088 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:56.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:21:56.142 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:56.142+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:56.181 INFO:teuthology.orchestra.run.smithi012.stdout:754 read 0x3124a2e thru 0x31341e1 (0xf7b4 bytes) 2024-09-11T05:21:56.189 INFO:teuthology.orchestra.run.smithi012.stdout:755 punch from 0xf09b3 to 0xf6a16, (0x6063 bytes) 2024-09-11T05:21:56.189 INFO:teuthology.orchestra.run.smithi012.stdout:756 punch from 0xef2224 to 0xef79af, (0x578b bytes) 2024-09-11T05:21:56.189 INFO:teuthology.orchestra.run.smithi012.stdout:757 punch from 0x2c09dc5 to 0x2c09f23, (0x15e bytes) 2024-09-11T05:21:56.189 INFO:teuthology.orchestra.run.smithi012.stdout:758 read 0x535a8b thru 0x53f3dd (0x9953 bytes) 2024-09-11T05:21:56.195 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:56.195 INFO:teuthology.orchestra.run.smithi012.stdout:760 punch from 0x226b06e to 0x226d1f8, (0x218a bytes) 2024-09-11T05:21:56.209 INFO:teuthology.orchestra.run.smithi012.stdout:762 write 0xcb949f1 thru 0xcb98487 (0x3a97 bytes) 2024-09-11T05:21:56.215 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:56.214+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:56.227 INFO:teuthology.orchestra.run.smithi012.stdout:763 writesame 0x8ffe19a thru 0x9009a10 data_size 0x63(0xb877 bytes) 2024-09-11T05:21:56.251 INFO:teuthology.orchestra.run.smithi012.stdout:765 writesame 0xc9c6f1b thru 0xc9ccb0e data_size 0x16(0x5bf4 bytes) 2024-09-11T05:21:56.254 INFO:teuthology.orchestra.run.smithi012.stdout:766 write 0x556c66f thru 0x5571680 (0x5012 bytes) 2024-09-11T05:21:56.268 INFO:teuthology.orchestra.run.smithi012.stdout:767 punch from 0xbcfe070 to 0xbd0c326, (0xe2b6 bytes) 2024-09-11T05:21:56.268 INFO:teuthology.orchestra.run.smithi012.stdout:768 read 0xae63cd2 thru 0xae725d3 (0xe902 bytes) 2024-09-11T05:21:56.274 INFO:teuthology.orchestra.run.smithi012.stdout:769 write 0xd5cd938 thru 0xd5cf0e6 (0x17af bytes) 2024-09-11T05:21:56.277 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:56.277 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:770 writesame 0x2b7b9a9 thru 0x2b88328 data_size 0x80(0xc980 bytes) 2024-09-11T05:21:56.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:21:56.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:56.330+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:56.417 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:56.417+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:56.449 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:21:56.464 INFO:teuthology.orchestra.run.smithi012.stdout:772 punch from 0x8d73d6b to 0x8d7d5bd, (0x9852 bytes) 2024-09-11T05:21:56.464 INFO:teuthology.orchestra.run.smithi012.stdout:774 writesame 0x9ca80ad thru 0x9cb044c data_size 0x51(0x83a0 bytes) 2024-09-11T05:21:56.480 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:56.482 INFO:teuthology.orchestra.run.smithi012.stdout:778 trunc from 0xd5cf0e7 to 0xb5ec3d8 2024-09-11T05:21:56.484 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:56.484 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:56.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:21:56.507 INFO:teuthology.orchestra.run.smithi012.stdout:779 write 0xc902d9d thru 0xc903237 (0x49b bytes) 2024-09-11T05:21:56.511 INFO:teuthology.orchestra.run.smithi012.stdout:780 write 0x4e67f2c thru 0x4e72168 (0xa23d bytes) 2024-09-11T05:21:56.514 INFO:teuthology.orchestra.run.smithi012.stdout:781 read 0x3f3138 thru 0x3f892b (0x57f4 bytes) 2024-09-11T05:21:56.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:56.518+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:56.519 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:56.519 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:56.519 INFO:teuthology.orchestra.run.smithi012.stdout:787 punch from 0x86f3312 to 0x86ff423, (0xc111 bytes) 2024-09-11T05:21:56.520 INFO:teuthology.orchestra.run.smithi012.stdout:788 read 0x5bdd7ae thru 0x5be2ed4 (0x5727 bytes) 2024-09-11T05:21:56.520 INFO:teuthology.orchestra.run.smithi012.stdout:789 read 0x99b4e05 thru 0x99c273f (0xd93b bytes) 2024-09-11T05:21:56.529 INFO:teuthology.orchestra.run.smithi012.stdout:790 trunc from 0xc903238 to 0x4168250 2024-09-11T05:21:56.619 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:56.619+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:56.680 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:56.680 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:56.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:21:56.734 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:56.734+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:56.774 INFO:teuthology.orchestra.run.smithi012.stdout:791 punch from 0x219e200 to 0x21a47d2, (0x65d2 bytes) 2024-09-11T05:21:56.774 INFO:teuthology.orchestra.run.smithi012.stdout:793 read 0x35a8eaa thru 0x35a9fbc (0x1113 bytes) 2024-09-11T05:21:56.774 INFO:teuthology.orchestra.run.smithi012.stdout:794 write 0x1bfe294 thru 0x1bff1fb (0xf68 bytes) 2024-09-11T05:21:56.822 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:56.821+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:56.871 INFO:teuthology.orchestra.run.smithi012.stdout:795 write 0x3bf14c2 thru 0x3bf781c (0x635b bytes) 2024-09-11T05:21:56.885 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:56.885 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:56.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:21:56.922 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:56.922+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:57.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:57.023+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:57.104 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:57.104 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:57.105 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:57.105 INFO:teuthology.orchestra.run.smithi012.stdout:797 read 0x3bca3a5 thru 0x3bd0714 (0x6370 bytes) 2024-09-11T05:21:57.105 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:57.116 INFO:teuthology.orchestra.run.smithi012.stdout:799 write 0x8892a27 thru 0x8898d0a (0x62e4 bytes) 2024-09-11T05:21:57.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:21:57.123 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:57.123+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:57.132 INFO:teuthology.orchestra.run.smithi012.stdout:801 read 0x7581abb thru 0x7586c0d (0x5153 bytes) 2024-09-11T05:21:57.141 INFO:teuthology.orchestra.run.smithi012.stdout:804 write 0xa6b46a6 thru 0xa6b5f5b (0x18b6 bytes) 2024-09-11T05:21:57.153 INFO:teuthology.orchestra.run.smithi012.stdout:805 writesame 0x930a949 thru 0x93125f7 data_size 0x1(0x7caf bytes) 2024-09-11T05:21:57.169 INFO:teuthology.orchestra.run.smithi012.stdout:806 read 0x1bd2fd5 thru 0x1bdb079 (0x80a5 bytes) 2024-09-11T05:21:57.171 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:57.181 INFO:teuthology.orchestra.run.smithi012.stdout:808 writesame 0xd797d47 thru 0xd79cb98 data_size 0x19(0x4e52 bytes) 2024-09-11T05:21:57.181 INFO:teuthology.orchestra.run.smithi012.stdout:810 read 0x4b0558c thru 0x4b0c56e (0x6fe3 bytes) 2024-09-11T05:21:57.195 INFO:teuthology.orchestra.run.smithi012.stdout:812 trunc from 0xd79cb99 to 0x18b44db 2024-09-11T05:21:57.224 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:57.224+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:57.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:21:57.288 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:21:57.288 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:21:57.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:21:57.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:57.343+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:57.426 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:57.425+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:57.442 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:57.442 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:57.455 INFO:teuthology.orchestra.run.smithi012.stdout:813 writesame 0x8924992 thru 0x8929c0d data_size 0x2(0x527c bytes) 2024-09-11T05:21:57.455 INFO:teuthology.orchestra.run.smithi012.stdout:814 writesame 0x2bd6cf0 thru 0x2be53fa data_size 0x13(0xe70b bytes) 2024-09-11T05:21:57.469 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:57.469 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:57.474 INFO:teuthology.orchestra.run.smithi012.stdout:815 read 0x5d2dbe8 thru 0x5d3d2bc (0xf6d5 bytes) 2024-09-11T05:21:57.474 INFO:teuthology.orchestra.run.smithi012.stdout:816 read 0x723380c thru 0x7235477 (0x1c6c bytes) 2024-09-11T05:21:57.474 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:57.474 INFO:teuthology.orchestra.run.smithi012.stdout:819 write 0x6cb7e1b thru 0x6cbb392 (0x3578 bytes) 2024-09-11T05:21:57.489 INFO:teuthology.orchestra.run.smithi012.stdout:820 write 0x87e532a thru 0x87e9f65 (0x4c3c bytes) 2024-09-11T05:21:57.501 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:57.501 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:57.505 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:57.505 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:57.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:57.505 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:57.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.505 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4253.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-11T05:21:57.505 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 24.728970225000001, 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0041632789999999998, 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774977+0000", 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774978+0000", 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8799999999999999e-07 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774986+0000", 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3669999999999997e-06 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.774997+0000", 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1274000000000001e-05 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775005+0000", 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6660000000000008e-06 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775080+0000", 2024-09-11T05:21:57.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4821999999999996e-05 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.775102+0000", 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1894000000000001e-05 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779079+0000", 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039771809999999998 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:32.779141+0000", 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1886999999999999e-05 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2163 3.0 e27/22 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head v 27'27, mlcod=27'25)", 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2642290620000001, 2024-09-11T05:21:57.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001546069, 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239719+0000", 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7300000000000005e-07 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239739+0000", 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9219999999999999e-05 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239750+0000", 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1138000000000001e-05 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239757+0000", 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5850000000000002e-06 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239814+0000", 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6653000000000001e-05 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.239837+0000", 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3003e-05 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.241220+0000", 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0013825630000000001 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.241265+0000", 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5133999999999999e-05 2024-09-11T05:21:57.514 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2575 3.0 e27/22 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:head v 27'28, mlcod=27'26)", 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.0783488870000006, 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001441594, 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425599+0000", 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425600+0000", 2024-09-11T05:21:57.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2160000000000001e-06 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425626+0000", 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6004e-05 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425646+0000", 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9935000000000001e-05 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425655+0000", 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2799999999999992e-06 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425716+0000", 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0395e-05 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.425733+0000", 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7730000000000001e-05 2024-09-11T05:21:57.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.427006+0000", 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001272961 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.427040+0000", 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4072999999999997e-05 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2597 3.4 e27/22 3:2359855f:::rbd_data.1179262aa3d7.0000000000000076:head v 27'36, mlcod=27'34)", 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.0485807390000002, 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0026880620000000002, 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:57.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455367+0000", 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455368+0000", 2024-09-11T05:21:57.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2410000000000001e-06 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455381+0000", 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3112000000000001e-05 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455404+0000", 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2263e-05 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455414+0000", 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0259e-05 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455483+0000", 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-05 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.455506+0000", 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.317e-05 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458008+0000", 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025021209999999999 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.458055+0000", 2024-09-11T05:21:57.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6795999999999997e-05 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2624 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'38, mlcod=27'36)", 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.0125134639999995, 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030956740000000001, 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491434+0000", 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491435+0000", 2024-09-11T05:21:57.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2300000000000001e-06 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491449+0000", 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3586e-05 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491470+0000", 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0647999999999999e-05 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491486+0000", 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6767000000000001e-05 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491558+0000", 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1538999999999994e-05 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.491574+0000", 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5931999999999999e-05 2024-09-11T05:21:57.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494482+0000", 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029085309999999998 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.494530+0000", 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7441000000000002e-05 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2654 3.4 e27/22 3:2491c6b7:::rbd_data.1179262aa3d7.0000000000000031:head v 27'39, mlcod=27'37)", 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.9748261229999997, 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030637849999999999, 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529122+0000", 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529123+0000", 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.327e-06 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529132+0000", 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2189999999999993e-06 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529153+0000", 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1152e-05 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529167+0000", 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3817e-05 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529249+0000", 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2127999999999997e-05 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.529272+0000", 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3150999999999999e-05 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532138+0000", 2024-09-11T05:21:57.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0028653530000000002 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.532185+0000", 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7638e-05 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2725 3.0 e27/22 3:006e61e3:::rbd_data.1179262aa3d7.0000000000000050:head v 27'29, mlcod=27'27)", 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.899736914, 2024-09-11T05:21:57.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012950559999999999, 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604211+0000", 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604212+0000", 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3710000000000001e-06 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604244+0000", 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1488000000000001e-05 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604264+0000", 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0477999999999999e-05 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604276+0000", 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.219e-05 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604348+0000", 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2158999999999998e-05 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.604373+0000", 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4664e-05 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.605449+0000", 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010756310000000001 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:48.605506+0000", 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7074999999999998e-05 2024-09-11T05:21:57.538 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:2985 3.0 e28/22 3:014574f2:::rbd_header.1179fd824b6b:head v 28'32, mlcod=27'30)", 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.468434+0000", 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.035513345, 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033032560000000001, 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468434+0000", 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468434+0000", 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468435+0000", 2024-09-11T05:21:57.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3499999999999996e-07 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468440+0000", 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7559999999999999e-06 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468449+0000", 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1349999999999998e-06 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468455+0000", 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1650000000000003e-06 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468517+0000", 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1995999999999994e-05 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.468540+0000", 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2699000000000001e-05 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.471688+0000", 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003148386 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.471738+0000", 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9583999999999998e-05 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:3000 3.0 e28/22 3:014574f2:::rbd_header.1179fd824b6b:head v 28'34, mlcod=28'32)", 2024-09-11T05:21:57.543 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.481881+0000", 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.0220666529999995, 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0022520399999999999, 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481881+0000", 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481881+0000", 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481882+0000", 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481886+0000", 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9300000000000002e-06 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481895+0000", 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9069999999999996e-06 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481900+0000", 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481946+0000", 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6384000000000002e-05 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.481969+0000", 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2299000000000001e-05 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.484102+0000", 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0021336850000000002 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.484133+0000", 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0534999999999998e-05 2024-09-11T05:21:57.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:3106 3.0 e28/22 3:061be309:::rbd_data.1179fd824b6b.0000000000000199:head v 28'38, mlcod=28'36)", 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.672434+0000", 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.8315138969999998, 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001274332, 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672434+0000", 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672434+0000", 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672435+0000", 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6589999999999999e-06 2024-09-11T05:21:57.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672467+0000", 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1260999999999998e-05 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672494+0000", 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7552e-05 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672504+0000", 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0045e-05 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672606+0000", 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000101399 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.672631+0000", 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5181000000000002e-05 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.673663+0000", 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010321849999999999 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.673708+0000", 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5049999999999997e-05 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:10809 3.4 e32/22 3:21755018:::rbd_data.117977dc529b.0000000000000005:head v 32'70, mlcod=30'68)", 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.547852+0000", 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9560958729999998, 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012974830000000001, 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547852+0000", 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547852+0000", 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547853+0000", 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.19e-06 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547864+0000", 2024-09-11T05:21:57.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1151999999999999e-05 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547886+0000", 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1438999999999999e-05 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547894+0000", 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8429999999999999e-06 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547954+0000", 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9673999999999998e-05 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.547974+0000", 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9471e-05 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.549094+0000", 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011207050000000001 2024-09-11T05:21:57.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.549149+0000", 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5009000000000001e-05 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 32/22 rep_tid 221 entries 32'50 (0'0) error 3:94f264b1:::rbd_data.117977dc529b.0000000000000015:head by client.4473.0:10991 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 31'48)", 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.561522+0000", 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9424256829999997, 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0018297599999999999, 2024-09-11T05:21:57.557 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561522+0000", 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561522+0000", 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561522+0000", 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5800000000000001e-07 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561528+0000", 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1199999999999999e-06 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561553+0000", 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5242e-05 2024-09-11T05:21:57.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561571+0000", 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7549000000000001e-05 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.561666+0000", 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5266999999999994e-05 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563352+0000", 2024-09-11T05:21:57.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001685424 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.4 epoch 32/22 rep_tid 171 entries 32'71 (0'0) error 3:22b657e2:::rbd_data.117977dc529b.0000000000000019:head by client.4473.0:11012 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 32'69)", 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.562654+0000", 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9412933510000001, 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034957880000000001, 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562654+0000", 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562654+0000", 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562655+0000", 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4900000000000005e-07 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562665+0000", 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5650000000000007e-06 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562690+0000", 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5215000000000002e-05 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562707+0000", 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7418000000000002e-05 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.562803+0000", 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5391999999999997e-05 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.566150+0000", 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033473489999999999 2024-09-11T05:21:57.564 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 32/22 rep_tid 222 entries 32'51 (0'0) error 3:943702aa:::rbd_data.117977dc529b.000000000000001a:head by client.4473.0:11017 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 31'48)", 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.563031+0000", 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9409162800000002, 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031232930000000001, 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563031+0000", 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563031+0000", 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563032+0000", 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2500000000000005e-07 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563038+0000", 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2530000000000001e-06 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563051+0000", 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3249e-05 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563062+0000", 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.101e-05 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.563144+0000", 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1641e-05 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.566155+0000", 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030105150000000001 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.568 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:11038 3.9 e32/22 3:94f264b1:::rbd_data.117977dc529b.0000000000000015:head v 32'52, mlcod=31'49)", 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.565536+0000", 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.938411592, 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033405940000000001, 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565536+0000", 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565536+0000", 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565537+0000", 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.004e-06 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565545+0000", 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8390000000000007e-06 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565561+0000", 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5798999999999999e-05 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565569+0000", 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1110000000000008e-06 2024-09-11T05:21:57.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565622+0000", 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3258999999999999e-05 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.565640+0000", 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.785e-05 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.568829+0000", 2024-09-11T05:21:57.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031890659999999999 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.568877+0000", 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7666000000000001e-05 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:11121 3.9 e32/22 3:943702aa:::rbd_data.117977dc529b.000000000000001a:head v 32'53, mlcod=32'51)", 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.570775+0000", 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9331729319999997, 2024-09-11T05:21:57.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033757240000000001, 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570775+0000", 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570775+0000", 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570776+0000", 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1400000000000001e-06 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570796+0000", 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9772999999999999e-05 2024-09-11T05:21:57.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570816+0000", 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9935000000000001e-05 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570824+0000", 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8259999999999999e-06 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570913+0000", 2024-09-11T05:21:57.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8388999999999997e-05 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570947+0000", 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4600000000000001e-05 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.574084+0000", 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003136518 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.574150+0000", 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6543000000000003e-05 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:11151 3.4 e32/22 3:22b657e2:::rbd_data.117977dc529b.0000000000000019:head v 32'72, mlcod=32'70)", 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.570959+0000", 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9329889790000001, 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0037676239999999998, 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.578 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570959+0000", 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570959+0000", 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570959+0000", 2024-09-11T05:21:57.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-07 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570967+0000", 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0790000000000003e-06 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570981+0000", 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4287000000000001e-05 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.570991+0000", 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0003000000000001e-05 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.571046+0000", 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5149999999999999e-05 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.571068+0000", 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2104999999999999e-05 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.574678+0000", 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0036097820000000002 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.574726+0000", 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8423e-05 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:11681 3.4 e32/22 3:23ce943e:::rbd_data.117977dc529b.000000000000002f:head v 32'74, mlcod=32'72)", 2024-09-11T05:21:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.599467+0000", 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9044802870000002, 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001692792, 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599467+0000", 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599467+0000", 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599468+0000", 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.141e-06 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599482+0000", 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3884e-05 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599502+0000", 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0129999999999999e-05 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599514+0000", 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1161e-05 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599578+0000", 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4240999999999997e-05 2024-09-11T05:21:57.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.599598+0000", 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.984e-05 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.601113+0000", 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001515157 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.601160+0000", 2024-09-11T05:21:57.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7237999999999997e-05 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:11707 3.9 e32/22 3:94433776:::rbd_data.117977dc529b.000000000000005f:head v 32'55, mlcod=32'52)", 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.610941+0000", 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.8930068019999999, 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002234532, 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.610941+0000", 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.610941+0000", 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.610942+0000", 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.189e-06 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.610953+0000", 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1117999999999999e-05 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.610974+0000", 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1245000000000001e-05 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.610984+0000", 2024-09-11T05:21:57.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0093e-05 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611046+0000", 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2001999999999994e-05 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611070+0000", 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3213999999999998e-05 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.613128+0000", 2024-09-11T05:21:57.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0020584129999999998 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.613175+0000", 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7258000000000001e-05 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:11710 3.9 e32/22 3:94106178:::rbd_data.117977dc529b.00000000000000de:head v 32'57, mlcod=32'52)", 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.611859+0000", 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.8920886489999997, 2024-09-11T05:21:57.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001705345, 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611859+0000", 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611859+0000", 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611860+0000", 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611869+0000", 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5670000000000001e-06 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611882+0000", 2024-09-11T05:21:57.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2447e-05 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611890+0000", 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1429999999999998e-06 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611947+0000", 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6988999999999999e-05 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.611969+0000", 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1800000000000001e-05 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.613524+0000", 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0015556470000000001 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.613564+0000", 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0089999999999997e-05 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.595 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.596 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:57.597 INFO:teuthology.orchestra.run.smithi012.stdout:821 read 0x5268384 thru 0x52722e5 (0x9f62 bytes) 2024-09-11T05:21:57.597 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:21:57.597 INFO:teuthology.orchestra.run.smithi012.stdout:826 read 0x6645880 thru 0x66491c6 (0x3947 bytes) 2024-09-11T05:21:57.597 INFO:teuthology.orchestra.run.smithi012.stdout:827 read 0x721ae8e thru 0x7228665 (0xd7d8 bytes) 2024-09-11T05:21:57.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:21:57.598 INFO:teuthology.orchestra.run.smithi012.stdout:828 write 0xb360af3 thru 0xb36dac5 (0xcfd3 bytes) 2024-09-11T05:21:57.599 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:57.599 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:21:57.599 INFO:teuthology.orchestra.run.smithi012.stdout:829 clone 8 order 21 su 524288 sc 3 2024-09-11T05:21:57.600 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:21:57.600 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:21:57.600 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:21:57.600 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:21:57.601 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:21:57.601 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:21:57.601 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:21:57.602 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:21:57.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:57.597+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:57.697 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:57.697+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:57.749 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:57.750 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:57.750 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:21:57.750 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:57.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:21:57.799 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:57.798+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:57.865 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:57.865 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:21:57.865 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:21:57.865 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:21:57.866 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:57.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:21:57.917 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:57.917+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:57.982 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3098 3.1e 3:79cfec26:::rbd_data.1179fd824b6b.000000000000018c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.3296589759999993, 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013181033, 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3098 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651657+0000", 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651659+0000", 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0990000000000001e-06 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651667+0000", 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0029999999999994e-06 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651687+0000", 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9669000000000001e-05 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651699+0000", 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651753+0000", 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3752999999999998e-05 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.651853+0000", 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100216 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653599+0000", 2024-09-11T05:21:57.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017458230000000001 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664569+0000", 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010970570000000001 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664624+0000", 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037999999999997e-05 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664711+0000", 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6629e-05 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.664838+0000", 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012700100000000001 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.989 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:3099 3.18 3:197c5bdc:::rbd_data.1179fd824b6b.000000000000018d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.3279067760000007, 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012482269000000001, 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 3099 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653409+0000", 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653410+0000", 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0300000000000001e-06 2024-09-11T05:21:57.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653417+0000", 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3770000000000001e-06 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653431+0000", 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.385e-05 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653438+0000", 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8820000000000001e-06 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653503+0000", 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4694000000000001e-05 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.653612+0000", 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109036 2024-09-11T05:21:57.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.656159+0000", 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002546436 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665824+0000", 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0096652730000000003 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:57.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665834+0000", 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9389999999999992e-06 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665863+0000", 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9526000000000002e-05 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:49.665892+0000", 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8226e-05 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:57.995 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14784 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.1663700380000002, 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011485377, 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14784 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.996 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814946+0000", 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814948+0000", 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9130000000000001e-06 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814954+0000", 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:21:57.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814959+0000", 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826424+0000", 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011464396999999999 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:57.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.826431+0000", 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8849999999999999e-06 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:14850 3.8 3.246d8b68 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.1658051470000004, 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011534898999999999, 2024-09-11T05:21:58.000 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 14850 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:58.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815511+0000", 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815514+0000", 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.21e-06 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815520+0000", 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3450000000000002e-06 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.815525+0000", 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0969999999999996e-06 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.827038+0000", 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011512638 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.827046+0000", 2024-09-11T05:21:58.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1450000000000008e-06 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15863 3.18 3:1b8beade:::rbd_data.117977dc529b.000000000000001f:8 [read 491520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.038231+0000", 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9430850299999998, 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01403366, 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15863 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038231+0000", 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038231+0000", 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038232+0000", 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4000000000000002e-07 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038234+0000", 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0590000000000001e-06 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038244+0000", 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0084e-05 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038249+0000", 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4620000000000004e-06 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052074+0000", 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013825306000000001 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052161+0000", 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6798999999999993e-05 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052265+0000", 2024-09-11T05:21:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010341 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15902 3.8 3:163d4420:::rbd_data.117977dc529b.0000000000000032:8 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.038679+0000", 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9426370309999998, 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013761611, 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.010 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15902 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038679+0000", 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038679+0000", 2024-09-11T05:21:58.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038679+0000", 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038682+0000", 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.266e-06 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038688+0000", 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.703e-06 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038693+0000", 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7550000000000002e-06 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052292+0000", 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013599083 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052374+0000", 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1588000000000006e-05 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052441+0000", 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6814000000000001e-05 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.014 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15904 3.8 3:163d4420:::rbd_data.117977dc529b.0000000000000032:8 [read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.038934+0000", 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9423824070000002, 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013679635000000001, 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15904 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038934+0000", 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038934+0000", 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038934+0000", 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3399999999999999e-07 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038938+0000", 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8469999999999998e-06 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038946+0000", 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8930000000000005e-06 2024-09-11T05:21:58.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038953+0000", 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.472e-06 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052466+0000", 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013513702000000001 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052547+0000", 2024-09-11T05:21:58.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0348999999999999e-05 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052613+0000", 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6737999999999997e-05 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15905 3.8 3:163d4420:::rbd_data.117977dc529b.0000000000000032:8 [read 327680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.038963+0000", 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.942353072, 2024-09-11T05:21:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013812454, 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15905 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038963+0000", 2024-09-11T05:21:58.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038963+0000", 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038964+0000", 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3799999999999997e-07 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038966+0000", 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8370000000000001e-06 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038975+0000", 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2640000000000008e-06 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.038980+0000", 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3650000000000003e-06 2024-09-11T05:21:58.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052637+0000", 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013657142000000001 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052709+0000", 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2121999999999998e-05 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.052775+0000", 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6186000000000006e-05 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15997 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 212992~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.040418+0000", 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.940898206, 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012954489, 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15997 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040418+0000", 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040418+0000", 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040418+0000", 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040420+0000", 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0999999999999998e-06 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040426+0000", 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040431+0000", 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9309999999999999e-06 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053046+0000", 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01261439 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053189+0000", 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014282100000000001 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053372+0000", 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00018371899999999999 2024-09-11T05:21:58.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15998 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.040439+0000", 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.940876598, 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013094977000000001, 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.029 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15998 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040439+0000", 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040439+0000", 2024-09-11T05:21:58.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040440+0000", 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040442+0000", 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0779999999999998e-06 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040448+0000", 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9349999999999999e-06 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040453+0000", 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.69e-06 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053397+0000", 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012944661999999999 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053467+0000", 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9777000000000006e-05 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053534+0000", 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7432000000000001e-05 2024-09-11T05:21:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15999 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3194880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.040459+0000", 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9408567539999999, 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013229805000000001, 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.034 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.035 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.035 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15999 2024-09-11T05:21:58.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.035 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040459+0000", 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040459+0000", 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040460+0000", 2024-09-11T05:21:58.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040462+0000", 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0329999999999998e-06 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040467+0000", 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7440000000000004e-06 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.040472+0000", 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053558+0000", 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01308571 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053622+0000", 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4499999999999996e-05 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053689+0000", 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6773000000000006e-05 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16000 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041966+0000", 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9393496190000001, 2024-09-11T05:21:58.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011875619, 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16000 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041966+0000", 2024-09-11T05:21:58.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041966+0000", 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041967+0000", 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6199999999999997e-07 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041990+0000", 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3149000000000001e-05 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042002+0000", 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2115e-05 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042013+0000", 2024-09-11T05:21:58.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0159e-05 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053713+0000", 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011700769999999999 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053778+0000", 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4783000000000006e-05 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053842+0000", 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3880999999999994e-05 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16005 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.042027+0000", 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9392892069999998, 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011994124, 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16005 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042027+0000", 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042027+0000", 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042027+0000", 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2399999999999998e-07 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042031+0000", 2024-09-11T05:21:58.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0359999999999998e-06 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042038+0000", 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9310000000000008e-06 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042044+0000", 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9560000000000002e-06 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053865+0000", 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011820219 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.053933+0000", 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8107000000000004e-05 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054021+0000", 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8251000000000006e-05 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.048 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16006 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.042053+0000", 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9392631380000003, 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012134420999999999, 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16006 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042053+0000", 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042053+0000", 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042053+0000", 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4799999999999999e-07 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042056+0000", 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7829999999999999e-06 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042063+0000", 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-06 2024-09-11T05:21:58.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042068+0000", 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3630000000000002e-06 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054045+0000", 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011976828 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054110+0000", 2024-09-11T05:21:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4700000000000001e-05 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054187+0000", 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7389000000000001e-05 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16008 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3981312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.042076+0000", 2024-09-11T05:21:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9392405689999999, 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012880605, 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16008 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042076+0000", 2024-09-11T05:21:58.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042076+0000", 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042076+0000", 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042078+0000", 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5100000000000001e-06 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042085+0000", 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0090000000000001e-06 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042091+0000", 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6999999999999996e-06 2024-09-11T05:21:58.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054212+0000", 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012121059 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054836+0000", 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000623856 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054956+0000", 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000120059 2024-09-11T05:21:58.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16029 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:3 [read 3211264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.042098+0000", 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.9392178539999998, 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013090121, 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:21:58.058 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16029 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042098+0000", 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042098+0000", 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042099+0000", 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042101+0000", 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1509999999999998e-06 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042108+0000", 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7680000000000003e-06 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.042113+0000", 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.536e-06 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.054986+0000", 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012872699 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.055101+0000", 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011531099999999999 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.055188+0000", 2024-09-11T05:21:58.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7237000000000005e-05 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16595 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6961836] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.084176+0000", 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.8971398710000003, 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.023327885999999999, 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.063 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16595 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.084176+0000", 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.084176+0000", 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.084178+0000", 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7889999999999999e-06 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.087544+0000", 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00336586 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.087580+0000", 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6535999999999997e-05 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.087599+0000", 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8165999999999999e-05 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.087662+0000", 2024-09-11T05:21:58.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3850999999999996e-05 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.087779+0000", 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116105 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.088190+0000", 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041136100000000001 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.107360+0000", 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.019169717999999999 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.107403+0000", 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3007999999999999e-05 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.107446+0000", 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3673e-05 2024-09-11T05:21:58.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.107504+0000", 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16684 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.261191+0000", 2024-09-11T05:21:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7201250209999999, 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.015412675000000001, 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16684 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261191+0000", 2024-09-11T05:21:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261191+0000", 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261193+0000", 2024-09-11T05:21:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5409999999999999e-06 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261200+0000", 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0790000000000003e-06 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261216+0000", 2024-09-11T05:21:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6432000000000001e-05 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261223+0000", 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1799999999999999e-06 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261289+0000", 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6066000000000001e-05 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.261344+0000", 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4614000000000003e-05 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.263917+0000", 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002573376 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.276527+0000", 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012609634 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.276537+0000", 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0066e-05 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.276572+0000", 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4468000000000003e-05 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.276604+0000", 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2218999999999998e-05 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16760 3.1e 3:794cf04e:::rbd_data.1179c3639760.000000000000000c:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.378077+0000", 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.6032393969999998, 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.015544937999999999, 2024-09-11T05:21:58.076 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16760 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378077+0000", 2024-09-11T05:21:58.077 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378077+0000", 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378078+0000", 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5349999999999999e-06 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.078 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378084+0000", 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6760000000000004e-06 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378097+0000", 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3385e-05 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378105+0000", 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5669999999999997e-06 2024-09-11T05:21:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378151+0000", 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5902999999999997e-05 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.378235+0000", 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4698999999999997e-05 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.380581+0000", 2024-09-11T05:21:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0023450680000000001 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.393545+0000", 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012964343999999999 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.393556+0000", 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1452e-05 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.393588+0000", 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1473000000000002e-05 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.393622+0000", 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3835999999999999e-05 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:16796 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.426362+0000", 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.5549542089999999, 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013324116, 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 16796 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:21:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426362+0000", 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426362+0000", 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426364+0000", 2024-09-11T05:21:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.652e-06 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426370+0000", 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9469999999999997e-06 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426387+0000", 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6350000000000001e-05 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426394+0000", 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0129999999999996e-06 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426446+0000", 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2577999999999997e-05 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.426510+0000", 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3810000000000001e-05 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.428891+0000", 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0023804759999999999 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.439567+0000", 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010676379999999999 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.439611+0000", 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4066999999999997e-05 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.439651+0000", 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0321000000000002e-05 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.439686+0000", 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4521999999999999e-05 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:21:58.088 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:21:58.090 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:21:58.090 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:21:58.090+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:21:58.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:58.191+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:58.205 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:58.205 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:58.205 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:21:58.205 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:58.214 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:21:58.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:21:58.292+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:21:58.318 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:58.318 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:58.318 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:21:58.318 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:21:58.318 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:58.326 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:21:58.393 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:58.392+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:58.433 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:58.433 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:21:58.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:21:58.433 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:13 3.e e25/22 3:7343f3fe:::rbd_object_map.1179d519140e:head v 25'1, mlcod=0'0)", 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.010329386, 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057493450000000003, 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:58.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421836+0000", 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6600000000000003e-07 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421840+0000", 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.002e-06 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421850+0000", 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.028e-05 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421861+0000", 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0513000000000001e-05 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421924+0000", 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3546000000000004e-05 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.421942+0000", 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7589e-05 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.427542+0000", 2024-09-11T05:21:58.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056002400000000003 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:44.427585+0000", 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2908999999999999e-05 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2523 3.14 3:2b103c72:::rbd_data.1179262aa3d7.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.072594044000001, 2024-09-11T05:21:58.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013316906999999999, 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2523 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359571+0000", 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.359573+0000", 2024-09-11T05:21:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6840000000000001e-06 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361466+0000", 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001893287 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361482+0000", 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5519000000000002e-05 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361495+0000", 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3370000000000001e-05 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361560+0000", 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4745000000000004e-05 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.361729+0000", 2024-09-11T05:21:58.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016939400000000001 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.364709+0000", 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029801099999999998 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372342+0000", 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0076326930000000003 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372776+0000", 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000433609 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372834+0000", 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8417e-05 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.372888+0000", 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079000000000002e-05 2024-09-11T05:21:58.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2525 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.068653227, 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019154353999999998, 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2525 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363512+0000", 2024-09-11T05:21:58.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.363513+0000", 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9800000000000002e-07 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365409+0000", 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001896191 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365427+0000", 2024-09-11T05:21:58.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7388e-05 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365435+0000", 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6090000000000001e-06 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365491+0000", 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6289000000000003e-05 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.365647+0000", 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015579999999999999 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371139+0000", 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054914359999999997 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.380804+0000", 2024-09-11T05:21:58.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096655219999999993 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382549+0000", 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017446199999999999 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382614+0000", 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4807000000000005e-05 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.382666+0000", 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2694000000000001e-05 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2527 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.062973963999999, 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014529937, 2024-09-11T05:21:58.451 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2527 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369191+0000", 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.369192+0000", 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371078+0000", 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001885861 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371090+0000", 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1979e-05 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371097+0000", 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.002e-06 2024-09-11T05:21:58.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371161+0000", 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3348000000000004e-05 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.371329+0000", 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016788799999999999 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.375139+0000", 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003810173 2024-09-11T05:21:58.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383559+0000", 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084199949999999996 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383654+0000", 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5092000000000004e-05 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383686+0000", 2024-09-11T05:21:58.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1965999999999999e-05 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.383721+0000", 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5392999999999998e-05 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2590 3.1a 3:5b4ca92b:::rbd_data.1179262aa3d7.000000000000005c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:58.457 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.9776911340000005, 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051783389999999997, 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2590 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454474+0000", 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454475+0000", 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.28e-06 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454489+0000", 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801000000000001e-05 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454500+0000", 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.066e-05 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454507+0000", 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3799999999999996e-06 2024-09-11T05:21:58.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454565+0000", 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7917999999999997e-05 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454649+0000", 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3963999999999998e-05 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:58.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.454751+0000", 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102326 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.458547+0000", 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037954780000000001 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459574+0000", 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010266780000000001 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459622+0000", 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8380000000000001e-05 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.459652+0000", 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0474e-05 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2655 3.1a 3:5b95b2d1:::rbd_data.1179262aa3d7.0000000000000056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.9037110750000004, 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067417809999999996, 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2655 2024-09-11T05:21:58.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528454+0000", 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528455+0000", 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528459+0000", 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528470+0000", 2024-09-11T05:21:58.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0210000000000001e-05 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528477+0000", 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2099999999999996e-06 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528530+0000", 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2809000000000002e-05 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528615+0000", 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5845000000000002e-05 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.528735+0000", 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011913699999999999 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.529264+0000", 2024-09-11T05:21:58.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052902400000000001 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535140+0000", 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058759420000000003 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535171+0000", 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1377999999999997e-05 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.535196+0000", 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4939999999999998e-05 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3107 3.1a 3:5b3318f8:::rbd_data.1179fd824b6b.000000000000019a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7624702299999999, 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0083332600000000003, 2024-09-11T05:21:58.470 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3107 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:58.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669695+0000", 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669696+0000", 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5269999999999999e-06 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669703+0000", 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7190000000000004e-06 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669715+0000", 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2184000000000001e-05 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669721+0000", 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999996e-06 2024-09-11T05:21:58.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669768+0000", 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6665999999999997e-05 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.669863+0000", 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4823999999999999e-05 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.671208+0000", 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013450059999999999 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677941+0000", 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067329379999999999 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677951+0000", 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0732e-05 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.677983+0000", 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1582999999999999e-05 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.678028+0000", 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5290999999999997e-05 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.476 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:11549 3.14 3:29aa68ec:::rbd_data.117977dc529b.0000000000000026:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.592483+0000", 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8396824000000001, 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0056916470000000002, 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11549 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.477 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.592483+0000", 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.592483+0000", 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.592484+0000", 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3600000000000002e-07 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593622+0000", 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011380889999999999 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593636+0000", 2024-09-11T05:21:58.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4287999999999999e-05 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593644+0000", 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4630000000000001e-06 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593768+0000", 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012390799999999999 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.593853+0000", 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4433999999999998e-05 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.594090+0000", 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237235 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.596861+0000", 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027705770000000002 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.598083+0000", 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001222852 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.598136+0000", 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2816999999999999e-05 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.598174+0000", 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8148000000000001e-05 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12197 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6983106619999999, 2024-09-11T05:21:58.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050822769999999996, 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12197 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733855+0000", 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:21:58.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733857+0000", 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9240000000000001e-06 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733863+0000", 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8590000000000001e-06 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733868+0000", 2024-09-11T05:21:58.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8489999999999997e-06 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738770+0000", 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049025559999999998 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738839+0000", 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8793000000000004e-05 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738937+0000", 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7854000000000002e-05 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12198 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6982920989999997, 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050661059999999999, 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.488 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12198 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733873+0000", 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733875+0000", 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9719999999999999e-06 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733882+0000", 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.071e-06 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733886+0000", 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7759999999999997e-06 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738834+0000", 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049473989999999999 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738882+0000", 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8148e-05 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738939+0000", 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7351e-05 2024-09-11T05:21:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12199 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6982736809999999, 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052374530000000004, 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12199 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733892+0000", 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733894+0000", 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9539999999999998e-06 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733900+0000", 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1e-06 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733905+0000", 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6450000000000004e-06 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738970+0000", 2024-09-11T05:21:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050656779999999997 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739036+0000", 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5457999999999996e-05 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739129+0000", 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3227999999999996e-05 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12206 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733945+0000", 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.698219731, 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051847760000000003, 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12206 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733945+0000", 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733945+0000", 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733946+0000", 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999998e-07 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733948+0000", 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4380000000000002e-06 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733955+0000", 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2330000000000003e-06 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733965+0000", 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428000000000001e-05 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.738969+0000", 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050034299999999997 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739035+0000", 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6885999999999996e-05 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739130+0000", 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4782000000000002e-05 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12208 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 1146880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.733994+0000", 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6981712399999997, 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052443139999999999, 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12208 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733994+0000", 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733994+0000", 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733995+0000", 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6700000000000003e-07 2024-09-11T05:21:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.733997+0000", 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.142e-06 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734003+0000", 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734008+0000", 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8509999999999998e-06 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739154+0000", 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051460619999999999 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739189+0000", 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4916000000000002e-05 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739238+0000", 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9317999999999998e-05 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12209 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 1146880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6981512619999997, 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053092189999999996, 2024-09-11T05:21:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12209 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734014+0000", 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734021+0000", 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5830000000000003e-06 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734028+0000", 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4059999999999999e-06 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734034+0000", 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2440000000000001e-06 2024-09-11T05:21:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739164+0000", 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051305140000000001 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739231+0000", 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7273000000000005e-05 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739323+0000", 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1735000000000002e-05 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12211 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734040+0000", 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6981250210000001, 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0054081859999999997, 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12211 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734040+0000", 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734040+0000", 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734041+0000", 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734043+0000", 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-11T05:21:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734050+0000", 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.905e-06 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734059+0000", 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739354+0000", 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052947280000000003 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739391+0000", 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7141000000000002e-05 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739448+0000", 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7076e-05 2024-09-11T05:21:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12213 3.3 3:c44a6968:::rbd_data.1179262aa3d7.0000000000000008:5 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734102+0000", 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6980632609999997, 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052405239999999999, 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12213 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734102+0000", 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734102+0000", 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734103+0000", 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7599999999999997e-07 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734105+0000", 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4889999999999998e-06 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734113+0000", 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8299999999999996e-06 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734118+0000", 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739254+0000", 2024-09-11T05:21:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051358200000000001 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739290+0000", 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6177999999999998e-05 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739342+0000", 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2216000000000003e-05 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:12215 3.1a 3:5b544e14:::rbd_data.1179262aa3d7.0000000000000009:5 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6980404020000002, 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055120500000000001, 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 12215 2024-09-11T05:21:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734125+0000", 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9200000000000001e-07 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734128+0000", 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734133+0000", 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:21:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.734138+0000", 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739471+0000", 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053332910000000004 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739543+0000", 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2512e-05 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.739637+0000", 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3469999999999998e-05 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16596 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.085451+0000", 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3467141720000004, 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035633092999999998, 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16596 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.085451+0000", 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.085451+0000", 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.085453+0000", 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8220000000000001e-06 2024-09-11T05:21:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.097972+0000", 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01251961 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098001+0000", 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8776e-05 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098014+0000", 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3059e-05 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098102+0000", 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7797e-05 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.098279+0000", 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000177147 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.099045+0000", 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076592299999999995 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.114143+0000", 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015098115 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120993+0000", 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068501969999999997 2024-09-11T05:21:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.121042+0000", 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8474999999999999e-05 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.121084+0000", 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2172000000000002e-05 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16683 3.14 3:28b1ec8f:::rbd_data.1179c3639760.0000000000000006:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1786494960000002, 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071994340000000002, 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16683 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253516+0000", 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0100000000000004e-07 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253521+0000", 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3599999999999998e-06 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253531+0000", 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0370999999999999e-05 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253537+0000", 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253583+0000", 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6385999999999999e-05 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.253680+0000", 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6497999999999997e-05 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 7", 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.254851+0000", 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00117169 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260585+0000", 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057331559999999997 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260604+0000", 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9093000000000002e-05 2024-09-11T05:21:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260662+0000", 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7995000000000003e-05 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.260715+0000", 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3483999999999998e-05 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16685 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.261258+0000", 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.1709071839999998, 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060508389999999997, 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16685 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261258+0000", 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261258+0000", 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261259+0000", 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.141e-06 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261265+0000", 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261276+0000", 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1191e-05 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261281+0000", 2024-09-11T05:21:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261327+0000", 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5277e-05 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.261383+0000", 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6317000000000003e-05 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.262254+0000", 2024-09-11T05:21:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00087115900000000004 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267151+0000", 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0048965099999999998 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267197+0000", 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6307000000000002e-05 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:21:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267260+0000", 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3006e-05 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.267309+0000", 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8902e-05 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.544 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:58.545 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:21:58.546 INFO:teuthology.orchestra.run.smithi012.stdout:flattening image image_client.0-clone7 2024-09-11T05:21:58.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:21:58.547 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:58.546+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:58.648 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:21:58.648+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:21:58.750 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:21:58.750+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:21:58.755 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:58.755 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:21:58.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.755 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37162 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.697886+0000", 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038993840000000002, 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039014841000000001, 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37162 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697886+0000", 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697886+0000", 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697887+0000", 2024-09-11T05:21:58.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4499999999999997e-07 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697890+0000", 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5409999999999999e-06 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697897+0000", 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2200000000000003e-06 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697903+0000", 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7790000000000001e-06 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37194 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698638+0000", 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038242630999999999, 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038327511000000002, 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.759 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37194 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698638+0000", 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698638+0000", 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698638+0000", 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1e-07 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698639+0000", 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.125e-06 2024-09-11T05:21:58.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698642+0000", 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698645+0000", 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7099999999999999e-06 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37400 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699328+0000", 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037552236000000003, 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037682101000000003, 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37400 2024-09-11T05:21:58.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699328+0000", 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699328+0000", 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699329+0000", 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699331+0000", 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.187e-06 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699337+0000", 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699342+0000", 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1680000000000003e-06 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37432 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.702030+0000", 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.03484988, 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035021038999999997, 2024-09-11T05:21:58.766 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37432 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702030+0000", 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702030+0000", 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702031+0000", 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702033+0000", 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1859999999999999e-06 2024-09-11T05:21:58.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702041+0000", 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6590000000000007e-06 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702046+0000", 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3839999999999996e-06 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37464 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.712066+0000", 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.024813927, 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025028559999999998, 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37464 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712066+0000", 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712066+0000", 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712389+0000", 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032260299999999997 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712393+0000", 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8689999999999997e-06 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712404+0000", 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1331999999999999e-05 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712416+0000", 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1399999999999999e-05 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37672 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720030+0000", 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016850770000000001, 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017113389, 2024-09-11T05:21:58.773 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.774 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.774 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.774 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.774 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.774 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.774 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37672 2024-09-11T05:21:58.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720030+0000", 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720030+0000", 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720030+0000", 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720032+0000", 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.956e-06 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720038+0000", 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9279999999999998e-06 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720043+0000", 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9830000000000004e-06 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37704 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726303+0000", 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010577623, 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010891659999999999, 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37704 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726303+0000", 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726303+0000", 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726303+0000", 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726305+0000", 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.232e-06 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726313+0000", 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.498e-06 2024-09-11T05:21:58.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726318+0000", 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37908 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735777+0000", 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001103639, 2024-09-11T05:21:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001465376, 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37908 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735777+0000", 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735777+0000", 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735777+0000", 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735779+0000", 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735786+0000", 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4080000000000001e-06 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735792+0000", 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37163 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.697928+0000", 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038952035000000003, 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03936216, 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37163 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697928+0000", 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697928+0000", 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697929+0000", 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000002e-07 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697931+0000", 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697939+0000", 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1240000000000005e-06 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697945+0000", 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4219999999999999e-06 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37195 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698648+0000", 2024-09-11T05:21:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038232294, 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038692519000000002, 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37195 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698648+0000", 2024-09-11T05:21:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698648+0000", 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698648+0000", 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.99e-07 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698649+0000", 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0109999999999999e-06 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698652+0000", 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0510000000000001e-06 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698655+0000", 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4669999999999998e-06 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37401 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699348+0000", 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037532098999999999, 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038042596999999997, 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37401 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699348+0000", 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699348+0000", 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699349+0000", 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5299999999999999e-07 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699351+0000", 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1639999999999999e-06 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699357+0000", 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699362+0000", 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8550000000000001e-06 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37433 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.702053+0000", 2024-09-11T05:21:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.034827773999999999, 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035387373, 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37433 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702053+0000", 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702053+0000", 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702053+0000", 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:21:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702055+0000", 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1619999999999998e-06 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702067+0000", 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.236e-05 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702073+0000", 2024-09-11T05:21:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2379999999999997e-06 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37465 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.712428+0000", 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.024452227, 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025059596, 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37465 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712428+0000", 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712428+0000", 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713927+0000", 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001498779 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713932+0000", 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6659999999999999e-06 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713941+0000", 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8660000000000001e-06 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713947+0000", 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7849999999999997e-06 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37673 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720049+0000", 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016831628000000001, 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017486877000000001, 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37673 2024-09-11T05:21:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720049+0000", 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720049+0000", 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720049+0000", 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0600000000000001e-07 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720051+0000", 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720057+0000", 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.874e-06 2024-09-11T05:21:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720061+0000", 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5410000000000002e-06 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37705 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726325+0000", 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010555676, 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01125964, 2024-09-11T05:21:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37705 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726325+0000", 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726325+0000", 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726325+0000", 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726327+0000", 2024-09-11T05:21:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726333+0000", 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726337+0000", 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4490000000000001e-06 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37909 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735797+0000", 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010829399999999999, 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001840979, 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37909 2024-09-11T05:21:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735797+0000", 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735797+0000", 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735798+0000", 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735800+0000", 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735806+0000", 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0800000000000002e-06 2024-09-11T05:21:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735813+0000", 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9380000000000003e-06 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37164 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.697953+0000", 2024-09-11T05:21:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038926954, 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039737058999999998, 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37164 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697953+0000", 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697953+0000", 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697954+0000", 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697956+0000", 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.21e-06 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697963+0000", 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697968+0000", 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0560000000000004e-06 2024-09-11T05:21:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37196 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698658+0000", 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038222595999999998, 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039085001000000001, 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37196 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698658+0000", 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698658+0000", 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698658+0000", 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.05e-07 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698659+0000", 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.048e-06 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698662+0000", 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698665+0000", 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8250000000000001e-06 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37402 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699368+0000", 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037512265000000003, 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038423312000000001, 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37402 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699368+0000", 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699368+0000", 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699368+0000", 2024-09-11T05:21:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699370+0000", 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0099999999999998e-06 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699378+0000", 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3350000000000001e-06 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699383+0000", 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7539999999999997e-06 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37434 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.702081+0000", 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.034799579999999997, 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035758555999999997, 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37434 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702081+0000", 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702081+0000", 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702081+0000", 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702087+0000", 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:21:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702095+0000", 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0099999999999995e-06 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702100+0000", 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0420000000000002e-06 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37642 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.713957+0000", 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.022923625999999999, 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023930379000000002, 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37642 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713957+0000", 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713957+0000", 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713957+0000", 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000002e-07 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713959+0000", 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.069e-06 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713964+0000", 2024-09-11T05:21:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713967+0000", 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1839999999999999e-06 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37674 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720068+0000", 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016812763000000001, 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017871794999999999, 2024-09-11T05:21:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37674 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720068+0000", 2024-09-11T05:21:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720068+0000", 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720068+0000", 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.39e-07 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720070+0000", 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0159999999999998e-06 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720076+0000", 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7989999999999999e-06 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720080+0000", 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6689999999999997e-06 2024-09-11T05:21:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37706 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726344+0000", 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010536478, 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011633151, 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37706 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726344+0000", 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726344+0000", 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726344+0000", 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726346+0000", 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726354+0000", 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2439999999999996e-06 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726358+0000", 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6609999999999999e-06 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37910 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735819+0000", 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001060914, 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022054850000000001, 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37910 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735819+0000", 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735819+0000", 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735820+0000", 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1900000000000003e-07 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735822+0000", 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1490000000000001e-06 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735835+0000", 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2841e-05 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735841+0000", 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37165 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.697981+0000", 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038899161000000002, 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040099503000000002, 2024-09-11T05:21:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37165 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697981+0000", 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697981+0000", 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697982+0000", 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6899999999999998e-07 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697989+0000", 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697996+0000", 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0659999999999998e-06 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698002+0000", 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37197 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698668+0000", 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038212444999999998, 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039465685, 2024-09-11T05:21:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37197 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698668+0000", 2024-09-11T05:21:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698668+0000", 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698668+0000", 2024-09-11T05:21:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698669+0000", 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.015e-06 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698672+0000", 2024-09-11T05:21:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.083e-06 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698675+0000", 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7099999999999999e-06 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37403 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699389+0000", 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037491414000000001, 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038784094999999998, 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37403 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699389+0000", 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699389+0000", 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699389+0000", 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4400000000000001e-07 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699391+0000", 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.103e-06 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699398+0000", 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6379999999999998e-06 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699403+0000", 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.045e-06 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37435 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.702107+0000", 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.034772853999999999, 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036102675000000001, 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37435 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702107+0000", 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702107+0000", 2024-09-11T05:21:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703925+0000", 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018176379999999999 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703929+0000", 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0929999999999996e-06 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703941+0000", 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2242000000000001e-05 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703949+0000", 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.255e-06 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37643 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.713975+0000", 2024-09-11T05:21:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.022905588000000001, 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024263414000000001, 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37643 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713975+0000", 2024-09-11T05:21:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713975+0000", 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713975+0000", 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713977+0000", 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7179999999999999e-06 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713981+0000", 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713985+0000", 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7979999999999999e-06 2024-09-11T05:21:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37675 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720086+0000", 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016793958000000001, 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018179087, 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37675 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720086+0000", 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720086+0000", 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720087+0000", 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720089+0000", 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9099999999999999e-06 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720094+0000", 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:21:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720099+0000", 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4569999999999998e-06 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37707 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726365+0000", 2024-09-11T05:21:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010515652, 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011927627, 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37707 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726365+0000", 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726365+0000", 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726365+0000", 2024-09-11T05:21:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7300000000000001e-07 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726367+0000", 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726373+0000", 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726378+0000", 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8620000000000002e-06 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37911 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735849+0000", 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010316609999999999, 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0024701979999999998, 2024-09-11T05:21:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37911 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735849+0000", 2024-09-11T05:21:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735849+0000", 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735849+0000", 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1500000000000005e-07 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735851+0000", 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3300000000000001e-06 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735859+0000", 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.041e-06 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735864+0000", 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2089999999999996e-06 2024-09-11T05:21:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37166 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698011+0000", 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038869763000000002, 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040335255, 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37166 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698011+0000", 2024-09-11T05:21:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698011+0000", 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698011+0000", 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8999999999999995e-07 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698014+0000", 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.351e-06 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698021+0000", 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9859999999999997e-06 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698025+0000", 2024-09-11T05:21:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8029999999999996e-06 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37198 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698678+0000", 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038202431000000002, 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039694838000000003, 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37198 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698678+0000", 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698678+0000", 2024-09-11T05:21:58.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698678+0000", 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.35e-07 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698679+0000", 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0189999999999999e-06 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698683+0000", 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.053e-06 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698686+0000", 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7099999999999999e-06 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37404 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699409+0000", 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037471009, 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039028206000000003, 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37404 2024-09-11T05:21:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699409+0000", 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699409+0000", 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699410+0000", 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5400000000000002e-07 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699412+0000", 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1849999999999998e-06 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699418+0000", 2024-09-11T05:21:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699423+0000", 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37436 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.703961+0000", 2024-09-11T05:21:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.032919193999999999, 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034505584999999998, 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37436 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703961+0000", 2024-09-11T05:21:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703961+0000", 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703962+0000", 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6899999999999998e-07 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703964+0000", 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.61e-06 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703971+0000", 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703977+0000", 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37644 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.713989+0000", 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.022891748, 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024505458000000001, 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37644 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713989+0000", 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713989+0000", 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713989+0000", 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.29e-07 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713990+0000", 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3829999999999999e-06 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713993+0000", 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.253e-06 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713996+0000", 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.712e-06 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37676 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720105+0000", 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016775714000000001, 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018418708999999998, 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37676 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720105+0000", 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720105+0000", 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720105+0000", 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720107+0000", 2024-09-11T05:21:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9920000000000002e-06 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720114+0000", 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8990000000000004e-06 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720119+0000", 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8010000000000003e-06 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37708 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726384+0000", 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010495969000000001, 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012165977999999999, 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37708 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726384+0000", 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726384+0000", 2024-09-11T05:21:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727926+0000", 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001541995 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727931+0000", 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6619999999999996e-06 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727942+0000", 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1423000000000001e-05 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727948+0000", 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4099999999999999e-06 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37912 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735870+0000", 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0010102710000000001, 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027080899999999998, 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37912 2024-09-11T05:21:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735870+0000", 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735870+0000", 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735870+0000", 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735873+0000", 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0710000000000002e-06 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735879+0000", 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5180000000000001e-06 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735884+0000", 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7160000000000002e-06 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37167 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698032+0000", 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038848021000000003, 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040572704000000001, 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37167 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698032+0000", 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698032+0000", 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698033+0000", 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698035+0000", 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-06 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698041+0000", 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.297e-06 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698046+0000", 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7709999999999997e-06 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.906 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37199 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698708+0000", 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038172676000000003, 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039933494999999999, 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37199 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698708+0000", 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698708+0000", 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698708+0000", 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3300000000000002e-07 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698711+0000", 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2480000000000001e-06 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698718+0000", 2024-09-11T05:21:58.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.516e-06 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698722+0000", 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2830000000000003e-06 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.910 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37405 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699429+0000", 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037451496000000001, 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039242356999999999, 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37405 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699429+0000", 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699429+0000", 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699429+0000", 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699431+0000", 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9819999999999998e-06 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699437+0000", 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1850000000000001e-06 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699443+0000", 2024-09-11T05:21:58.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.524e-06 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37437 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.703984+0000", 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.032896680999999997, 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034718003999999997, 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.914 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37437 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703984+0000", 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703984+0000", 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703984+0000", 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703986+0000", 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.092e-06 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703992+0000", 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3729999999999998e-06 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.703997+0000", 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8559999999999998e-06 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37645 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.713999+0000", 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.022880939999999999, 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024729441000000001, 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37645 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.918 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713999+0000", 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.713999+0000", 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715926+0000", 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019270470000000001 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715931+0000", 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9919999999999998e-06 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715943+0000", 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1126e-05 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715950+0000", 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4250000000000001e-06 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37677 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720125+0000", 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016755612, 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018632770999999999, 2024-09-11T05:21:58.921 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37677 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720125+0000", 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720125+0000", 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720125+0000", 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7300000000000001e-07 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720127+0000", 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9369999999999998e-06 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720133+0000", 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7710000000000003e-06 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720137+0000", 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6070000000000001e-06 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.924 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37709 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.727959+0000", 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.008921231, 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0108255, 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.925 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37709 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727959+0000", 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727959+0000", 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727959+0000", 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727961+0000", 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8250000000000001e-06 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727966+0000", 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9450000000000001e-06 2024-09-11T05:21:58.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727969+0000", 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9629999999999998e-06 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37913 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.928 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735891+0000", 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0009896760000000001, 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029222359999999999, 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37913 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735891+0000", 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735891+0000", 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735891+0000", 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:21:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735894+0000", 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5050000000000002e-06 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735900+0000", 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9199999999999998e-06 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735906+0000", 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1139999999999997e-06 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37168 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698111+0000", 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038769703000000003, 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040745826999999998, 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.932 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37168 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698111+0000", 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698111+0000", 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698111+0000", 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9599999999999999e-07 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698114+0000", 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698122+0000", 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9070000000000007e-06 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698127+0000", 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3530000000000002e-06 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37200 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698734+0000", 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038146081999999998, 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040180635999999999, 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37200 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.936 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698734+0000", 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698734+0000", 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698735+0000", 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698736+0000", 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.906e-06 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698740+0000", 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0049999999999998e-06 2024-09-11T05:21:58.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698743+0000", 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8459999999999999e-06 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37406 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699449+0000", 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037431418000000001, 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039525716000000002, 2024-09-11T05:21:58.939 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37406 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699449+0000", 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699449+0000", 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699449+0000", 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699452+0000", 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3130000000000001e-06 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699457+0000", 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3900000000000001e-06 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699461+0000", 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0729999999999998e-06 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37438 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.704004+0000", 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.032876426, 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035028388000000001, 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.943 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37438 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704004+0000", 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704004+0000", 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704004+0000", 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704007+0000", 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3640000000000002e-06 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704012+0000", 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6960000000000002e-06 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704017+0000", 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4599999999999996e-06 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37646 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.715963+0000", 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020917076, 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023116385999999999, 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37646 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715963+0000", 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715963+0000", 2024-09-11T05:21:58.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715964+0000", 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8100000000000003e-07 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715967+0000", 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7460000000000001e-06 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715974+0000", 2024-09-11T05:21:58.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9929999999999998e-06 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715979+0000", 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3530000000000002e-06 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37678 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720144+0000", 2024-09-11T05:21:58.949 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016736772, 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018964517, 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37678 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720144+0000", 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720144+0000", 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721925+0000", 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017813670000000001 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721933+0000", 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3950000000000001e-06 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721944+0000", 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1046999999999999e-05 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721951+0000", 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5189999999999998e-06 2024-09-11T05:21:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37710 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.727973+0000", 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0089069160000000008, 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011164601, 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37710 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727973+0000", 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727973+0000", 2024-09-11T05:21:58.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727974+0000", 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5499999999999999e-07 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727975+0000", 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5349999999999999e-06 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727978+0000", 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2550000000000002e-06 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727981+0000", 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4870000000000001e-06 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37914 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.956 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735912+0000", 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00096837599999999996, 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003253007, 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37914 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735912+0000", 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735912+0000", 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735912+0000", 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9499999999999998e-07 2024-09-11T05:21:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735915+0000", 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.277e-06 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735929+0000", 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4071e-05 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735934+0000", 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2460000000000003e-06 2024-09-11T05:21:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37169 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1619968~1024 out=1024b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698134+0000", 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038745895000000002, 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041064484999999998, 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.960 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37169 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698134+0000", 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698134+0000", 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698135+0000", 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2900000000000004e-07 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698137+0000", 2024-09-11T05:21:58.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9889999999999999e-06 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698143+0000", 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3600000000000001e-06 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698148+0000", 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8679999999999998e-06 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.739054+0000", 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040906340999999999 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.739137+0000", 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2671999999999997e-05 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.964 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37201 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698748+0000", 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038131838000000001, 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040483810000000002, 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37201 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698748+0000", 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698748+0000", 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698749+0000", 2024-09-11T05:21:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698754+0000", 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8899999999999998e-06 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698757+0000", 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4479999999999999e-06 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698760+0000", 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37407 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699467+0000", 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.03741336, 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039795837000000001, 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.968 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37407 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699467+0000", 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699467+0000", 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699467+0000", 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699469+0000", 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.075e-06 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699482+0000", 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2459e-05 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699487+0000", 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4399999999999996e-06 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37439 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.704037+0000", 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.032843116999999998, 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035266568999999998, 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37439 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704037+0000", 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704037+0000", 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704038+0000", 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704040+0000", 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3910000000000001e-06 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704046+0000", 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0020000000000003e-06 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704051+0000", 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6299999999999997e-06 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.975 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37647 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.715986+0000", 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020893928999999999, 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023373990000000001, 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37647 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715986+0000", 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715986+0000", 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715987+0000", 2024-09-11T05:21:58.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5299999999999999e-07 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715989+0000", 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1919999999999999e-06 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.715996+0000", 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716000+0000", 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6149999999999999e-06 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37679 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.721962+0000", 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014918334, 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017452348999999999, 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37679 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721962+0000", 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721962+0000", 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721962+0000", 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2e-07 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721965+0000", 2024-09-11T05:21:58.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4339999999999999e-06 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721971+0000", 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3099999999999997e-06 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721977+0000", 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8170000000000004e-06 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37711 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.727984+0000", 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088960819999999996, 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011486366, 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.983 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37711 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727984+0000", 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727984+0000", 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727984+0000", 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727986+0000", 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.207e-06 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727989+0000", 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0910000000000001e-06 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727992+0000", 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0309999999999999e-06 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37915 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.986 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735943+0000", 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000937082, 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003581098, 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37915 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735943+0000", 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735943+0000", 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735944+0000", 2024-09-11T05:21:58.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7899999999999998e-07 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735946+0000", 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4889999999999998e-06 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735953+0000", 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7320000000000001e-06 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735958+0000", 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9490000000000004e-06 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37202 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698763+0000", 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038116903000000001, 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040796849000000003, 2024-09-11T05:21:58.990 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37202 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698763+0000", 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698763+0000", 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698764+0000", 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698765+0000", 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2359999999999999e-06 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698768+0000", 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2509999999999999e-06 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698771+0000", 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.095e-06 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.993 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37408 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699494+0000", 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037386524999999997, 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040095453000000003, 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37408 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699494+0000", 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699494+0000", 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699494+0000", 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699496+0000", 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2730000000000001e-06 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699504+0000", 2024-09-11T05:21:58.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6539999999999999e-06 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699510+0000", 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8100000000000003e-06 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37440 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.704057+0000", 2024-09-11T05:21:58.997 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.032822817999999997, 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03556078, 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37440 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:58.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704057+0000", 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704057+0000", 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704058+0000", 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:58.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704060+0000", 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.979e-06 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704066+0000", 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9920000000000004e-06 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704071+0000", 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.668e-06 2024-09-11T05:21:59.000 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37648 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716007+0000", 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020873563000000001, 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648915999999999, 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37648 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716007+0000", 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716007+0000", 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716007+0000", 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.63e-07 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716009+0000", 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716016+0000", 2024-09-11T05:21:59.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716021+0000", 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37680 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.721984+0000", 2024-09-11T05:21:59.004 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014896120000000001, 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017794529, 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37680 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721984+0000", 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721984+0000", 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721985+0000", 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721987+0000", 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.244e-06 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721994+0000", 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.721998+0000", 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6840000000000004e-06 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37712 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.727995+0000", 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088853690000000006, 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011839439, 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37712 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727995+0000", 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727995+0000", 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727995+0000", 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727996+0000", 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1790000000000001e-06 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.727999+0000", 2024-09-11T05:21:59.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1099999999999999e-06 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728002+0000", 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.463e-06 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37916 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735964+0000", 2024-09-11T05:21:59.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000915853, 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039236999999999996, 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37916 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735964+0000", 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735964+0000", 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735965+0000", 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735967+0000", 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735974+0000", 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.584e-06 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735979+0000", 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9649999999999999e-06 2024-09-11T05:21:59.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37203 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698774+0000", 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038105935000000001, 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041143526999999999, 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37203 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698774+0000", 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698774+0000", 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698775+0000", 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698776+0000", 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1540000000000001e-06 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698779+0000", 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.67e-06 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698782+0000", 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6280000000000001e-06 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37409 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699517+0000", 2024-09-11T05:21:59.018 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037363678999999997, 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040445200000000001, 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37409 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699517+0000", 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699517+0000", 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699517+0000", 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699519+0000", 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.075e-06 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699526+0000", 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2099999999999996e-06 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699532+0000", 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2850000000000002e-06 2024-09-11T05:21:59.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37441 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.704076+0000", 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.032803883999999998, 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035913805, 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37441 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704076+0000", 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704076+0000", 2024-09-11T05:21:59.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704077+0000", 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704079+0000", 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.046e-06 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704085+0000", 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9549999999999997e-06 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704089+0000", 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6e-06 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.025 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37649 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716028+0000", 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020852646999999998, 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023997916000000001, 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37649 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716028+0000", 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716028+0000", 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716028+0000", 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:21:59.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716030+0000", 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1679999999999998e-06 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716037+0000", 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3589999999999996e-06 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716041+0000", 2024-09-11T05:21:59.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.729e-06 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37681 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722005+0000", 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014875704999999999, 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01807839, 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.029 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37681 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722005+0000", 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722005+0000", 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722005+0000", 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722007+0000", 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1090000000000001e-06 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722013+0000", 2024-09-11T05:21:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722017+0000", 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37713 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.728005+0000", 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088755050000000005, 2024-09-11T05:21:59.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01213435, 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37713 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728005+0000", 2024-09-11T05:21:59.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728005+0000", 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728005+0000", 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728006+0000", 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.175e-06 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728009+0000", 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728012+0000", 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.368e-06 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37917 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735985+0000", 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00089531500000000004, 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042108400000000004, 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.036 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37917 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735985+0000", 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735985+0000", 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735985+0000", 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735987+0000", 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0310000000000001e-06 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735994+0000", 2024-09-11T05:21:59.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.173e-06 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736000+0000", 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2249999999999997e-06 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37204 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698786+0000", 2024-09-11T05:21:59.039 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038094718999999999, 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041464620000000001, 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37204 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698786+0000", 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698786+0000", 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698786+0000", 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9489999999999999e-06 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698794+0000", 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7930000000000003e-06 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698798+0000", 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.352e-06 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37410 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699539+0000", 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037341225999999998, 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040743222000000003, 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37410 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699539+0000", 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699539+0000", 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699539+0000", 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699542+0000", 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1900000000000002e-06 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699550+0000", 2024-09-11T05:21:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4989999999999994e-06 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699555+0000", 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8570000000000003e-06 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37442 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.704095+0000", 2024-09-11T05:21:59.046 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.032785057999999999, 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036214651, 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37442 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704095+0000", 2024-09-11T05:21:59.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.704095+0000", 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705925+0000", 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001830059 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705930+0000", 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9520000000000002e-06 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705939+0000", 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9879999999999993e-06 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705946+0000", 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.657e-06 2024-09-11T05:21:59.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37650 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716048+0000", 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020832469999999999, 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024299003999999999, 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.050 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37650 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716048+0000", 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716048+0000", 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716048+0000", 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7300000000000001e-07 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716051+0000", 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7630000000000001e-06 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716057+0000", 2024-09-11T05:21:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2770000000000002e-06 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716062+0000", 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9429999999999999e-06 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37682 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722023+0000", 2024-09-11T05:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014856886, 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018364956000000002, 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37682 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722023+0000", 2024-09-11T05:21:59.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722023+0000", 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722024+0000", 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722026+0000", 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3709999999999998e-06 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722032+0000", 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722037+0000", 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7269999999999998e-06 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37714 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.728015+0000", 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.008865665, 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012428889, 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37714 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728015+0000", 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728015+0000", 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728015+0000", 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.34e-07 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728022+0000", 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9e-06 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728031+0000", 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9509999999999995e-06 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728034+0000", 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.089e-06 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37918 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736007+0000", 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000873766, 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044900369999999997, 2024-09-11T05:21:59.060 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37918 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736007+0000", 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736007+0000", 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736007+0000", 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736014+0000", 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.579e-06 2024-09-11T05:21:59.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736021+0000", 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1189999999999999e-06 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736026+0000", 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2950000000000001e-06 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37205 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698805+0000", 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038075584000000003, 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041751300999999998, 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37205 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.064 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698805+0000", 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698805+0000", 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698805+0000", 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.51e-07 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698807+0000", 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.108e-06 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698814+0000", 2024-09-11T05:21:59.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2249999999999997e-06 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698818+0000", 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37411 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699562+0000", 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037318756000000002, 2024-09-11T05:21:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041044815999999998, 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37411 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699562+0000", 2024-09-11T05:21:59.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699562+0000", 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699562+0000", 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699568+0000", 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0850000000000002e-06 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699576+0000", 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8800000000000008e-06 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699581+0000", 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9880000000000004e-06 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37443 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.705958+0000", 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.030922383000000001, 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034679441999999998, 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37443 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705958+0000", 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705958+0000", 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705958+0000", 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705961+0000", 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705969+0000", 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0150000000000003e-06 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705974+0000", 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1660000000000002e-06 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37651 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716069+0000", 2024-09-11T05:21:59.074 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020811551000000001, 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596476999999999, 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37651 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716069+0000", 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716069+0000", 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716069+0000", 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4400000000000001e-07 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716071+0000", 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716077+0000", 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0159999999999997e-06 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716083+0000", 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5260000000000001e-06 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.077 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37683 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722043+0000", 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014837625, 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018652808, 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37683 2024-09-11T05:21:59.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722043+0000", 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722043+0000", 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722043+0000", 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722045+0000", 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9580000000000001e-06 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722055+0000", 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5279999999999992e-06 2024-09-11T05:21:59.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722060+0000", 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3419999999999998e-06 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37715 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.728055+0000", 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0088248600000000003, 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012679332999999999, 2024-09-11T05:21:59.081 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37715 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728055+0000", 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728055+0000", 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728056+0000", 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0999999999999999e-07 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728058+0000", 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:21:59.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728064+0000", 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.976e-06 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728069+0000", 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0660000000000003e-06 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37919 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736033+0000", 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00084738399999999996, 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047526950000000004, 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37919 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.085 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736033+0000", 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736033+0000", 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736033+0000", 2024-09-11T05:21:59.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736035+0000", 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736042+0000", 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736046+0000", 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37206 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698829+0000", 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038050979999999998, 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042014572, 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.088 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37206 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698829+0000", 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698829+0000", 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698830+0000", 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5400000000000002e-07 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698832+0000", 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.142e-06 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698844+0000", 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2257e-05 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698850+0000", 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8080000000000001e-06 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37412 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699587+0000", 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037292879000000001, 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041309549000000001, 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37412 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.092 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699587+0000", 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699587+0000", 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699588+0000", 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699590+0000", 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.198e-06 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699596+0000", 2024-09-11T05:21:59.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699601+0000", 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4719999999999997e-06 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37444 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.705982+0000", 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.030898307, 2024-09-11T05:21:59.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034974736999999999, 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37444 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705982+0000", 2024-09-11T05:21:59.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705982+0000", 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705982+0000", 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3300000000000003e-07 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705985+0000", 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1660000000000001e-06 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705992+0000", 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1080000000000004e-06 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.705996+0000", 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4950000000000002e-06 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37652 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716090+0000", 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020790385000000002, 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024907674000000001, 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37652 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716090+0000", 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716090+0000", 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716090+0000", 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5000000000000003e-07 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716093+0000", 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1569999999999998e-06 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716099+0000", 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0109999999999997e-06 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716103+0000", 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7589999999999997e-06 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37684 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722306+0000", 2024-09-11T05:21:59.102 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014574607999999999, 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018750286000000001, 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37684 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722306+0000", 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722306+0000", 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722306+0000", 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722309+0000", 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7989999999999998e-06 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722316+0000", 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.396e-06 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722322+0000", 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.049e-06 2024-09-11T05:21:59.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37716 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.728076+0000", 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.008804147, 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013035939999999999, 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37716 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728076+0000", 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728076+0000", 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728076+0000", 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728078+0000", 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9630000000000001e-06 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728084+0000", 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6470000000000003e-06 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728089+0000", 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4240000000000003e-06 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37920 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.109 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736053+0000", 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00082744299999999997, 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051165819999999997, 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37920 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736053+0000", 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736053+0000", 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736053+0000", 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736055+0000", 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.029e-06 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736064+0000", 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4489999999999999e-06 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736070+0000", 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7710000000000001e-06 2024-09-11T05:21:59.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37207 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698864+0000", 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.038016735000000003, 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042355533000000001, 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37207 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698864+0000", 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698864+0000", 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698864+0000", 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.75e-07 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698867+0000", 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5050000000000002e-06 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698873+0000", 2024-09-11T05:21:59.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3169999999999998e-06 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698878+0000", 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7400000000000004e-06 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.116 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37413 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699606+0000", 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037273817000000001, 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041644992999999998, 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37413 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699606+0000", 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699606+0000", 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699607+0000", 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:21:59.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699609+0000", 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2010000000000002e-06 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699615+0000", 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8459999999999996e-06 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699620+0000", 2024-09-11T05:21:59.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7949999999999998e-06 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37445 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.706004+0000", 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.030876667999999999, 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035276384000000001, 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37445 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706004+0000", 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706004+0000", 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706004+0000", 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706006+0000", 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706013+0000", 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2799999999999998e-06 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706018+0000", 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9259999999999999e-06 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37653 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716110+0000", 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020770638000000001, 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025200353000000002, 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37653 2024-09-11T05:21:59.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716110+0000", 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716110+0000", 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716110+0000", 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3300000000000003e-07 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716112+0000", 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9870000000000002e-06 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716118+0000", 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716124+0000", 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2310000000000004e-06 2024-09-11T05:21:59.127 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37685 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722332+0000", 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014547905999999999, 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019004722000000002, 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.128 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37685 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722332+0000", 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722332+0000", 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722333+0000", 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2099999999999997e-07 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722335+0000", 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3439999999999999e-06 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722343+0000", 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2609999999999996e-06 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722347+0000", 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.921e-06 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37717 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.728095+0000", 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0087855539999999992, 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013271096, 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37717 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728095+0000", 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728095+0000", 2024-09-11T05:21:59.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728095+0000", 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728097+0000", 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.967e-06 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728103+0000", 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728108+0000", 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37921 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736081+0000", 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00079974799999999997, 2024-09-11T05:21:59.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053126559999999998, 2024-09-11T05:21:59.137 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.137 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.137 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.137 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37921 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736081+0000", 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736081+0000", 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736081+0000", 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736083+0000", 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2359999999999999e-06 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736091+0000", 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1189999999999997e-06 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736097+0000", 2024-09-11T05:21:59.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37382 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698884+0000", 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037996459000000003, 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042554575999999997, 2024-09-11T05:21:59.141 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37382 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.142 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698884+0000", 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698884+0000", 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698884+0000", 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698886+0000", 2024-09-11T05:21:59.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0710000000000002e-06 2024-09-11T05:21:59.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698893+0000", 2024-09-11T05:21:59.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6409999999999996e-06 2024-09-11T05:21:59.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698898+0000", 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5240000000000002e-06 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37414 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.146 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699626+0000", 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037254321, 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041858791999999999, 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37414 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699626+0000", 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699626+0000", 2024-09-11T05:21:59.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699626+0000", 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699628+0000", 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.08e-06 2024-09-11T05:21:59.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699635+0000", 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699639+0000", 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6859999999999997e-06 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37446 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.706026+0000", 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.030854751, 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035487591999999998, 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37446 2024-09-11T05:21:59.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706026+0000", 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706026+0000", 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706026+0000", 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706033+0000", 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706040+0000", 2024-09-11T05:21:59.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.627e-06 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706046+0000", 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2650000000000004e-06 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37654 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716130+0000", 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020750358, 2024-09-11T05:21:59.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025412562999999999, 2024-09-11T05:21:59.155 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.155 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.156 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37654 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716130+0000", 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716130+0000", 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716130+0000", 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7899999999999999e-07 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716138+0000", 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716144+0000", 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2530000000000001e-06 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716149+0000", 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9019999999999998e-06 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37686 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722354+0000", 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014526107999999999, 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019215332000000002, 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37686 2024-09-11T05:21:59.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722354+0000", 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722354+0000", 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722355+0000", 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8599999999999999e-07 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722357+0000", 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722363+0000", 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0950000000000001e-06 2024-09-11T05:21:59.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722367+0000", 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7940000000000002e-06 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37718 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.728114+0000", 2024-09-11T05:21:59.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0087667349999999995, 2024-09-11T05:21:59.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013485397999999999, 2024-09-11T05:21:59.164 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37718 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728114+0000", 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.728114+0000", 2024-09-11T05:21:59.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729924+0000", 2024-09-11T05:21:59.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00181083 2024-09-11T05:21:59.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729929+0000", 2024-09-11T05:21:59.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2089999999999999e-06 2024-09-11T05:21:59.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729936+0000", 2024-09-11T05:21:59.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4100000000000002e-06 2024-09-11T05:21:59.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729941+0000", 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5299999999999998e-06 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37922 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736104+0000", 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00077665500000000001, 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055221920000000004, 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.170 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37922 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736104+0000", 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736104+0000", 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736104+0000", 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736106+0000", 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9920000000000002e-06 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736112+0000", 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0090000000000004e-06 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736124+0000", 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1678999999999999e-05 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37383 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698904+0000", 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037976457999999998, 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042756178999999998, 2024-09-11T05:21:59.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37383 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698904+0000", 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698904+0000", 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698904+0000", 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698906+0000", 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698913+0000", 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.297e-06 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698917+0000", 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.887e-06 2024-09-11T05:21:59.177 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37415 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699655+0000", 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037225412999999999, 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042046774000000002, 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.178 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37415 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699655+0000", 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699655+0000", 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699655+0000", 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.99e-07 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699658+0000", 2024-09-11T05:21:59.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2220000000000001e-06 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699664+0000", 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4230000000000002e-06 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699669+0000", 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8960000000000002e-06 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37447 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.706053+0000", 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.030827637000000001, 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035685811999999997, 2024-09-11T05:21:59.182 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37447 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706053+0000", 2024-09-11T05:21:59.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706053+0000", 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706053+0000", 2024-09-11T05:21:59.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706055+0000", 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1169999999999998e-06 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706063+0000", 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6480000000000003e-06 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706068+0000", 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7990000000000001e-06 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37655 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716156+0000", 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020724345000000002, 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025635021000000001, 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.186 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37655 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716156+0000", 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716156+0000", 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716156+0000", 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-07 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716159+0000", 2024-09-11T05:21:59.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716165+0000", 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2870000000000001e-06 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716170+0000", 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1749999999999996e-06 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37687 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722374+0000", 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014506026, 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019477510999999999, 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.190 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37687 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722374+0000", 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722374+0000", 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722375+0000", 2024-09-11T05:21:59.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722377+0000", 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1220000000000002e-06 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722383+0000", 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722387+0000", 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.797e-06 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37719 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.729950+0000", 2024-09-11T05:21:59.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0069303029999999996, 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01195444, 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37719 2024-09-11T05:21:59.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729950+0000", 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729950+0000", 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729950+0000", 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729952+0000", 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5960000000000001e-06 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729956+0000", 2024-09-11T05:21:59.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.675e-06 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729959+0000", 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5269999999999999e-06 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37923 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736131+0000", 2024-09-11T05:21:59.198 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00074890700000000004, 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058332810000000001, 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37923 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736131+0000", 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736131+0000", 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736132+0000", 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:21:59.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736134+0000", 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1260000000000001e-06 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736141+0000", 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.793e-06 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736146+0000", 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4890000000000003e-06 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37384 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698936+0000", 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037943816999999998, 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043066849999999997, 2024-09-11T05:21:59.202 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37384 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698936+0000", 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698936+0000", 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698937+0000", 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9599999999999999e-07 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698939+0000", 2024-09-11T05:21:59.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3609999999999999e-06 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698946+0000", 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6769999999999998e-06 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698951+0000", 2024-09-11T05:21:59.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2449999999999998e-06 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37416 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699675+0000", 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037204802000000002, 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042370889000000002, 2024-09-11T05:21:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37416 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699675+0000", 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699675+0000", 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699676+0000", 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699678+0000", 2024-09-11T05:21:59.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0490000000000002e-06 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699684+0000", 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0240000000000003e-06 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699689+0000", 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8060000000000002e-06 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.209 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37448 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.706074+0000", 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.030806257, 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036004841000000003, 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37448 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706074+0000", 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.706074+0000", 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707926+0000", 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001852207 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707931+0000", 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2490000000000001e-06 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707944+0000", 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2639e-05 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707952+0000", 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3399999999999998e-06 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37656 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.213 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716177+0000", 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020703525, 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025929745000000001, 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37656 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716177+0000", 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716177+0000", 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716177+0000", 2024-09-11T05:21:59.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716179+0000", 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716185+0000", 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8259999999999998e-06 2024-09-11T05:21:59.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716190+0000", 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37688 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722393+0000", 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014486885999999999, 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019746331999999998, 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37688 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722393+0000", 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722393+0000", 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722394+0000", 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722396+0000", 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9470000000000002e-06 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722402+0000", 2024-09-11T05:21:59.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999997e-06 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722406+0000", 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.459e-06 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37720 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.729965+0000", 2024-09-11T05:21:59.221 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0069152739999999999, 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012226727999999999, 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37720 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729965+0000", 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729965+0000", 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729965+0000", 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729967+0000", 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6220000000000001e-06 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729978+0000", 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1077000000000001e-05 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.729984+0000", 2024-09-11T05:21:59.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4909999999999996e-06 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37924 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736168+0000", 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00071213600000000004, 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060802069999999998, 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.225 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37924 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736168+0000", 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736168+0000", 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736169+0000", 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736171+0000", 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2639999999999998e-06 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736179+0000", 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5660000000000001e-06 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736184+0000", 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6110000000000001e-06 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37385 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698957+0000", 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037923130999999999, 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.04334557, 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.229 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37385 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698957+0000", 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698957+0000", 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698958+0000", 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698960+0000", 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.001e-06 2024-09-11T05:21:59.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698966+0000", 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698971+0000", 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8890000000000001e-06 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37417 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699695+0000", 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037185105000000003, 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042662723999999999, 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.233 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37417 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699695+0000", 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699695+0000", 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699696+0000", 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699698+0000", 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699708+0000", 2024-09-11T05:21:59.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0400999999999999e-05 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699717+0000", 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2119999999999992e-06 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37449 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.707968+0000", 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.028912337, 2024-09-11T05:21:59.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034423587999999998, 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37449 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707968+0000", 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707968+0000", 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707969+0000", 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9699999999999996e-07 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.707995+0000", 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6417000000000001e-05 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708013+0000", 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7655e-05 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708019+0000", 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8759999999999999e-06 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.240 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37657 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716196+0000", 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020684546000000002, 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026226066999999999, 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37657 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716196+0000", 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716196+0000", 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716196+0000", 2024-09-11T05:21:59.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:21:59.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716198+0000", 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716307+0000", 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108404 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716314+0000", 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6490000000000008e-06 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.244 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37689 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722412+0000", 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014468388, 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020036978, 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.245 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37689 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722412+0000", 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722412+0000", 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722412+0000", 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722414+0000", 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722425+0000", 2024-09-11T05:21:59.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0249e-05 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722430+0000", 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5899999999999998e-06 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37721 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730021+0000", 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068590150000000004, 2024-09-11T05:21:59.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01246513, 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37721 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730021+0000", 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730021+0000", 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730022+0000", 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3600000000000003e-07 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730025+0000", 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7360000000000001e-06 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730033+0000", 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3489999999999992e-06 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730039+0000", 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2870000000000001e-06 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37925 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736191+0000", 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00068946100000000005, 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063375280000000003, 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.252 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37925 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736191+0000", 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736191+0000", 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736191+0000", 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736193+0000", 2024-09-11T05:21:59.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.148e-06 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736202+0000", 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0329999999999997e-06 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736208+0000", 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.366e-06 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37386 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698977+0000", 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037903381, 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043608873999999999, 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.256 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37386 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698977+0000", 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698977+0000", 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698977+0000", 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698979+0000", 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:21:59.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698985+0000", 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.066e-06 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698990+0000", 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6920000000000001e-06 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37418 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699724+0000", 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037156150999999998, 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042916114999999998, 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37418 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699724+0000", 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699724+0000", 2024-09-11T05:21:59.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699725+0000", 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699727+0000", 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699733+0000", 2024-09-11T05:21:59.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2949999999999999e-06 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699738+0000", 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.797e-06 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37450 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.708064+0000", 2024-09-11T05:21:59.263 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.028816442000000001, 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034728131000000002, 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37450 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708064+0000", 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708064+0000", 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708064+0000", 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708068+0000", 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1659999999999998e-06 2024-09-11T05:21:59.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708077+0000", 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8050000000000001e-06 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708111+0000", 2024-09-11T05:21:59.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3263000000000003e-05 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37658 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716332+0000", 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020548601999999999, 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026489854, 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.268 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37658 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716332+0000", 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716332+0000", 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716332+0000", 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5600000000000005e-07 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716335+0000", 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0649999999999999e-06 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716344+0000", 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6160000000000002e-06 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716350+0000", 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9630000000000003e-06 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.271 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37690 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722437+0000", 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014443371999999999, 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020413889000000001, 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37690 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722437+0000", 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722437+0000", 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722437+0000", 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722445+0000", 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4370000000000001e-06 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722452+0000", 2024-09-11T05:21:59.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6009999999999997e-06 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722457+0000", 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8779999999999997e-06 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37722 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.275 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730049+0000", 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068311489999999999, 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012848902000000001, 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37722 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730049+0000", 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730049+0000", 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730050+0000", 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-07 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730052+0000", 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730064+0000", 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2547e-05 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730070+0000", 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3430000000000003e-06 2024-09-11T05:21:59.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37926 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736214+0000", 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00066590699999999998, 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067398789999999998, 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37926 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736214+0000", 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736214+0000", 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736215+0000", 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0699999999999997e-07 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736217+0000", 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.119e-06 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736223+0000", 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1720000000000004e-06 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736228+0000", 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000001e-06 2024-09-11T05:21:59.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37387 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.698996+0000", 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037883989, 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044018757999999998, 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.283 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37387 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698996+0000", 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698996+0000", 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698997+0000", 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699002+0000", 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699009+0000", 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6719999999999998e-06 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699014+0000", 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37419 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699744+0000", 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037136065000000003, 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043325033999999998, 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37419 2024-09-11T05:21:59.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699744+0000", 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699744+0000", 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699745+0000", 2024-09-11T05:21:59.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:21:59.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699747+0000", 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1100000000000001e-06 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699753+0000", 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3029999999999996e-06 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699758+0000", 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8570000000000003e-06 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37451 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.708121+0000", 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.028759215000000001, 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034990182000000002, 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37451 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708121+0000", 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708121+0000", 2024-09-11T05:21:59.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708122+0000", 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7000000000000005e-07 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708127+0000", 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4099999999999999e-06 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708137+0000", 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7219999999999994e-06 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708142+0000", 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6869999999999999e-06 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37659 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.716356+0000", 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020524087999999999, 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026783283000000001, 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37659 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716356+0000", 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.716356+0000", 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717928+0000", 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001571474 2024-09-11T05:21:59.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717931+0000", 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3869999999999999e-06 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717944+0000", 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2461e-05 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717951+0000", 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7999999999999999e-06 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37691 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.722464+0000", 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.014416208, 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020705416000000001, 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.299 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37691 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722464+0000", 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.722464+0000", 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723924+0000", 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001459517 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723932+0000", 2024-09-11T05:21:59.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7439999999999996e-06 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723944+0000", 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.134e-05 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723951+0000", 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8480000000000003e-06 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37723 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730077+0000", 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0068033850000000003, 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013119541, 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.303 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37723 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730077+0000", 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730077+0000", 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730077+0000", 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3700000000000001e-07 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730080+0000", 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2199999999999999e-06 2024-09-11T05:21:59.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730086+0000", 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.708e-06 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730091+0000", 2024-09-11T05:21:59.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8849999999999998e-06 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37927 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736235+0000", 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00064568700000000004, 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.007006633, 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.307 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37927 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736235+0000", 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736235+0000", 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736235+0000", 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736237+0000", 2024-09-11T05:21:59.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736246+0000", 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1099999999999992e-06 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736252+0000", 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.293e-06 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.310 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37388 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699019+0000", 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037861168000000001, 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044276482999999998, 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.311 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37388 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699019+0000", 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699019+0000", 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699019+0000", 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699022+0000", 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699028+0000", 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0689999999999998e-06 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699032+0000", 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37420 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699764+0000", 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037116009999999998, 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043588425, 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37420 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699764+0000", 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699764+0000", 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699765+0000", 2024-09-11T05:21:59.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.08e-07 2024-09-11T05:21:59.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699767+0000", 2024-09-11T05:21:59.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:21:59.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699772+0000", 2024-09-11T05:21:59.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3990000000000003e-06 2024-09-11T05:21:59.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699776+0000", 2024-09-11T05:21:59.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8550000000000004e-06 2024-09-11T05:21:59.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.321 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37452 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.321 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.708178+0000", 2024-09-11T05:21:59.321 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.028702360999999999, 2024-09-11T05:21:59.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035227889999999998, 2024-09-11T05:21:59.322 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.322 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.322 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37452 2024-09-11T05:21:59.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708178+0000", 2024-09-11T05:21:59.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708178+0000", 2024-09-11T05:21:59.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708178+0000", 2024-09-11T05:21:59.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6100000000000001e-07 2024-09-11T05:21:59.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708181+0000", 2024-09-11T05:21:59.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:21:59.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708194+0000", 2024-09-11T05:21:59.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2337999999999999e-05 2024-09-11T05:21:59.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708224+0000", 2024-09-11T05:21:59.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0000000000000001e-05 2024-09-11T05:21:59.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.328 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.329 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.329 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37660 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.329 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.717963+0000", 2024-09-11T05:21:59.329 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018917364999999998, 2024-09-11T05:21:59.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025484538000000001, 2024-09-11T05:21:59.330 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.330 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.330 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.330 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.331 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37660 2024-09-11T05:21:59.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.331 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717963+0000", 2024-09-11T05:21:59.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717963+0000", 2024-09-11T05:21:59.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717963+0000", 2024-09-11T05:21:59.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4099999999999999e-07 2024-09-11T05:21:59.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717966+0000", 2024-09-11T05:21:59.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4150000000000002e-06 2024-09-11T05:21:59.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717974+0000", 2024-09-11T05:21:59.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0819999999999999e-06 2024-09-11T05:21:59.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717979+0000", 2024-09-11T05:21:59.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2349999999999999e-06 2024-09-11T05:21:59.337 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.337 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.337 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.338 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37692 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.338 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.723961+0000", 2024-09-11T05:21:59.338 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012919249000000001, 2024-09-11T05:21:59.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019514856000000001, 2024-09-11T05:21:59.338 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.338 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.339 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.339 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37692 2024-09-11T05:21:59.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.340 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723961+0000", 2024-09-11T05:21:59.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723961+0000", 2024-09-11T05:21:59.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723962+0000", 2024-09-11T05:21:59.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:21:59.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723964+0000", 2024-09-11T05:21:59.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5550000000000001e-06 2024-09-11T05:21:59.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723976+0000", 2024-09-11T05:21:59.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1443999999999999e-05 2024-09-11T05:21:59.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723982+0000", 2024-09-11T05:21:59.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:21:59.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.346 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.346 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37724 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730098+0000", 2024-09-11T05:21:59.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067826900000000001, 2024-09-11T05:21:59.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013408629, 2024-09-11T05:21:59.347 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.347 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.347 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.348 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37724 2024-09-11T05:21:59.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730098+0000", 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730098+0000", 2024-09-11T05:21:59.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730098+0000", 2024-09-11T05:21:59.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:21:59.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730100+0000", 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0229999999999999e-06 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730112+0000", 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2403e-05 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730118+0000", 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5770000000000001e-06 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37928 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736259+0000", 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00062168300000000004, 2024-09-11T05:21:59.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0072825549999999996, 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37928 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736259+0000", 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736259+0000", 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736259+0000", 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.34e-07 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736261+0000", 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2910000000000002e-06 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736268+0000", 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7499999999999997e-06 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736273+0000", 2024-09-11T05:21:59.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9989999999999999e-06 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37389 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699037+0000", 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037843217999999998, 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044549454000000002, 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.356 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37389 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699037+0000", 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699037+0000", 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699037+0000", 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699039+0000", 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:21:59.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699045+0000", 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7950000000000004e-06 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699050+0000", 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.977e-06 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37421 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699781+0000", 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037099021000000003, 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.043862271000000001, 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37421 2024-09-11T05:21:59.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699781+0000", 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699781+0000", 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699782+0000", 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699783+0000", 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.734e-06 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699790+0000", 2024-09-11T05:21:59.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4790000000000001e-06 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699794+0000", 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6319999999999999e-06 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37453 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.363 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.708235+0000", 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.028645717000000001, 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035461917000000003, 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.364 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37453 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708235+0000", 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708235+0000", 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708235+0000", 2024-09-11T05:21:59.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708238+0000", 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8569999999999999e-06 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708250+0000", 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.171e-05 2024-09-11T05:21:59.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708255+0000", 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7649999999999999e-06 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37661 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.717987+0000", 2024-09-11T05:21:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018893154999999998, 2024-09-11T05:21:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025765993000000001, 2024-09-11T05:21:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37661 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717987+0000", 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717987+0000", 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717988+0000", 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717990+0000", 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.385e-06 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.717999+0000", 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4749999999999993e-06 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718004+0000", 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37693 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.723990+0000", 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012890449, 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019801600999999999, 2024-09-11T05:21:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37693 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723990+0000", 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723990+0000", 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723990+0000", 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.723993+0000", 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4339999999999999e-06 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724001+0000", 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2039999999999997e-06 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724006+0000", 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3120000000000001e-06 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37725 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730125+0000", 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067549469999999999, 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013696341000000001, 2024-09-11T05:21:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37725 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730125+0000", 2024-09-11T05:21:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730125+0000", 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730126+0000", 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7700000000000005e-07 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730128+0000", 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4049999999999998e-06 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730135+0000", 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7649999999999996e-06 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730140+0000", 2024-09-11T05:21:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0950000000000003e-06 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37929 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736279+0000", 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00060122300000000001, 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075700389999999998, 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37929 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736279+0000", 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736279+0000", 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736279+0000", 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736282+0000", 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0810000000000001e-06 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736288+0000", 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736293+0000", 2024-09-11T05:21:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6759999999999998e-06 2024-09-11T05:21:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37390 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699094+0000", 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037786334999999997, 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044789508999999998, 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37390 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699094+0000", 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699094+0000", 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699094+0000", 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0299999999999999e-07 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699097+0000", 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699104+0000", 2024-09-11T05:21:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699109+0000", 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3449999999999996e-06 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37422 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699800+0000", 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037080555000000001, 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044136991, 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37422 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699800+0000", 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699800+0000", 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699800+0000", 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699802+0000", 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699809+0000", 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6460000000000004e-06 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699813+0000", 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9430000000000002e-06 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37454 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.708263+0000", 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.028616895999999999, 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035704079999999999, 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37454 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708263+0000", 2024-09-11T05:21:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.708263+0000", 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709944+0000", 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016808350000000001 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709949+0000", 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5879999999999999e-06 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709961+0000", 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2490999999999999e-05 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709969+0000", 2024-09-11T05:21:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5270000000000001e-06 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37662 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.718018+0000", 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018862778, 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025978169999999998, 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37662 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718018+0000", 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718018+0000", 2024-09-11T05:21:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718018+0000", 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5000000000000003e-07 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718020+0000", 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1229999999999998e-06 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718027+0000", 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0859999999999996e-06 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718032+0000", 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37694 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.724013+0000", 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012867109999999999, 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020012321, 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37694 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724013+0000", 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724013+0000", 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724014+0000", 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0400000000000002e-07 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724016+0000", 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2589999999999999e-06 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724022+0000", 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0209999999999996e-06 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724026+0000", 2024-09-11T05:21:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5059999999999997e-06 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37726 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730158+0000", 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0067219549999999999, 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013897028000000001, 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37726 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730158+0000", 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730158+0000", 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730159+0000", 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.06e-07 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730166+0000", 2024-09-11T05:21:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730174+0000", 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8679999999999999e-06 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730182+0000", 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1720000000000007e-06 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37930 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736306+0000", 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00057410299999999996, 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078007629999999996, 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37930 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736306+0000", 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736306+0000", 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736307+0000", 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9599999999999999e-07 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736309+0000", 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7039999999999999e-06 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736317+0000", 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6389999999999992e-06 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736322+0000", 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3730000000000001e-06 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37391 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699116+0000", 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037764328999999999, 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045048327999999999, 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37391 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699116+0000", 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699116+0000", 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699117+0000", 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5499999999999998e-07 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699119+0000", 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.125e-06 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699126+0000", 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0480000000000001e-06 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699132+0000", 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6309999999999997e-06 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37423 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699822+0000", 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037058555999999999, 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044401681999999998, 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37423 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699822+0000", 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699822+0000", 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699822+0000", 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699824+0000", 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.26e-06 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699832+0000", 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7330000000000003e-06 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699837+0000", 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2100000000000001e-06 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37455 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.709982+0000", 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.026898110999999999, 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034297323999999997, 2024-09-11T05:21:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37455 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709982+0000", 2024-09-11T05:21:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709982+0000", 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709983+0000", 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4000000000000002e-07 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709985+0000", 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709993+0000", 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6920000000000002e-06 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.709999+0000", 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5929999999999996e-06 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37663 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.718039+0000", 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018841238999999999, 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026285381, 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37663 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718039+0000", 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718039+0000", 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718040+0000", 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.06e-07 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718041+0000", 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718048+0000", 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5060000000000001e-06 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718053+0000", 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9919999999999998e-06 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37695 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.724033+0000", 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.01284765, 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020321084999999999, 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37695 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724033+0000", 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724033+0000", 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724033+0000", 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724035+0000", 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.193e-06 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724041+0000", 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6670000000000001e-06 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724045+0000", 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37727 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730191+0000", 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0066895030000000003, 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014190260999999999, 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37727 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730191+0000", 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730191+0000", 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730191+0000", 2024-09-11T05:21:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730194+0000", 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730198+0000", 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5329999999999996e-06 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730201+0000", 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.01e-06 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37931 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736330+0000", 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00055057999999999995, 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0080802410000000002, 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37931 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736330+0000", 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736330+0000", 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736330+0000", 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736332+0000", 2024-09-11T05:21:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1749999999999999e-06 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736341+0000", 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9400000000000008e-06 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736346+0000", 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2050000000000001e-06 2024-09-11T05:21:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37392 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699141+0000", 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037739672000000002, 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045302396000000002, 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37392 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699141+0000", 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699141+0000", 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699141+0000", 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699143+0000", 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1280000000000002e-06 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699155+0000", 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2091e-05 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699162+0000", 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6490000000000002e-06 2024-09-11T05:21:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37424 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699843+0000", 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037036806999999998, 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044644079000000003, 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37424 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699843+0000", 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699843+0000", 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699844+0000", 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:21:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699846+0000", 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699853+0000", 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8970000000000002e-06 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699858+0000", 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7650000000000001e-06 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37456 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.710011+0000", 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.026869339999999999, 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034514088999999998, 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37456 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710011+0000", 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710011+0000", 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710011+0000", 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710014+0000", 2024-09-11T05:21:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8200000000000001e-06 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710021+0000", 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7920000000000004e-06 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710026+0000", 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0309999999999998e-06 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37664 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.718060+0000", 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018820711, 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026523169999999999, 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37664 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718060+0000", 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718060+0000", 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718060+0000", 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718062+0000", 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.216e-06 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718069+0000", 2024-09-11T05:21:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0639999999999996e-06 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718074+0000", 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37696 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.724051+0000", 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012829248999999999, 2024-09-11T05:21:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020588456000000002, 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37696 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724051+0000", 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724051+0000", 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724051+0000", 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9499999999999998e-07 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724053+0000", 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0099999999999998e-06 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724059+0000", 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7100000000000004e-06 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724064+0000", 2024-09-11T05:21:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8149999999999996e-06 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37728 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.730205+0000", 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0066751190000000002, 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014492990000000001, 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37728 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730205+0000", 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.730205+0000", 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731925+0000", 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017198479999999999 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731930+0000", 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6750000000000001e-06 2024-09-11T05:21:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731944+0000", 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4229e-05 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731952+0000", 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2849999999999995e-06 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.461 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37932 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736353+0000", 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000526985, 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0083955910000000009, 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37932 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736353+0000", 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736353+0000", 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736354+0000", 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-07 2024-09-11T05:21:59.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736356+0000", 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1660000000000001e-06 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736363+0000", 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.703e-06 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736368+0000", 2024-09-11T05:21:59.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:21:59.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.466 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.466 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37393 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.467 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699169+0000", 2024-09-11T05:21:59.467 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037711664999999998, 2024-09-11T05:21:59.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045616644999999997, 2024-09-11T05:21:59.467 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.467 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.467 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.468 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37393 2024-09-11T05:21:59.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.468 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699169+0000", 2024-09-11T05:21:59.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699169+0000", 2024-09-11T05:21:59.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699169+0000", 2024-09-11T05:21:59.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:21:59.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699171+0000", 2024-09-11T05:21:59.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.995e-06 2024-09-11T05:21:59.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699177+0000", 2024-09-11T05:21:59.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1480000000000003e-06 2024-09-11T05:21:59.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699182+0000", 2024-09-11T05:21:59.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9339999999999997e-06 2024-09-11T05:21:59.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37425 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699866+0000", 2024-09-11T05:21:59.475 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037014644999999999, 2024-09-11T05:21:59.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044967728999999998, 2024-09-11T05:21:59.475 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.475 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37425 2024-09-11T05:21:59.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699866+0000", 2024-09-11T05:21:59.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699866+0000", 2024-09-11T05:21:59.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699866+0000", 2024-09-11T05:21:59.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:21:59.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699868+0000", 2024-09-11T05:21:59.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.289e-06 2024-09-11T05:21:59.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699876+0000", 2024-09-11T05:21:59.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4699999999999996e-06 2024-09-11T05:21:59.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699880+0000", 2024-09-11T05:21:59.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6999999999999999e-06 2024-09-11T05:21:59.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37457 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.710033+0000", 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.026847112999999999, 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034840570000000001, 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.482 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37457 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710033+0000", 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710033+0000", 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710034+0000", 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.27e-07 2024-09-11T05:21:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710036+0000", 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.576e-06 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710043+0000", 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5690000000000001e-06 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710048+0000", 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1080000000000001e-06 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37665 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.486 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.718081+0000", 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018799105, 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026849693000000001, 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37665 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718081+0000", 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718081+0000", 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718082+0000", 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718084+0000", 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1619999999999998e-06 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718091+0000", 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1509999999999998e-06 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718096+0000", 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0880000000000002e-06 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.489 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37697 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.724070+0000", 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.012810546000000001, 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020918239000000002, 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37697 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724070+0000", 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724070+0000", 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724070+0000", 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:21:59.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724072+0000", 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0379999999999998e-06 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724079+0000", 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9129999999999997e-06 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724083+0000", 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.301e-06 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37729 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.731977+0000", 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0049035249999999997, 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013064477999999999, 2024-09-11T05:21:59.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37729 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731977+0000", 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731977+0000", 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731977+0000", 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731980+0000", 2024-09-11T05:21:59.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7930000000000002e-06 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731988+0000", 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2039999999999997e-06 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.731994+0000", 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37933 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736399+0000", 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00048107, 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0086937500000000001, 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.498 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37933 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736399+0000", 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736399+0000", 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736400+0000", 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.99e-07 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736402+0000", 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736410+0000", 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4490000000000002e-06 2024-09-11T05:21:59.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736415+0000", 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5979999999999996e-06 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37394 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.501 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699196+0000", 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037683976000000001, 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045935128999999998, 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37394 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699196+0000", 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699196+0000", 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699197+0000", 2024-09-11T05:21:59.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699199+0000", 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2120000000000002e-06 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699208+0000", 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5669999999999995e-06 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699218+0000", 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0473e-05 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37426 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699887+0000", 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.036993267000000003, 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045287460000000002, 2024-09-11T05:21:59.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37426 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699887+0000", 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699887+0000", 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699887+0000", 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699890+0000", 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1210000000000001e-06 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699897+0000", 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699902+0000", 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.508 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37458 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.710054+0000", 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.026825921999999999, 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035151092000000002, 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.509 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37458 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710054+0000", 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.710054+0000", 2024-09-11T05:21:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711716+0000", 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016613380000000001 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711726+0000", 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.077e-05 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711751+0000", 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4189000000000002e-05 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711759+0000", 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.585e-06 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37666 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.718103+0000", 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018777507999999998, 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027130359999999999, 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37666 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.513 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718103+0000", 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718103+0000", 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718103+0000", 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718111+0000", 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2810000000000008e-06 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718120+0000", 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.867e-06 2024-09-11T05:21:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718126+0000", 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3059999999999997e-06 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37698 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.724089+0000", 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.01279113, 2024-09-11T05:21:59.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.021172528999999999, 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37698 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724089+0000", 2024-09-11T05:21:59.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.724089+0000", 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725925+0000", 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001835609 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725929+0000", 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.639e-06 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725941+0000", 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1691999999999999e-05 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725948+0000", 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.25e-06 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.519 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37902 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735621+0000", 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0012591620000000001, 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096674889999999996, 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.520 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37902 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735621+0000", 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735621+0000", 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735622+0000", 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0100000000000003e-07 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735627+0000", 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4800000000000003e-06 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735640+0000", 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3994e-05 2024-09-11T05:21:59.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735649+0000", 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5210000000000002e-06 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37934 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736422+0000", 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00045845400000000001, 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088970920000000005, 2024-09-11T05:21:59.523 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37934 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736422+0000", 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736422+0000", 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736422+0000", 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736424+0000", 2024-09-11T05:21:59.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736433+0000", 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736438+0000", 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:21:59.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37395 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699225+0000", 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037655574999999997, 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046144812, 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.527 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37395 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699225+0000", 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699225+0000", 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699225+0000", 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699227+0000", 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1380000000000001e-06 2024-09-11T05:21:59.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699233+0000", 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.874e-06 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699239+0000", 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0220000000000001e-06 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37427 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699910+0000", 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.036970562999999998, 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045517259999999997, 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37427 2024-09-11T05:21:59.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699910+0000", 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699910+0000", 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699910+0000", 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7500000000000001e-07 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699912+0000", 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2460000000000002e-06 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699924+0000", 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1956999999999999e-05 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699930+0000", 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.071e-06 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37459 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.711777+0000", 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.025103296000000001, 2024-09-11T05:21:59.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033703485999999998, 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37459 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711777+0000", 2024-09-11T05:21:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711777+0000", 2024-09-11T05:21:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711778+0000", 2024-09-11T05:21:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:21:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711781+0000", 2024-09-11T05:21:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:21:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711797+0000", 2024-09-11T05:21:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6296000000000001e-05 2024-09-11T05:21:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711803+0000", 2024-09-11T05:21:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3690000000000003e-06 2024-09-11T05:21:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37667 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.541 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.718133+0000", 2024-09-11T05:21:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018747466000000001, 2024-09-11T05:21:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027403510999999998, 2024-09-11T05:21:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.542 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37667 2024-09-11T05:21:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.543 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718133+0000", 2024-09-11T05:21:59.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718133+0000", 2024-09-11T05:21:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718133+0000", 2024-09-11T05:21:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:21:59.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718135+0000", 2024-09-11T05:21:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:21:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718142+0000", 2024-09-11T05:21:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7320000000000001e-06 2024-09-11T05:21:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718147+0000", 2024-09-11T05:21:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8380000000000001e-06 2024-09-11T05:21:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37699 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.725962+0000", 2024-09-11T05:21:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010918769, 2024-09-11T05:21:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019627706000000002, 2024-09-11T05:21:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.550 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37699 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725962+0000", 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725962+0000", 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725962+0000", 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725965+0000", 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6110000000000001e-06 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725972+0000", 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725979+0000", 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9199999999999998e-06 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37903 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735662+0000", 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001217868, 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0099841640000000002, 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37903 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735662+0000", 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735662+0000", 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735663+0000", 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4899999999999995e-07 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735666+0000", 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735673+0000", 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7649999999999993e-06 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735679+0000", 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6890000000000001e-06 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37935 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.736443+0000", 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00043685000000000002, 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092557049999999995, 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37935 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736443+0000", 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.736443+0000", 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737924+0000", 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014810240000000001 2024-09-11T05:21:59.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737929+0000", 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9250000000000003e-06 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737939+0000", 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4930000000000004e-06 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737947+0000", 2024-09-11T05:21:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5969999999999992e-06 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37396 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699245+0000", 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037635694999999997, 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046516413, 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.561 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37396 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699245+0000", 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699245+0000", 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699245+0000", 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699247+0000", 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0379999999999998e-06 2024-09-11T05:21:59.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699253+0000", 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2650000000000002e-06 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699258+0000", 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0869999999999997e-06 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.564 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37428 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699938+0000", 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.036942441999999999, 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.045878834, 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.565 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37428 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699938+0000", 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699938+0000", 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701926+0000", 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019882440000000001 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701930+0000", 2024-09-11T05:21:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3499999999999999e-06 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701942+0000", 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1365999999999999e-05 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701949+0000", 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0849999999999999e-06 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37460 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.711813+0000", 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.025067521999999998, 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034057305000000003, 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37460 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711813+0000", 2024-09-11T05:21:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711813+0000", 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711813+0000", 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9999999999999997e-07 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711816+0000", 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6579999999999998e-06 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711823+0000", 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3170000000000004e-06 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711828+0000", 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.707e-06 2024-09-11T05:21:59.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37668 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.718153+0000", 2024-09-11T05:21:59.576 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.018727192, 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027778183000000001, 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.577 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37668 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718153+0000", 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.718153+0000", 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719927+0000", 2024-09-11T05:21:59.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017737930000000001 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719932+0000", 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7770000000000002e-06 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719940+0000", 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3129999999999999e-06 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719945+0000", 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37700 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.725988+0000", 2024-09-11T05:21:59.581 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010892423, 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019997529, 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37700 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.582 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725988+0000", 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725988+0000", 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725988+0000", 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725991+0000", 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3140000000000002e-06 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.725998+0000", 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8110000000000003e-06 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726004+0000", 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2469999999999999e-06 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37904 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735687+0000", 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001193104, 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010352818999999999, 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37904 2024-09-11T05:21:59.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735687+0000", 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735687+0000", 2024-09-11T05:21:59.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735688+0000", 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735690+0000", 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1059999999999998e-06 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735696+0000", 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6250000000000001e-06 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735702+0000", 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37936 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.737989+0000", 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9988918, 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081027660000000008, 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37936 2024-09-11T05:21:59.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737989+0000", 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737989+0000", 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737989+0000", 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3200000000000005e-07 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737992+0000", 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:21:59.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.737999+0000", 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2590000000000003e-06 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738005+0000", 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.699e-06 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.593 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37397 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699265+0000", 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037615672000000003, 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.046885441, 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37397 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699265+0000", 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699265+0000", 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699265+0000", 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699267+0000", 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.131e-06 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699273+0000", 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699278+0000", 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6240000000000001e-06 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37429 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.701961+0000", 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.034919178000000002, 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044239702999999998, 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37429 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701961+0000", 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701961+0000", 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701962+0000", 2024-09-11T05:21:59.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1200000000000003e-07 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701964+0000", 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6000000000000001e-06 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701972+0000", 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6790000000000005e-06 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701977+0000", 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5489999999999997e-06 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37461 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.711836+0000", 2024-09-11T05:21:59.601 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.025044482, 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034421905000000003, 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37461 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711836+0000", 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711836+0000", 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711836+0000", 2024-09-11T05:21:59.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5000000000000003e-07 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711839+0000", 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.48e-06 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711845+0000", 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.066e-06 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711849+0000", 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4830000000000001e-06 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37669 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.719954+0000", 2024-09-11T05:21:59.605 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016925827000000001, 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026352823000000001, 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37669 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719954+0000", 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719954+0000", 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719955+0000", 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:21:59.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719957+0000", 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.849e-06 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719960+0000", 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.642e-06 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719964+0000", 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3330000000000001e-06 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37701 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726012+0000", 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010868466, 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020350579000000001, 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.609 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37701 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726012+0000", 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726012+0000", 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726012+0000", 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726014+0000", 2024-09-11T05:21:59.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.272e-06 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726022+0000", 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2969999999999998e-06 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726028+0000", 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9209999999999997e-06 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37905 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735708+0000", 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001171811, 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010704461, 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.613 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37905 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735708+0000", 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735708+0000", 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735709+0000", 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2300000000000002e-07 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735711+0000", 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2500000000000001e-06 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735719+0000", 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2230000000000007e-06 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735725+0000", 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1760000000000001e-06 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37937 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.738012+0000", 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9988689, 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084581420000000001, 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37937 2024-09-11T05:21:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738012+0000", 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738012+0000", 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738012+0000", 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738014+0000", 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9439999999999999e-06 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738020+0000", 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.976e-06 2024-09-11T05:21:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738028+0000", 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2519999999999999e-06 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37398 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699282+0000", 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037597932000000001, 2024-09-11T05:21:59.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047245127999999997, 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37398 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699282+0000", 2024-09-11T05:21:59.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699282+0000", 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699283+0000", 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699285+0000", 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699291+0000", 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8930000000000002e-06 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699295+0000", 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.566e-06 2024-09-11T05:21:59.623 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37430 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.701985+0000", 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.034895039000000003, 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044601114999999997, 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.624 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37430 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701985+0000", 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701985+0000", 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701986+0000", 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701988+0000", 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.075e-06 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.701996+0000", 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4649999999999994e-06 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702001+0000", 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2399999999999998e-06 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37462 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.711857+0000", 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.025023734999999998, 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034784411000000001, 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37462 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711857+0000", 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711857+0000", 2024-09-11T05:21:59.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711857+0000", 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0800000000000005e-07 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711859+0000", 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2730000000000001e-06 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711866+0000", 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711871+0000", 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.933e-06 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37670 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.719990+0000", 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016890458000000001, 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026707444, 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37670 2024-09-11T05:21:59.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719990+0000", 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719990+0000", 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719990+0000", 2024-09-11T05:21:59.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3799999999999997e-07 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719993+0000", 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2680000000000001e-06 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.719999+0000", 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9800000000000003e-06 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720003+0000", 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8829999999999997e-06 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37702 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726034+0000", 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010845841, 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020717669000000001, 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.635 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37702 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726034+0000", 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726034+0000", 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726035+0000", 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726042+0000", 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5869999999999998e-06 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726048+0000", 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.742e-06 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726053+0000", 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8380000000000001e-06 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37906 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735731+0000", 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0011490230000000001, 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011075936999999999, 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37906 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735731+0000", 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735731+0000", 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735732+0000", 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735738+0000", 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.776e-06 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735746+0000", 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1230000000000002e-06 2024-09-11T05:21:59.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735751+0000", 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.164e-06 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37938 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.738034+0000", 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9988461, 2024-09-11T05:21:59.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0088191840000000007, 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37938 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738034+0000", 2024-09-11T05:21:59.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738034+0000", 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738035+0000", 2024-09-11T05:21:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:21:59.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738037+0000", 2024-09-11T05:21:59.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9829999999999999e-06 2024-09-11T05:21:59.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738043+0000", 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9850000000000003e-06 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738048+0000", 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6280000000000002e-06 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37399 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.699301+0000", 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.037578802000000001, 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.047581519000000003, 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37399 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699301+0000", 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699301+0000", 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699302+0000", 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699309+0000", 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699316+0000", 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7719999999999997e-06 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.699321+0000", 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1900000000000003e-06 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37431 3.16 3.927d6796 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.702009+0000", 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.034871428000000003, 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044903601000000001, 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.650 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37431 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702009+0000", 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702009+0000", 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702009+0000", 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8999999999999997e-07 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702012+0000", 2024-09-11T05:21:59.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702018+0000", 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.702023+0000", 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8919999999999999e-06 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37463 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.711877+0000", 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.025003082999999999, 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035072245000000002, 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.654 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37463 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711877+0000", 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.711877+0000", 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712035+0000", 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015774699999999999 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712039+0000", 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0160000000000002e-06 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712049+0000", 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.815e-06 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.712055+0000", 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2990000000000002e-06 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37671 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.657 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.720010+0000", 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.016869935999999999, 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026990465000000002, 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37671 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720010+0000", 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720010+0000", 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720011+0000", 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.58e-07 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720013+0000", 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9369999999999998e-06 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720019+0000", 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9120000000000003e-06 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.720024+0000", 2024-09-11T05:21:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9830000000000004e-06 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37703 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.726279+0000", 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.010601253, 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.020776341, 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37703 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726279+0000", 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726279+0000", 2024-09-11T05:21:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726280+0000", 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726282+0000", 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6560000000000001e-06 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726290+0000", 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4800000000000004e-06 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.726295+0000", 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3619999999999997e-06 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37907 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.735757+0000", 2024-09-11T05:21:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00112294, 2024-09-11T05:21:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011356068, 2024-09-11T05:21:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37907 2024-09-11T05:21:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735757+0000", 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735757+0000", 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735758+0000", 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735760+0000", 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9829999999999999e-06 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735766+0000", 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9970000000000004e-06 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.735771+0000", 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2780000000000001e-06 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37939 3.16 3.927d6796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.738054+0000", 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4294967295.9988265, 2024-09-11T05:21:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0091139789999999995, 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "queued for pg", 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37939 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738054+0000", 2024-09-11T05:21:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738054+0000", 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738054+0000", 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9700000000000002e-07 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738056+0000", 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8810000000000001e-06 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738065+0000", 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4030000000000007e-06 2024-09-11T05:21:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.738070+0000", 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0549999999999999e-06 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-11T05:21:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 232 2024-09-11T05:21:59.677 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:59.677 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:21:59.677 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:21:59.677 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:21:59.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 6 2024-09-11T05:21:59.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:21:59.681 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:21:59.681 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:21:59.682 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:21:59.679+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:21:59.781 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:21:59.780+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:21:59.869 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:21:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:21:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:21:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:21:59.870 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:21:59.881 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:21:59.882 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:21:59.880+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:21:59.910 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:21:59.910 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:21:59.940 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:21:59.941 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:21:59.965 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:21:59.966 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:21:59.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:21:59.982+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:21:59.989 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:21:59.989 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:00.017 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:00.017 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:00.042 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:00.045 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.045 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:00.060 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:00.060 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:00.077 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:00.077 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:00.082 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:00.083+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:00.141 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:22:00.141+0000 7f4182606640 -1 mon.a@0(leader).osd e36 definitely_dead 0 2024-09-11T05:22:00.159 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.159 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.166 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-11T05:22:00.168 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:00.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:00.184+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:00.275 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.275 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:00.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:00.286+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:00.387 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:00.386+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:00.387 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.387 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:00.411 INFO:teuthology.orchestra.run.smithi012.stdout:830 read 0xb267ba8 thru 0xb26e8e2 (0x6d3b bytes) 2024-09-11T05:22:00.413 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:00.413 INFO:teuthology.orchestra.run.smithi012.stdout:832 read 0x9b4e6fd thru 0x9b4f85a (0x115e bytes) 2024-09-11T05:22:00.426 INFO:teuthology.orchestra.run.smithi012.stdout:833 write 0xe56f1bb thru 0xe57a4ea (0xb330 bytes) 2024-09-11T05:22:00.429 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:00.429 INFO:teuthology.orchestra.run.smithi012.stdout:837 write 0xe510aab thru 0xe51b5ad (0xab03 bytes) 2024-09-11T05:22:00.430 INFO:teuthology.orchestra.run.smithi012.stdout:838 writesame 0xd70c832 thru 0xd718812 data_size 0x1(0xbfe1 bytes) 2024-09-11T05:22:00.457 INFO:teuthology.orchestra.run.smithi012.stdout:840 read 0xa4077ba thru 0xa40fb9c (0x83e3 bytes) 2024-09-11T05:22:00.457 INFO:teuthology.orchestra.run.smithi012.stdout:841 punch from 0x3125724 to 0x312e175, (0x8a51 bytes) 2024-09-11T05:22:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:842 trunc from 0xe57a4eb to 0x1dfb87c 2024-09-11T05:22:00.475 INFO:teuthology.orchestra.run.smithi012.stderr:marked out osd.6. 2024-09-11T05:22:00.489 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:00.489+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:00.501 INFO:teuthology.orchestra.run.smithi012.stdout:844 write 0x3d3fc6f thru 0x3d4f2fe (0xf690 bytes) 2024-09-11T05:22:00.507 INFO:teuthology.orchestra.run.smithi012.stdout:845 write 0x8abde0 thru 0x8ba6c8 (0xe8e9 bytes) 2024-09-11T05:22:00.543 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.544 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.552 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:00.596 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:00.596+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:00.655 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.655 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:00.692 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:00.691+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:00.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:00.792+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:00.806 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.806 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:00.896 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:00.893+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:00.924 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:00.924 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:00.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:01.018 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:01.018+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:01.080 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:01.081 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:01.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:01.130 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:01.130+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:01.196 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:01.196+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:01.236 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:01.236 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:01.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:01.297 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:01.297+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:01.353 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:01.353 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:01.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:01.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:01.402+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:01.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:01.499+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:01.516 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.520 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:01.520 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:01.533 INFO:teuthology.orchestra.run.smithi012.stdout:847 write 0xc1634a1 thru 0xc17221c (0xed7c bytes) 2024-09-11T05:22:01.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:01.538 INFO:teuthology.orchestra.run.smithi012.stdout:848 read 0xc067c90 thru 0xc06c6be (0x4a2f bytes) 2024-09-11T05:22:01.538 INFO:teuthology.orchestra.run.smithi012.stdout:850 write 0xadfea0b thru 0xae0232e (0x3924 bytes) 2024-09-11T05:22:01.545 INFO:teuthology.orchestra.run.smithi012.stdout:851 read 0x4a023ac thru 0x4a0ced5 (0xab2a bytes) 2024-09-11T05:22:01.555 INFO:teuthology.orchestra.run.smithi012.stdout:852 trunc from 0xc17221d to 0x45961b2 2024-09-11T05:22:01.571 INFO:teuthology.orchestra.run.smithi012.stdout:853 read 0x305aa08 thru 0x306a1ef (0xf7e8 bytes) 2024-09-11T05:22:01.571 INFO:teuthology.orchestra.run.smithi012.stdout:854 read 0x14310d3 thru 0x1440c09 (0xfb37 bytes) 2024-09-11T05:22:01.584 INFO:teuthology.orchestra.run.smithi012.stdout:855 writesame 0x8c70784 thru 0x8c72d50 data_size 0x1(0x25cd bytes) 2024-09-11T05:22:01.584 INFO:teuthology.orchestra.run.smithi012.stdout:857 write 0x17b77fc thru 0x17c718f (0xf994 bytes) 2024-09-11T05:22:01.598 INFO:teuthology.orchestra.run.smithi012.stdout:858 trunc from 0x8c72d51 to 0x2ddec40 2024-09-11T05:22:01.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:01.600+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:01.619 INFO:teuthology.orchestra.run.smithi012.stdout:859 writesame 0x7b249da thru 0x7b25409 data_size 0x8(0xa30 bytes) 2024-09-11T05:22:01.619 INFO:teuthology.orchestra.run.smithi012.stdout:861 read 0x1a5f044 thru 0x1a5f5ed (0x5aa bytes) 2024-09-11T05:22:01.619 INFO:teuthology.orchestra.run.smithi012.stdout:862 punch from 0x67d5baa to 0x67e2936, (0xcd8c bytes) 2024-09-11T05:22:01.626 INFO:teuthology.orchestra.run.smithi012.stdout:863 trunc from 0x7b2540a to 0x1b67e40 2024-09-11T05:22:01.657 INFO:teuthology.orchestra.run.smithi012.stdout:864 write 0xc309873 thru 0xc31969f (0xfe2d bytes) 2024-09-11T05:22:01.660 INFO:teuthology.orchestra.run.smithi012.stdout:866 read 0xae9793e thru 0xae9e2e7 (0x69aa bytes) 2024-09-11T05:22:01.660 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.660 INFO:teuthology.orchestra.run.smithi012.stdout:868 read 0x888a9aa thru 0x8891e4f (0x74a6 bytes) 2024-09-11T05:22:01.660 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.660 INFO:teuthology.orchestra.run.smithi012.stdout:870 write 0x5e5582b thru 0x5e5da65 (0x823b bytes) 2024-09-11T05:22:01.663 INFO:teuthology.orchestra.run.smithi012.stdout:871 writesame 0x9414bf8 thru 0x9415f09 data_size 0x1(0x1312 bytes) 2024-09-11T05:22:01.667 INFO:teuthology.orchestra.run.smithi012.stdout:872 writesame 0x739e796 thru 0x73a45df data_size 0x51(0x5e4a bytes) 2024-09-11T05:22:01.670 INFO:teuthology.orchestra.run.smithi012.stdout:873 read 0xbb7abe4 thru 0xbb7d17c (0x2599 bytes) 2024-09-11T05:22:01.673 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:01.673 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:01.674 INFO:teuthology.orchestra.run.smithi012.stdout:874 trunc from 0xc3196a0 to 0x8d53e8e 2024-09-11T05:22:01.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:22:01.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:01.685 INFO:teuthology.orchestra.run.smithi012.stdout:876 write 0x3bbe8cf thru 0x3bc2948 (0x407a bytes) 2024-09-11T05:22:01.687 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.687 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.687 INFO:teuthology.orchestra.run.smithi012.stdout:881 read 0x1462af8 thru 0x1471090 (0xe599 bytes) 2024-09-11T05:22:01.689 INFO:teuthology.orchestra.run.smithi012.stdout:883 write 0x55dd289 thru 0x55ecb60 (0xf8d8 bytes) 2024-09-11T05:22:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:885 writesame 0x358b089 thru 0x358b76e data_size 0x1(0x6e6 bytes) 2024-09-11T05:22:01.695 INFO:teuthology.orchestra.run.smithi012.stdout:886 punch from 0x59d7848 to 0x59da9f2, (0x31aa bytes) 2024-09-11T05:22:01.695 INFO:teuthology.orchestra.run.smithi012.stdout:887 write 0x21ba30c thru 0x21bcf34 (0x2c29 bytes) 2024-09-11T05:22:01.700 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:01.701+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:01.705 INFO:teuthology.orchestra.run.smithi012.stdout:891 writesame 0x9111512 thru 0x9116465 data_size 0x2(0x4f54 bytes) 2024-09-11T05:22:01.705 INFO:teuthology.orchestra.run.smithi012.stdout:893 writesame 0x3a20795 thru 0x3a29d6b data_size 0x1(0x95d7 bytes) 2024-09-11T05:22:01.725 INFO:teuthology.orchestra.run.smithi012.stdout:894 punch from 0x6d7a106 to 0x6d8091a, (0x6814 bytes) 2024-09-11T05:22:01.725 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.736 INFO:teuthology.orchestra.run.smithi012.stdout:897 write 0xe4bcddf thru 0xe4ca250 (0xd472 bytes) 2024-09-11T05:22:01.739 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.739 INFO:teuthology.orchestra.run.smithi012.stdout:899 read 0x1f4094c thru 0x1f41217 (0x8cc bytes) 2024-09-11T05:22:01.739 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.739 INFO:teuthology.orchestra.run.smithi012.stdout:901 writesame 0x91096dc thru 0x910b20e data_size 0xb(0x1b33 bytes) 2024-09-11T05:22:01.742 INFO:teuthology.orchestra.run.smithi012.stdout:902 read 0xa490cb5 thru 0xa49cc67 (0xbfb3 bytes) 2024-09-11T05:22:01.742 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.742 INFO:teuthology.orchestra.run.smithi012.stdout:904 punch from 0x8582d5d to 0x858b5c9, (0x886c bytes) 2024-09-11T05:22:01.754 INFO:teuthology.orchestra.run.smithi012.stdout:905 trunc from 0xe4ca251 to 0x3bd590c 2024-09-11T05:22:01.767 INFO:teuthology.orchestra.run.smithi012.stdout:906 read 0x24f9640 thru 0x2504438 (0xadf9 bytes) 2024-09-11T05:22:01.767 INFO:teuthology.orchestra.run.smithi012.stdout:907 read 0x39cceb3 thru 0x39dcc28 (0xfd76 bytes) 2024-09-11T05:22:01.767 INFO:teuthology.orchestra.run.smithi012.stdout:908 punch from 0x1b72e35 to 0x1b7e0ae, (0xb279 bytes) 2024-09-11T05:22:01.775 INFO:teuthology.orchestra.run.smithi012.stdout:909 write 0x4f18801 thru 0x4f1ee1c (0x661c bytes) 2024-09-11T05:22:01.787 INFO:teuthology.orchestra.run.smithi012.stdout:910 write 0x7a58cf0 thru 0x7a62c7e (0x9f8f bytes) 2024-09-11T05:22:01.789 INFO:teuthology.orchestra.run.smithi012.stdout:911 write 0x2adcb3a thru 0x2ae359f (0x6a66 bytes) 2024-09-11T05:22:01.793 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.793 INFO:teuthology.orchestra.run.smithi012.stdout:913 punch from 0x201d42d to 0x20243f6, (0x6fc9 bytes) 2024-09-11T05:22:01.793 INFO:teuthology.orchestra.run.smithi012.stdout:914 punch from 0x36773f4 to 0x3682262, (0xae6e bytes) 2024-09-11T05:22:01.796 INFO:teuthology.orchestra.run.smithi012.stdout:917 trunc from 0x7a62c7f to 0x41f3960 2024-09-11T05:22:01.801 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:01.801+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:01.806 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:01.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:01.810 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:01.815 INFO:teuthology.orchestra.run.smithi012.stdout:919 trunc from 0x41f3960 to 0xb108845 2024-09-11T05:22:01.820 INFO:teuthology.orchestra.run.smithi012.stdout:920 write 0x3baa884 thru 0x3bac48c (0x1c09 bytes) 2024-09-11T05:22:01.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:01.832 INFO:teuthology.orchestra.run.smithi012.stdout:921 trunc from 0xb108845 to 0x20e2b6a 2024-09-11T05:22:01.844 INFO:teuthology.orchestra.run.smithi012.stdout:922 read 0x136f618 thru 0x13799e5 (0xa3ce bytes) 2024-09-11T05:22:01.853 INFO:teuthology.orchestra.run.smithi012.stdout:923 writesame 0x46cc409 thru 0x46d1edb data_size 0x1(0x5ad3 bytes) 2024-09-11T05:22:01.872 INFO:teuthology.orchestra.run.smithi012.stdout:924 writesame 0xe49d1f1 thru 0xe4a7f7c data_size 0x3a(0xad8c bytes) 2024-09-11T05:22:01.872 INFO:teuthology.orchestra.run.smithi012.stdout:926 writesame 0x7652d29 thru 0x765e27e data_size 0x9(0xb556 bytes) 2024-09-11T05:22:01.877 INFO:teuthology.orchestra.run.smithi012.stdout:931 write 0xdee977b thru 0xdef22f0 (0x8b76 bytes) 2024-09-11T05:22:01.879 INFO:teuthology.orchestra.run.smithi012.stdout:933 write 0x6fbb1ea thru 0x6fbd17e (0x1f95 bytes) 2024-09-11T05:22:01.882 INFO:teuthology.orchestra.run.smithi012.stdout:934 clone 9 order 19 su 262144 sc 2 2024-09-11T05:22:01.902 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:01.902+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:01.949 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:01.949 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:01.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:02.003 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:02.003+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:02.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:02.105 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:02.105 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:02.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:02.105+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:02.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:02.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:02.206+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:02.216 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:02.216 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:02.235 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:02.235 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:02.252 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:02.253 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:02.266 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:02.266 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:02.269 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:02.269 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:02.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:02.287 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:02.304 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:02.305 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:02.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:02.307+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:02.322 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:02.322 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:02.339 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:02.339 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:02.395 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:02.396 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:02.396 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:02.396 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:02.396 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:02.404 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:02.407 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:02.407+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:02.499 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:22:02.508 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:02.508+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7768206319999997, 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:02.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7768087440000002, 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:02.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:02.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:02.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:02.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:02.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7767715239999999, 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:02.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.538 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.776756743, 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:02.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.543 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7767454069999999, 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:02.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7755946059999999, 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:02.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:02.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7755801509999998, 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:02.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:02.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.775569671, 2024-09-11T05:22:02.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:02.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7755592039999999, 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:02.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.775540844, 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:02.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:02.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.772831772, 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.572 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:02.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.576 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7728087719999999, 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:02.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7727874090000002, 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:02.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7727658900000001, 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.586 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:02.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7727449630000001, 2024-09-11T05:22:02.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:02.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.594 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7709115390000001, 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:02.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:02.599 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7709012259999999, 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:02.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.603 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.770890853, 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:02.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.770875824, 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:02.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.7708658160000001, 2024-09-11T05:22:02.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:02.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:02.616 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:02.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:02.618 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone8 from 0xe4a7f7d (overlap 0x1b67e40) to 0x57b2d9 2024-09-11T05:22:02.619 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:02.617+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:02.667 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-11T05:22:02.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:02.719+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:02.730 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:02.730 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:02.730 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:02.731 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:02.740 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:02.820 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:02.820+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:02.843 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:02.843 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:02.843 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:02.843 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:02.843 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:02.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:02.916 INFO:teuthology.orchestra.run.smithi012.stdout:936 clone 10 order 22 su 1048576 sc 4 2024-09-11T05:22:02.935 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:02.935+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:02.997 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36838 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3633518430000002, 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059077179, 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36838 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632957+0000", 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632959+0000", 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1390000000000002e-06 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632966+0000", 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8990000000000004e-06 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632977+0000", 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1574e-05 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689825+0000", 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.056847555000000001 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689904+0000", 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9449000000000005e-05 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692033+0000", 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021291130000000002 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3633211139999997, 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36845 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1921024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3611998219999997, 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059196066999999998, 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36845 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635109+0000", 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635111+0000", 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4380000000000002e-06 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635117+0000", 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.161e-06 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635122+0000", 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.831e-06 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694031+0000", 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058908380000000003 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694099+0000", 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8046000000000005e-05 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694304+0000", 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000205749 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3611795930000001, 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:03.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.016 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3611580290000003, 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.017 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:03.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3611440180000001, 2024-09-11T05:22:03.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:03.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36851 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1994752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3593293280000003, 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059218845999999999, 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36851 2024-09-11T05:22:03.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636980+0000", 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9600000000000008e-07 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636984+0000", 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000004e-06 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636986+0000", 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6029999999999999e-06 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695889+0000", 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058902788999999997 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695961+0000", 2024-09-11T05:22:03.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1365999999999994e-05 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696198+0000", 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023703299999999999 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:03.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3593187169999998, 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.034 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3593041140000004, 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.035 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:03.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.039 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3592868090000003, 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3592627000000004, 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3592346239999999, 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3592076320000004, 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3591670730000001, 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3591436860000004, 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37893 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3084288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2631818590000004, 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058980038999999998, 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37893 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733127+0000", 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1699999999999998e-07 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733129+0000", 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4449999999999999e-06 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733138+0000", 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3850000000000002e-06 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733143+0000", 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3310000000000003e-06 2024-09-11T05:22:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791800+0000", 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058656610999999997 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791877+0000", 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7525000000000001e-05 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792106+0000", 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000229125 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2631585789999997, 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2631390189999996, 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2631198040000005, 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.2630990039999999, 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.089 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.089 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.089 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:03.090 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:03.091 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:03.090+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:03.191 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:03.191+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:03.235 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:03.235 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:03.235 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:03.235 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:03.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:03.292 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:03.292+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:03.347 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:03.347 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:03.347 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:03.347 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:03.347 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:03.355 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:03.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:03.393+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:03.461 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8637025459999998, 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8634750499999999, 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8632202360000001, 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8628513409999998, 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8626897949999996, 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8622470599999996, 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8601001669999997, 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8580696149999998, 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.8580492299999998, 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6408654250000003, 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6408444009999998, 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6408201460000003, 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6391410620000002, 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.639121716, 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6391009439999999, 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6390815339999998, 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6390610649999999, 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6390421750000002, 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6297043819999999, 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6296935560000003, 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.553 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:03.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:03.555 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:03.555+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:03.565 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone9 from 0xe4a7f7d (overlap 0xe4a7f7d) to 0x0 2024-09-11T05:22:03.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:03.655+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:03.693 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:03.693 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:03.693 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:03.693 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:03.705 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:03.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:03.756+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:03.848 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:03.848 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:03.848 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:03.848 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:03.848 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:03.857 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:03.857+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:03.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:03.936 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-11T05:22:03.951 INFO:teuthology.orchestra.run.smithi012.stdout:937 write 0x6c28ddc thru 0x6c2fcd6 (0x6efb bytes) 2024-09-11T05:22:03.958 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:03.958+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:03.958 INFO:teuthology.orchestra.run.smithi012.stdout:938 writesame 0x3a3d9ea thru 0x3a48178 data_size 0x17(0xa78f bytes) 2024-09-11T05:22:03.962 INFO:teuthology.orchestra.run.smithi012.stdout:939 writesame 0xcbe2b5e thru 0xcbf1b5e data_size 0x1(0xf001 bytes) 2024-09-11T05:22:03.976 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:03.976 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2884 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:head [write 294912~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.678482+0000", 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.296845131, 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039034730000000002, 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2884 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678482+0000", 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678482+0000", 2024-09-11T05:22:03.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678484+0000", 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6559999999999999e-06 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678505+0000", 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1563999999999999e-05 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678520+0000", 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4817999999999999e-05 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678527+0000", 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.849e-06 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678580+0000", 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3227999999999999e-05 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678639+0000", 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8730000000000002e-05 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678712+0000", 2024-09-11T05:22:03.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3608000000000004e-05 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.679381+0000", 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00066901500000000002 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.682322+0000", 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029404510000000002 2024-09-11T05:22:03.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.682356+0000", 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3813000000000003e-05 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.682385+0000", 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9740999999999999e-05 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3304 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:5 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.256298545, 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036699689999999999, 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3304 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.34e-07 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719030+0000", 2024-09-11T05:22:03.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0750000000000001e-06 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719033+0000", 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.932e-06 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719036+0000", 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.729e-06 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722506+0000", 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034706590000000001 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722587+0000", 2024-09-11T05:22:03.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0753000000000004e-05 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722699+0000", 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111587 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3305 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:5 [read 753664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.719040+0000", 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.256286715, 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038602720000000001, 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3305 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.990 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719040+0000", 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719040+0000", 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719041+0000", 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8099999999999999e-07 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719047+0000", 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.55e-06 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719053+0000", 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719058+0000", 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6299999999999997e-06 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722733+0000", 2024-09-11T05:22:03.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036753649999999999 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722808+0000", 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4493000000000007e-05 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722901+0000", 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2696999999999997e-05 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:03.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3306 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:5 [read 901120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.256261177000001, 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039343149999999999, 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:03.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3306 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:03.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719068+0000", 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8989999999999999e-06 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719072+0000", 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7689999999999998e-06 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719076+0000", 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:22:03.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722913+0000", 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038379439999999998 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722959+0000", 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5414000000000003e-05 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:03.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.723000+0000", 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1337000000000001e-05 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10509 3.10 3:0e4b85b7:::rbd_data.117977dc529b.0000000000000006:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.443199408, 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081221729999999999, 2024-09-11T05:22:04.000 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10509 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532129+0000", 2024-09-11T05:22:04.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.052e-06 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532146+0000", 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6931000000000001e-05 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532158+0000", 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2207e-05 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532164+0000", 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2210000000000002e-06 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532223+0000", 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9338e-05 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532325+0000", 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101656 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.540250+0000", 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079247680000000004 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.005 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10994 3.10 3:0b01f203:::rbd_data.117977dc529b.0000000000000017:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.414325980999999, 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052453930000000001, 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10994 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561003+0000", 2024-09-11T05:22:04.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.323e-06 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561010+0000", 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6420000000000001e-06 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561029+0000", 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8564999999999999e-05 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561039+0000", 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0046e-05 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561107+0000", 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7922999999999993e-05 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561253+0000", 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014678200000000001 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.566247+0000", 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049931120000000001 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:11697 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.606149+0000", 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.369178059999999, 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035728240000000001, 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11697 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606149+0000", 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606149+0000", 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606151+0000", 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9939999999999999e-06 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606159+0000", 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606179+0000", 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9748000000000001e-05 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606190+0000", 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:22:04.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606261+0000", 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0428999999999999e-05 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606349+0000", 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8140000000000007e-05 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:04.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606522+0000", 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017370100000000001 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.607684+0000", 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001161182 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.609627+0000", 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019434400000000001 2024-09-11T05:22:04.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.609683+0000", 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5968999999999999e-05 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.609722+0000", 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8911000000000001e-05 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.017 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15281 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.001748075, 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035275279999999998, 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15281 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:04.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973582+0000", 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:22:04.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973588+0000", 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.635e-06 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973593+0000", 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0259999999999998e-06 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976966+0000", 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003372154 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977041+0000", 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5523000000000002e-05 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977107+0000", 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5463999999999995e-05 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15377 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.000779066, 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039582419999999998, 2024-09-11T05:22:04.023 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15377 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974549+0000", 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3200000000000005e-07 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974551+0000", 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.706e-06 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974559+0000", 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4390000000000003e-06 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974564+0000", 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5249999999999996e-06 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977991+0000", 2024-09-11T05:22:04.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003426742 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978091+0000", 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9469000000000006e-05 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978506+0000", 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00041572899999999999 2024-09-11T05:22:04.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15378 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.00075455, 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00436718, 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.029 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15378 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974575+0000", 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3250000000000002e-06 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974582+0000", 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.951e-06 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974589+0000", 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0269999999999998e-06 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978537+0000", 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039479529999999997 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978616+0000", 2024-09-11T05:22:04.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8851999999999997e-05 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978940+0000", 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000323572 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.034 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15379 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.000730276000001, 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045646519999999998, 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15379 2024-09-11T05:22:04.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974599+0000", 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2139999999999999e-06 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974615+0000", 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5330999999999999e-05 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974621+0000", 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8069999999999996e-06 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978989+0000", 2024-09-11T05:22:04.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043679410000000002 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979086+0000", 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7297e-05 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979161+0000", 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5617000000000005e-05 2024-09-11T05:22:04.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15380 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.000698080999999, 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00473859, 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15380 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4900000000000001e-07 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974636+0000", 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974644+0000", 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4719999999999998e-06 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974649+0000", 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4210000000000003e-06 2024-09-11T05:22:04.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979201+0000", 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045517919999999998 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979287+0000", 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5981000000000002e-05 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979368+0000", 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0873999999999999e-05 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15506 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.9987615929999993, 2024-09-11T05:22:04.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035932709999999999, 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15506 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:04.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976569+0000", 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5229999999999998e-06 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976576+0000", 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1489999999999997e-06 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976582+0000", 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0009999999999998e-06 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979827+0000", 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032456730000000001 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979873+0000", 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.596e-05 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980159+0000", 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000285493 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.050 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15507 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 229376~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.976980+0000", 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.9983471700000006, 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035477939999999999, 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15507 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976980+0000", 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976980+0000", 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976981+0000", 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8500000000000001e-07 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976984+0000", 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6950000000000002e-06 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976993+0000", 2024-09-11T05:22:04.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7150000000000004e-06 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977000+0000", 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5350000000000001e-06 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980202+0000", 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032027700000000002 2024-09-11T05:22:04.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980261+0000", 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9049999999999999e-05 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980528+0000", 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026634400000000001 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15508 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.977010+0000", 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.9983169790000002, 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039256689999999997, 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15508 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977010+0000", 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977010+0000", 2024-09-11T05:22:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977011+0000", 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977013+0000", 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977020+0000", 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9090000000000003e-06 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977025+0000", 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2449999999999998e-06 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980552+0000", 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035271959999999998 2024-09-11T05:22:04.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980621+0000", 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9010000000000005e-05 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980936+0000", 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031442999999999998 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.060 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16758 3.10 3:0ff05fec:::rbd_data.1179c3639760.000000000000000a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.6174092590000004, 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0180985, 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.061 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16758 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357923+0000", 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3120000000000001e-06 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357935+0000", 2024-09-11T05:22:04.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2104e-05 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357951+0000", 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5818999999999999e-05 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357961+0000", 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5980000000000003e-06 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358021+0000", 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0650999999999999e-05 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358125+0000", 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103479 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.361575+0000", 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034500619999999998 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375931+0000", 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014355698 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375944+0000", 2024-09-11T05:22:04.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3328e-05 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375980+0000", 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5760999999999999e-05 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.376016+0000", 2024-09-11T05:22:04.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6687999999999998e-05 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16758 3.10 e32/22 ondisk, result = 0)", 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.6069044889999997, 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075142530000000003, 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.068 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368424+0000", 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3120000000000001e-06 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368431+0000", 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8129999999999998e-06 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368448+0000", 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6980999999999999e-05 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368458+0000", 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375910+0000", 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074519 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375918+0000", 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9589999999999995e-06 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375937+0000", 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8527999999999999e-05 2024-09-11T05:22:04.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16860 3.a 3:55f78c79:::rbd_data.1179c3639760.000000000000000e:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.4435190099999993, 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014769262999999999, 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:04.073 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16860 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531809+0000", 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531813+0000", 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3730000000000003e-06 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531824+0000", 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0494e-05 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531829+0000", 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1669999999999998e-06 2024-09-11T05:22:04.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531878+0000", 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9027999999999999e-05 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531974+0000", 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5874999999999999e-05 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.534209+0000", 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022353020000000002 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546470+0000", 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012260630999999999 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:04.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546499+0000", 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9436000000000001e-05 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546545+0000", 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5445999999999998e-05 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546577+0000", 2024-09-11T05:22:04.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2536999999999997e-05 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16860 3.a e32/22 ondisk, result = 0)", 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.4332031629999999, 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044590660000000002, 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.080 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:04.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542125+0000", 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.096e-06 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542128+0000", 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0639999999999998e-06 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542139+0000", 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0915e-05 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542148+0000", 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6060000000000003e-06 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546490+0000", 2024-09-11T05:22:04.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043424780000000003 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546496+0000", 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0000000000000002e-06 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546583+0000", 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6907e-05 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39459 3.a 3:54bd4aae:::rbd_data.1179ab1e2350.0000000000000015:head [write 0~0] snapc a=[a] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1367805280000001, 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041154470000000004, 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39459 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:04.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2099999999999997e-07 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838550+0000", 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4540000000000001e-06 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838555+0000", 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838558+0000", 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4709999999999999e-06 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839659+0000", 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011004089999999999 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839734+0000", 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4967000000000002e-05 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839916+0000", 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018229300000000001 2024-09-11T05:22:04.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842435+0000", 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002519257 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842572+0000", 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013645199999999999 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842619+0000", 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7586000000000001e-05 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842662+0000", 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2879000000000001e-05 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.092 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.092 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:04.094 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:04.095 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:04.092+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:04.096 INFO:teuthology.orchestra.run.smithi012.stdout:940 read 0xdf831d3 thru 0xdf8b7d9 (0x8607 bytes) 2024-09-11T05:22:04.096 INFO:teuthology.orchestra.run.smithi012.stdout:941 writesame 0x4174fe9 thru 0x417593a data_size 0x1(0x952 bytes) 2024-09-11T05:22:04.096 INFO:teuthology.orchestra.run.smithi012.stdout:942 trunc from 0xe4a7f7d to 0x9f1d461 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:944 write 0x184b051 thru 0x184efdc (0x3f8c bytes) 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:945 read 0xa70efa thru 0xa7509b (0x41a2 bytes) 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:946 write 0x6590cdf thru 0x6596e26 (0x6148 bytes) 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:947 read 0x29c1439 thru 0x29cc4f3 (0xb0bb bytes) 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:truncating to largest ever: 0xecd8d6f 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:948 trunc from 0x9f1d461 to 0xecd8d6f 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:949 read 0x3b3fba3 thru 0x3b4d521 (0xd97f bytes) 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:950 trunc from 0xecd8d6f to 0x6d68061 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:952 write 0x5e74e20 thru 0x5e7db01 (0x8ce2 bytes) 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:953 punch from 0xe50371 to 0xe58234, (0x7ec3 bytes) 2024-09-11T05:22:04.097 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.098 INFO:teuthology.orchestra.run.smithi012.stdout:955 trunc from 0x6d68061 to 0x6a78e50 2024-09-11T05:22:04.098 INFO:teuthology.orchestra.run.smithi012.stdout:957 punch from 0x9ef72 to 0xae28f, (0xf31d bytes) 2024-09-11T05:22:04.098 INFO:teuthology.orchestra.run.smithi012.stdout:958 trunc from 0x6a78e50 to 0xdbf994d 2024-09-11T05:22:04.098 INFO:teuthology.orchestra.run.smithi012.stdout:959 read 0xc8e7864 thru 0xc8ecfde (0x577b bytes) 2024-09-11T05:22:04.098 INFO:teuthology.orchestra.run.smithi012.stdout:960 punch from 0x709cfe8 to 0x70aa484, (0xd49c bytes) 2024-09-11T05:22:04.098 INFO:teuthology.orchestra.run.smithi012.stdout:961 write 0x7f8a647 thru 0x7f9328f (0x8c49 bytes) 2024-09-11T05:22:04.099 INFO:teuthology.orchestra.run.smithi012.stdout:962 read 0x61c43a9 thru 0x61d3057 (0xecaf bytes) 2024-09-11T05:22:04.109 INFO:teuthology.orchestra.run.smithi012.stdout:963 trunc from 0xdbf994d to 0x51b3568 2024-09-11T05:22:04.130 INFO:teuthology.orchestra.run.smithi012.stdout:964 read 0x450704a thru 0x4512002 (0xafb9 bytes) 2024-09-11T05:22:04.137 INFO:teuthology.orchestra.run.smithi012.stdout:966 write 0x5b56cc3 thru 0x5b5c256 (0x5594 bytes) 2024-09-11T05:22:04.140 INFO:teuthology.orchestra.run.smithi012.stdout:967 read 0x328102f thru 0x32821e9 (0x11bb bytes) 2024-09-11T05:22:04.140 INFO:teuthology.orchestra.run.smithi012.stdout:968 punch from 0x5a1bbcd to 0x5a2676a, (0xab9d bytes) 2024-09-11T05:22:04.140 INFO:teuthology.orchestra.run.smithi012.stdout:969 read 0x3d4c846 thru 0x3d53fe5 (0x77a0 bytes) 2024-09-11T05:22:04.140 INFO:teuthology.orchestra.run.smithi012.stdout:970 read 0xec657c thru 0xed114b (0xabd0 bytes) 2024-09-11T05:22:04.140 INFO:teuthology.orchestra.run.smithi012.stdout:971 punch from 0x1d179f7 to 0x1d25356, (0xd95f bytes) 2024-09-11T05:22:04.140 INFO:teuthology.orchestra.run.smithi012.stdout:972 write 0x38b060e thru 0x38bb838 (0xb22b bytes) 2024-09-11T05:22:04.144 INFO:teuthology.orchestra.run.smithi012.stdout:973 flatten 2024-09-11T05:22:04.194 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:04.194+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:04.200 INFO:teuthology.orchestra.run.smithi012.stdout:974 read 0x385b28c thru 0x38683ea (0xd15f bytes) 2024-09-11T05:22:04.200 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.201 INFO:teuthology.orchestra.run.smithi012.stdout:976 read 0x3adb9d3 thru 0x3ae8681 (0xccaf bytes) 2024-09-11T05:22:04.211 INFO:teuthology.orchestra.run.smithi012.stdout:977 trunc from 0x5b5c257 to 0xe5778f8 2024-09-11T05:22:04.217 INFO:teuthology.orchestra.run.smithi012.stdout:979 write 0x6b0d4e thru 0x6beecc (0xe17f bytes) 2024-09-11T05:22:04.228 INFO:teuthology.orchestra.run.smithi012.stdout:980 trunc from 0xe5778f8 to 0x6818b6c 2024-09-11T05:22:04.234 INFO:teuthology.orchestra.run.smithi012.stdout:983 write 0xe60338 thru 0xe65dca (0x5a93 bytes) 2024-09-11T05:22:04.242 INFO:teuthology.orchestra.run.smithi012.stdout:984 writesame 0x71a01da thru 0x71a4eef data_size 0x4e(0x4d16 bytes) 2024-09-11T05:22:04.242 INFO:teuthology.orchestra.run.smithi012.stdout:985 punch from 0x6836fd7 to 0x68401e3, (0x920c bytes) 2024-09-11T05:22:04.242 INFO:teuthology.orchestra.run.smithi012.stdout:986 read 0x4f44a52 thru 0x4f50ad3 (0xc082 bytes) 2024-09-11T05:22:04.242 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.243 INFO:teuthology.orchestra.run.smithi012.stdout:988 read 0x38ef856 thru 0x38ff7d6 (0xff81 bytes) 2024-09-11T05:22:04.247 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:04.247 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:04.250 INFO:teuthology.orchestra.run.smithi012.stdout:989 trunc from 0x71a4ef0 to 0xdf6b55e 2024-09-11T05:22:04.255 INFO:teuthology.orchestra.run.smithi012.stdout:991 read 0x6a8fbe1 thru 0x6a99674 (0x9a94 bytes) 2024-09-11T05:22:04.255 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.255 INFO:teuthology.orchestra.run.smithi012.stdout:993 write 0x787dfd2 thru 0x788192e (0x395d bytes) 2024-09-11T05:22:04.257 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:04.258 INFO:teuthology.orchestra.run.smithi012.stdout:994 write 0x8f7b462 thru 0x8f87be6 (0xc785 bytes) 2024-09-11T05:22:04.261 INFO:teuthology.orchestra.run.smithi012.stdout:999 writesame 0x668fb6c thru 0x669b72b data_size 0x10(0xbbc0 bytes) 2024-09-11T05:22:04.265 INFO:teuthology.orchestra.run.smithi012.stdout:1000 write 0x286b2be thru 0x286dc3f (0x2982 bytes) 2024-09-11T05:22:04.272 INFO:teuthology.orchestra.run.smithi012.stdout:1001 write 0xdfed78a thru 0xdff3d69 (0x65e0 bytes) 2024-09-11T05:22:04.275 INFO:teuthology.orchestra.run.smithi012.stdout:1002 writesame 0x19d48a thru 0x1a703f data_size 0x13(0x9bb6 bytes) 2024-09-11T05:22:04.277 INFO:teuthology.orchestra.run.smithi012.stdout:1004 write 0x9678f04 thru 0x967b543 (0x2640 bytes) 2024-09-11T05:22:04.280 INFO:teuthology.orchestra.run.smithi012.stdout:1005 read 0xada7773 thru 0xadb08dd (0x916b bytes) 2024-09-11T05:22:04.292 INFO:teuthology.orchestra.run.smithi012.stdout:1006 trunc from 0xdff3d6a to 0x3028fd4 2024-09-11T05:22:04.295 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:04.295+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:04.307 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.325 INFO:teuthology.orchestra.run.smithi012.stdout:1008 writesame 0xd0bc2af thru 0xd0c0a66 data_size 0x12(0x47b8 bytes) 2024-09-11T05:22:04.332 INFO:teuthology.orchestra.run.smithi012.stdout:1010 trunc from 0xd0c0a67 to 0x6c12cba 2024-09-11T05:22:04.338 INFO:teuthology.orchestra.run.smithi012.stdout:1011 read 0x78cf5f thru 0x799006 (0xc0a8 bytes) 2024-09-11T05:22:04.339 INFO:teuthology.orchestra.run.smithi012.stdout:1012 punch from 0x25a5647 to 0x25a5a6e, (0x427 bytes) 2024-09-11T05:22:04.339 INFO:teuthology.orchestra.run.smithi012.stdout:1013 punch from 0x18c661 to 0x18ccdf, (0x67e bytes) 2024-09-11T05:22:04.339 INFO:teuthology.orchestra.run.smithi012.stdout:1014 punch from 0x5207b5a to 0x5211412, (0x98b8 bytes) 2024-09-11T05:22:04.346 INFO:teuthology.orchestra.run.smithi012.stdout:1016 writesame 0x8008afc thru 0x800e7b7 data_size 0xa(0x5cbc bytes) 2024-09-11T05:22:04.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:1017 write 0xd502d70 thru 0xd50679d (0x3a2e bytes) 2024-09-11T05:22:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:1018 write 0xad3e482 thru 0xad4b5ca (0xd149 bytes) 2024-09-11T05:22:04.363 INFO:teuthology.orchestra.run.smithi012.stdout:1019 write 0xd2496fb thru 0xd2501b4 (0x6aba bytes) 2024-09-11T05:22:04.364 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:04.365 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:04.365 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:04.365 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:04.365 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:04.368 INFO:teuthology.orchestra.run.smithi012.stdout:1020 punch from 0x91035cd to 0x910bb84, (0x85b7 bytes) 2024-09-11T05:22:04.368 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.368 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.368 INFO:teuthology.orchestra.run.smithi012.stdout:1023 writesame 0x8cd35c9 thru 0x8cd687e data_size 0x1(0x32b6 bytes) 2024-09-11T05:22:04.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:04.376 INFO:teuthology.orchestra.run.smithi012.stdout:1024 write 0xb93e7e thru 0xba0a6a (0xcbed bytes) 2024-09-11T05:22:04.376 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.381 INFO:teuthology.orchestra.run.smithi012.stdout:1028 trunc from 0xd50679e to 0x9acf1af 2024-09-11T05:22:04.390 INFO:teuthology.orchestra.run.smithi012.stdout:1029 writesame 0x11e39cd thru 0x11e7dbd data_size 0x1(0x43f1 bytes) 2024-09-11T05:22:04.396 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:04.396+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:04.399 INFO:teuthology.orchestra.run.smithi012.stdout:1030 write 0x7b0d2fb thru 0x7b140f5 (0x6dfb bytes) 2024-09-11T05:22:04.402 INFO:teuthology.orchestra.run.smithi012.stdout:1031 write 0x59519ea thru 0x596184d (0xfe64 bytes) 2024-09-11T05:22:04.404 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.412 INFO:teuthology.orchestra.run.smithi012.stdout:1034 writesame 0xb7b5f77 thru 0xb7c5f4a data_size 0xe(0xffd4 bytes) 2024-09-11T05:22:04.412 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.412 INFO:teuthology.orchestra.run.smithi012.stdout:1036 read 0x6941ab2 thru 0x694f2e1 (0xd830 bytes) 2024-09-11T05:22:04.412 INFO:teuthology.orchestra.run.smithi012.stdout:1037 punch from 0x1d85382 to 0x1d8713b, (0x1db9 bytes) 2024-09-11T05:22:04.413 INFO:teuthology.orchestra.run.smithi012.stdout:1038 read 0x34ec328 thru 0x34f81ad (0xbe86 bytes) 2024-09-11T05:22:04.420 INFO:teuthology.orchestra.run.smithi012.stdout:1040 write 0xdc87eb9 thru 0xdc8da7c (0x5bc4 bytes) 2024-09-11T05:22:04.423 INFO:teuthology.orchestra.run.smithi012.stdout:1041 writesame 0xb381b25 thru 0xb3904f5 data_size 0x11(0xe9d1 bytes) 2024-09-11T05:22:04.435 INFO:teuthology.orchestra.run.smithi012.stdout:1042 trunc from 0xdc8da7d to 0x6ef2cb2 2024-09-11T05:22:04.445 INFO:teuthology.orchestra.run.smithi012.stdout:1043 write 0x2dde4a thru 0x2ddf17 (0xce bytes) 2024-09-11T05:22:04.446 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.454 INFO:teuthology.orchestra.run.smithi012.stdout:1045 write 0x8f407b1 thru 0x8f4556b (0x4dbb bytes) 2024-09-11T05:22:04.462 INFO:teuthology.orchestra.run.smithi012.stdout:1046 trunc from 0x8f4556c to 0xbe7ccf3 2024-09-11T05:22:04.467 INFO:teuthology.orchestra.run.smithi012.stdout:1047 write 0x20c4515 thru 0x20cc293 (0x7d7f bytes) 2024-09-11T05:22:04.468 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.469 INFO:teuthology.orchestra.run.smithi012.stdout:1050 write 0x6c96781 thru 0x6c98dcf (0x264f bytes) 2024-09-11T05:22:04.476 INFO:teuthology.orchestra.run.smithi012.stdout:1051 write 0xc06690a thru 0xc06dec5 (0x75bc bytes) 2024-09-11T05:22:04.479 INFO:teuthology.orchestra.run.smithi012.stdout:1053 write 0x6d08dd1 thru 0x6d0f88e (0x6abe bytes) 2024-09-11T05:22:04.483 INFO:teuthology.orchestra.run.smithi012.stdout:1054 read 0x5a0da3e thru 0x5a10b30 (0x30f3 bytes) 2024-09-11T05:22:04.483 INFO:teuthology.orchestra.run.smithi012.stdout:1055 punch from 0x72c0e17 to 0x72c5707, (0x48f0 bytes) 2024-09-11T05:22:04.483 INFO:teuthology.orchestra.run.smithi012.stdout:1056 writesame 0xba69785 thru 0xba6f7a2 data_size 0x9(0x601e bytes) 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:04.488 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.736344801999998, 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:04.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13304 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1671168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733303052, 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016884531000000001, 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13304 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:04.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.41e-07 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753660+0000", 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.68e-06 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753666+0000", 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9889999999999997e-06 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753670+0000", 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770413+0000", 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016742694999999998 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770479+0000", 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5858999999999994e-05 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770542+0000", 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3689000000000006e-05 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13309 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 2048000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753675+0000", 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733285539000001, 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016881598000000001, 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13309 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753675+0000", 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753675+0000", 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753676+0000", 2024-09-11T05:22:04.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753677+0000", 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.562e-06 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753683+0000", 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5110000000000003e-06 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753689+0000", 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9309999999999996e-06 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770404+0000", 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016715601 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770469+0000", 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4344999999999995e-05 2024-09-11T05:22:04.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770557+0000", 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8121000000000006e-05 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733266240000001, 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:04.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733248939999999, 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:04.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733222905, 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.519 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733206679, 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:04.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733184223, 2024-09-11T05:22:04.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:04.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:04.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:04.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733150144, 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:04.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.533 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.733112522999999, 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:04.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.538 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.732547683, 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:04.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.732498585, 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:04.543 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:04.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.547 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.447843507, 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.548 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:04.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:04.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.447823889, 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.445233835, 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:04.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16063 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 344064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.44484506, 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016861359999999999, 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.562 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16063 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042118+0000", 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0710000000000002e-06 2024-09-11T05:22:04.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042125+0000", 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4690000000000002e-06 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042130+0000", 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1789999999999999e-06 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058816+0000", 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016686014999999998 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058885+0000", 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9671000000000004e-05 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058977+0000", 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1584999999999998e-05 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.566 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.444803693000001, 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.444769273, 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:04.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:04.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.393678959000001, 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:04.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:04.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:04.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:04.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:04.581 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.32322734199999997, 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:04.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:04.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:04.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:04.586 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:04.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:22:04.588 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:04.589 INFO:teuthology.orchestra.run.smithi012.stdout:1057 trunc from 0xc06dec6 to 0x89065ae 2024-09-11T05:22:04.589 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.589 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.589 INFO:teuthology.orchestra.run.smithi012.stdout:1062 write 0xc22e8de thru 0xc23196e (0x3091 bytes) 2024-09-11T05:22:04.590 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:04.590 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:04.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:04.591 INFO:teuthology.orchestra.run.smithi012.stdout:1063 read 0x933d468 thru 0x933febe (0x2a57 bytes) 2024-09-11T05:22:04.591 INFO:teuthology.orchestra.run.smithi012.stdout:1065 trunc from 0xc23196f to 0x3f7a10e 2024-09-11T05:22:04.591 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:04.592 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:04.592 INFO:teuthology.orchestra.run.smithi012.stdout:1066 writesame 0x51ffd1d thru 0x52033ff data_size 0x1(0x36e3 bytes) 2024-09-11T05:22:04.592 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:04.592 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:04.593 INFO:teuthology.orchestra.run.smithi012.stdout:1067 write 0xb0b4300 thru 0xb0bf406 (0xb107 bytes) 2024-09-11T05:22:04.593 INFO:teuthology.orchestra.run.smithi012.stdout:1068 read 0x930f774 thru 0x931d772 (0xdfff bytes) 2024-09-11T05:22:04.593 INFO:teuthology.orchestra.run.smithi012.stdout:1069 read 0x4110f74 thru 0x411493e (0x39cb bytes) 2024-09-11T05:22:04.593 INFO:teuthology.orchestra.run.smithi012.stdout:1070 read 0x6c81667 thru 0x6c8393c (0x22d6 bytes) 2024-09-11T05:22:04.593 INFO:teuthology.orchestra.run.smithi012.stdout:1071 trunc from 0xb0bf407 to 0x333668e 2024-09-11T05:22:04.594 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:04.594 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:04.594 INFO:teuthology.orchestra.run.smithi012.stdout:1072 trunc from 0x333668e to 0x9062c93 2024-09-11T05:22:04.594 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:04.595 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:04.595 INFO:teuthology.orchestra.run.smithi012.stdout:1073 read 0x6f0a40d thru 0x6f19131 (0xed25 bytes) 2024-09-11T05:22:04.595 INFO:teuthology.orchestra.run.smithi012.stdout:1075 write 0x6ea5429 thru 0x6eb11b8 (0xbd90 bytes) 2024-09-11T05:22:04.595 INFO:teuthology.orchestra.run.smithi012.stdout:1077 write 0x136fdcc thru 0x13782cc (0x8501 bytes) 2024-09-11T05:22:04.596 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:04.588+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:04.599 INFO:teuthology.orchestra.run.smithi012.stdout:1078 write 0xca202aa thru 0xca2dc54 (0xd9ab bytes) 2024-09-11T05:22:04.600 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:04.610 INFO:teuthology.orchestra.run.smithi012.stdout:1079 writesame 0xed66006 thru 0xed73e22 data_size 0x1(0xde1d bytes) 2024-09-11T05:22:04.610 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.610 INFO:teuthology.orchestra.run.smithi012.stdout:1081 write 0x3bab9d9 thru 0x3bb00c5 (0x46ed bytes) 2024-09-11T05:22:04.613 INFO:teuthology.orchestra.run.smithi012.stdout:1082 writesame 0xa02f389 thru 0xa034f77 data_size 0x9(0x5bef bytes) 2024-09-11T05:22:04.630 INFO:teuthology.orchestra.run.smithi012.stdout:1084 trunc from 0xed73e23 to 0x3d6aadb 2024-09-11T05:22:04.642 INFO:teuthology.orchestra.run.smithi012.stdout:1085 trunc from 0x3d6aadb to 0x27a4392 2024-09-11T05:22:04.653 INFO:teuthology.orchestra.run.smithi012.stdout:1087 write 0x1fd867e thru 0x1fe4b3d (0xc4c0 bytes) 2024-09-11T05:22:04.655 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.656 INFO:teuthology.orchestra.run.smithi012.stdout:1090 read 0x1bff3ae thru 0x1c03095 (0x3ce8 bytes) 2024-09-11T05:22:04.656 INFO:teuthology.orchestra.run.smithi012.stdout:1092 read 0xf02879 thru 0xf0bbd1 (0x9359 bytes) 2024-09-11T05:22:04.657 INFO:teuthology.orchestra.run.smithi012.stdout:1094 read 0x9c0159 thru 0x9c1ea8 (0x1d50 bytes) 2024-09-11T05:22:04.675 INFO:teuthology.orchestra.run.smithi012.stdout:1095 writesame 0xb6be7ca thru 0xb6c882b data_size 0x9(0xa062 bytes) 2024-09-11T05:22:04.675 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.675 INFO:teuthology.orchestra.run.smithi012.stdout:1098 read 0xa489dfb thru 0xa498a49 (0xec4f bytes) 2024-09-11T05:22:04.675 INFO:teuthology.orchestra.run.smithi012.stdout:1100 read 0x739896 thru 0x73e258 (0x49c3 bytes) 2024-09-11T05:22:04.683 INFO:teuthology.orchestra.run.smithi012.stdout:1102 trunc from 0xb6c882c to 0x589a7ec 2024-09-11T05:22:04.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:04.688+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:04.689 INFO:teuthology.orchestra.run.smithi012.stdout:1103 punch from 0x1a32276 to 0x1a3d870, (0xb5fa bytes) 2024-09-11T05:22:04.689 INFO:teuthology.orchestra.run.smithi012.stdout:1104 read 0x57956e3 thru 0x57a0876 (0xb194 bytes) 2024-09-11T05:22:04.689 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.700 INFO:teuthology.orchestra.run.smithi012.stdout:1106 write 0xa0b9574 thru 0xa0c57c7 (0xc254 bytes) 2024-09-11T05:22:04.703 INFO:teuthology.orchestra.run.smithi012.stdout:1108 write 0x3af2cf7 thru 0x3b0159c (0xe8a6 bytes) 2024-09-11T05:22:04.706 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.706 INFO:teuthology.orchestra.run.smithi012.stdout:1110 trunc from 0xa0c57c8 to 0xa4e335e 2024-09-11T05:22:04.712 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.712 INFO:teuthology.orchestra.run.smithi012.stdout:1112 read 0x5cf843c thru 0x5cfa580 (0x2145 bytes) 2024-09-11T05:22:04.712 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.712 INFO:teuthology.orchestra.run.smithi012.stdout:1114 punch from 0x1ff9ff0 to 0x1ffaf6f, (0xf7f bytes) 2024-09-11T05:22:04.712 INFO:teuthology.orchestra.run.smithi012.stdout:1117 trunc from 0xa4e335e to 0xa243049 2024-09-11T05:22:04.721 INFO:teuthology.orchestra.run.smithi012.stdout:1118 trunc from 0xa243049 to 0xc87e2ea 2024-09-11T05:22:04.727 INFO:teuthology.orchestra.run.smithi012.stdout:1119 trunc from 0xc87e2ea to 0xbaa7a8a 2024-09-11T05:22:04.733 INFO:teuthology.orchestra.run.smithi012.stdout:1120 read 0x6f26090 thru 0x6f30e9f (0xae10 bytes) 2024-09-11T05:22:04.733 INFO:teuthology.orchestra.run.smithi012.stdout:1122 write 0x899ed51 thru 0x89a6043 (0x72f3 bytes) 2024-09-11T05:22:04.733 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:04.733 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:04.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:04.744 INFO:teuthology.orchestra.run.smithi012.stdout:1123 write 0xd3dc692 thru 0xd3ec4cf (0xfe3e bytes) 2024-09-11T05:22:04.747 INFO:teuthology.orchestra.run.smithi012.stdout:1126 write 0x6184914 thru 0x618d547 (0x8c34 bytes) 2024-09-11T05:22:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:1127 punch from 0x9de8662 to 0x9dee77a, (0x6118 bytes) 2024-09-11T05:22:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:1129 writesame 0x8602c96 thru 0x8608ba8 data_size 0x1(0x5f13 bytes) 2024-09-11T05:22:04.763 INFO:teuthology.orchestra.run.smithi012.stdout:1130 write 0x540e824 thru 0x541d230 (0xea0d bytes) 2024-09-11T05:22:04.767 INFO:teuthology.orchestra.run.smithi012.stdout:1131 punch from 0x85f80cc to 0x85fb6dc, (0x3610 bytes) 2024-09-11T05:22:04.768 INFO:teuthology.orchestra.run.smithi012.stdout:1132 trunc from 0xd3ec4d0 to 0xc436bb9 2024-09-11T05:22:04.780 INFO:teuthology.orchestra.run.smithi012.stdout:1133 trunc from 0xc436bb9 to 0xd6f5941 2024-09-11T05:22:04.785 INFO:teuthology.orchestra.run.smithi012.stdout:1134 write 0xd192755 thru 0xd1936d5 (0xf81 bytes) 2024-09-11T05:22:04.789 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.789 INFO:teuthology.orchestra.run.smithi012.stdout:1137 read 0x5f9d6d1 thru 0x5fa0dda (0x370a bytes) 2024-09-11T05:22:04.789 INFO:teuthology.orchestra.run.smithi012.stdout:1138 read 0x5c94e22 thru 0x5c9ae68 (0x6047 bytes) 2024-09-11T05:22:04.789 INFO:teuthology.orchestra.run.smithi012.stdout:1140 trunc from 0xd6f5941 to 0xdb8a2b0 2024-09-11T05:22:04.789 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:04.788+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:04.793 INFO:teuthology.orchestra.run.smithi012.stdout:1141 punch from 0x6edd644 to 0x6edfbf2, (0x25ae bytes) 2024-09-11T05:22:04.794 INFO:teuthology.orchestra.run.smithi012.stdout:1142 punch from 0xb8b3fb to 0xb97fb9, (0xcbbe bytes) 2024-09-11T05:22:04.794 INFO:teuthology.orchestra.run.smithi012.stdout:1143 read 0xae68197 thru 0xae6e9a7 (0x6811 bytes) 2024-09-11T05:22:04.798 INFO:teuthology.orchestra.run.smithi012.stdout:1144 trunc from 0xdb8a2b0 to 0x9e43dbe 2024-09-11T05:22:04.807 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.807 INFO:teuthology.orchestra.run.smithi012.stdout:1147 read 0x3ee320f thru 0x3ef048f (0xd281 bytes) 2024-09-11T05:22:04.808 INFO:teuthology.orchestra.run.smithi012.stdout:1148 punch from 0x8a165c3 to 0x8a1f037, (0x8a74 bytes) 2024-09-11T05:22:04.808 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.808 INFO:teuthology.orchestra.run.smithi012.stdout:1150 punch from 0x9e39ac5 to 0x9e3c4d4, (0x2a0f bytes) 2024-09-11T05:22:04.817 INFO:teuthology.orchestra.run.smithi012.stdout:1151 write 0xc3884b5 thru 0xc38e449 (0x5f95 bytes) 2024-09-11T05:22:04.820 INFO:teuthology.orchestra.run.smithi012.stdout:1152 write 0x7749afa thru 0x774a60f (0xb16 bytes) 2024-09-11T05:22:04.824 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.824 INFO:teuthology.orchestra.run.smithi012.stdout:1154 punch from 0x189d0c1 to 0x18a0af4, (0x3a33 bytes) 2024-09-11T05:22:04.824 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.824 INFO:teuthology.orchestra.run.smithi012.stdout:1156 read 0x8e86e24 thru 0x8e8be4c (0x5029 bytes) 2024-09-11T05:22:04.834 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:04.834 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:04.835 INFO:teuthology.orchestra.run.smithi012.stdout:1157 trunc from 0xc38e44a to 0x360cf94 2024-09-11T05:22:04.867 INFO:teuthology.orchestra.run.smithi012.stdout:1158 write 0xd3fd870 thru 0xd40d251 (0xf9e2 bytes) 2024-09-11T05:22:04.871 INFO:teuthology.orchestra.run.smithi012.stdout:1159 write 0x7fc9ed1 thru 0x7fd67db (0xc90b bytes) 2024-09-11T05:22:04.874 INFO:teuthology.orchestra.run.smithi012.stdout:1160 read 0x2a44eec thru 0x2a5137f (0xc494 bytes) 2024-09-11T05:22:04.874 INFO:teuthology.orchestra.run.smithi012.stdout:1161 read 0x494adf7 thru 0x49522c7 (0x74d1 bytes) 2024-09-11T05:22:04.874 INFO:teuthology.orchestra.run.smithi012.stdout:1162 write 0xaa60a8b thru 0xaa6a4e2 (0x9a58 bytes) 2024-09-11T05:22:04.877 INFO:teuthology.orchestra.run.smithi012.stdout:1163 writesame 0xeffe8f thru 0xf027ae data_size 0x38(0x2920 bytes) 2024-09-11T05:22:04.878 INFO:teuthology.orchestra.run.smithi012.stdout:1164 read 0x8cf00d4 thru 0x8cfd6bc (0xd5e9 bytes) 2024-09-11T05:22:04.879 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:04.879 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:04.889 INFO:teuthology.orchestra.run.smithi012.stdout:1166 trunc from 0xd40d252 to 0x46df6b9 2024-09-11T05:22:04.890 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:04.889+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:04.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:04.901 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.901 INFO:teuthology.orchestra.run.smithi012.stdout:1169 read 0x3b25bda thru 0x3b265f9 (0xa20 bytes) 2024-09-11T05:22:04.901 INFO:teuthology.orchestra.run.smithi012.stdout:1170 punch from 0x24f532d to 0x25023cb, (0xd09e bytes) 2024-09-11T05:22:04.901 INFO:teuthology.orchestra.run.smithi012.stdout:1171 read 0xf7275a thru 0xf7bdef (0x9696 bytes) 2024-09-11T05:22:04.918 INFO:teuthology.orchestra.run.smithi012.stdout:1172 write 0xcd2907b thru 0xcd2b164 (0x20ea bytes) 2024-09-11T05:22:04.922 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.922 INFO:teuthology.orchestra.run.smithi012.stdout:1177 write 0x7cbd277 thru 0x7cc465b (0x73e5 bytes) 2024-09-11T05:22:04.925 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.925 INFO:teuthology.orchestra.run.smithi012.stdout:1181 writesame 0x6dc777c thru 0x6dd69c3 data_size 0x4(0xf248 bytes) 2024-09-11T05:22:04.934 INFO:teuthology.orchestra.run.smithi012.stdout:1182 writesame 0xabc21a thru 0xac8747 data_size 0x5e(0xc52e bytes) 2024-09-11T05:22:04.936 INFO:teuthology.orchestra.run.smithi012.stdout:1185 read 0xc33c9b7 thru 0xc33dd2c (0x1376 bytes) 2024-09-11T05:22:04.936 INFO:teuthology.orchestra.run.smithi012.stdout:1186 punch from 0x6047500 to 0x604c486, (0x4f86 bytes) 2024-09-11T05:22:04.936 INFO:teuthology.orchestra.run.smithi012.stdout:1188 punch from 0x56b9774 to 0x56be8f9, (0x5185 bytes) 2024-09-11T05:22:04.936 INFO:teuthology.orchestra.run.smithi012.stdout:1192 writesame 0x5777295 thru 0x57871ed data_size 0x1(0xff59 bytes) 2024-09-11T05:22:04.963 INFO:teuthology.orchestra.run.smithi012.stdout:1193 punch from 0xb9ee3a0 to 0xb9f3085, (0x4ce5 bytes) 2024-09-11T05:22:04.963 INFO:teuthology.orchestra.run.smithi012.stdout:1194 write 0x1da5da4 thru 0x1da9ff7 (0x4254 bytes) 2024-09-11T05:22:04.964 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.965 INFO:teuthology.orchestra.run.smithi012.stdout:1197 write 0xf960d6 thru 0xf9d3a6 (0x72d1 bytes) 2024-09-11T05:22:04.966 INFO:teuthology.orchestra.run.smithi012.stdout:1198 punch from 0xa8d3b66 to 0xa8da2ca, (0x6764 bytes) 2024-09-11T05:22:04.967 INFO:teuthology.orchestra.run.smithi012.stdout:1199 punch from 0x64f7461 to 0x64fa10f, (0x2cae bytes) 2024-09-11T05:22:04.967 INFO:teuthology.orchestra.run.smithi012.stdout:1201 write 0x4b7ac2f thru 0x4b8a537 (0xf909 bytes) 2024-09-11T05:22:04.969 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.969 INFO:teuthology.orchestra.run.smithi012.stdout:1203 punch from 0x62ce401 to 0x62dc29d, (0xde9c bytes) 2024-09-11T05:22:04.970 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.970 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.970 INFO:teuthology.orchestra.run.smithi012.stdout:1208 read 0x36fbc41 thru 0x3705b66 (0x9f26 bytes) 2024-09-11T05:22:04.970 INFO:teuthology.orchestra.run.smithi012.stdout:1209 punch from 0x2758910 to 0x275b7f2, (0x2ee2 bytes) 2024-09-11T05:22:04.970 INFO:teuthology.orchestra.run.smithi012.stdout:1210 read 0xc94adaf thru 0xc9534c8 (0x871a bytes) 2024-09-11T05:22:04.971 INFO:teuthology.orchestra.run.smithi012.stdout:1211 punch from 0x6fefa7f to 0x6ff142c, (0x19ad bytes) 2024-09-11T05:22:04.971 INFO:teuthology.orchestra.run.smithi012.stdout:1213 writesame 0xdd4058 thru 0xdd41ff data_size 0x4(0x1a8 bytes) 2024-09-11T05:22:04.980 INFO:teuthology.orchestra.run.smithi012.stdout:1214 writesame 0xe3fb6b6 thru 0xe4082c4 data_size 0xb(0xcc0f bytes) 2024-09-11T05:22:04.980 INFO:teuthology.orchestra.run.smithi012.stdout:1215 read 0xbcc69c5 thru 0xbcd3e2a (0xd466 bytes) 2024-09-11T05:22:04.988 INFO:teuthology.orchestra.run.smithi012.stdout:1216 trunc from 0xe4082c5 to 0x716a3f8 2024-09-11T05:22:04.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:04.990+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:04.999 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:04.999 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.005 INFO:teuthology.orchestra.run.smithi012.stdout:1219 trunc from 0x716a3f8 to 0x1b88b4d 2024-09-11T05:22:05.022 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:05.022 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:05.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:05.038 INFO:teuthology.orchestra.run.smithi012.stdout:1221 write 0xbb7f89d thru 0xbb8e7c7 (0xef2b bytes) 2024-09-11T05:22:05.046 INFO:teuthology.orchestra.run.smithi012.stdout:1222 trunc from 0xbb8e7c8 to 0x73d3b90 2024-09-11T05:22:05.060 INFO:teuthology.orchestra.run.smithi012.stdout:1223 trunc from 0x73d3b90 to 0x3e46dab 2024-09-11T05:22:05.066 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.069 INFO:teuthology.orchestra.run.smithi012.stdout:1225 trunc from 0x3e46dab to 0xea395c 2024-09-11T05:22:05.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:05.091+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:05.094 INFO:teuthology.orchestra.run.smithi012.stdout:1226 write 0x6bfc137 thru 0x6c08e5b (0xcd25 bytes) 2024-09-11T05:22:05.097 INFO:teuthology.orchestra.run.smithi012.stdout:1227 punch from 0x1b01ed0 to 0x1b11a9c, (0xfbcc bytes) 2024-09-11T05:22:05.098 INFO:teuthology.orchestra.run.smithi012.stdout:1230 write 0x5d7df70 thru 0x5d853f9 (0x748a bytes) 2024-09-11T05:22:05.113 INFO:teuthology.orchestra.run.smithi012.stdout:1231 write 0xd11f33a thru 0xd12c9db (0xd6a2 bytes) 2024-09-11T05:22:05.126 INFO:teuthology.orchestra.run.smithi012.stdout:1232 trunc from 0xd12c9dc to 0x531d352 2024-09-11T05:22:05.142 INFO:teuthology.orchestra.run.smithi012.stdout:1234 trunc from 0x531d352 to 0x44cdc5 2024-09-11T05:22:05.161 INFO:teuthology.orchestra.run.smithi012.stdout:1236 writesame 0xb6f435 thru 0xb770de data_size 0x9(0x7caa bytes) 2024-09-11T05:22:05.164 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:05.164 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:05.168 INFO:teuthology.orchestra.run.smithi012.stdout:1237 writesame 0x126913a thru 0x1276187 data_size 0xe(0xd04e bytes) 2024-09-11T05:22:05.168 INFO:teuthology.orchestra.run.smithi012.stdout:1239 read 0xd6bc94 thru 0xd75166 (0x94d3 bytes) 2024-09-11T05:22:05.169 INFO:teuthology.orchestra.run.smithi012.stdout:1240 trunc from 0x1276188 to 0xd81fca 2024-09-11T05:22:05.174 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:05.184 INFO:teuthology.orchestra.run.smithi012.stdout:1245 writesame 0x2776aa2 thru 0x2784635 data_size 0x2f(0xdb94 bytes) 2024-09-11T05:22:05.192 INFO:teuthology.orchestra.run.smithi012.stdout:1247 trunc from 0x2784636 to 0x959c6f2 2024-09-11T05:22:05.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:05.192+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:05.198 INFO:teuthology.orchestra.run.smithi012.stdout:1248 punch from 0x2d30683 to 0x2d40642, (0xffbf bytes) 2024-09-11T05:22:05.199 INFO:teuthology.orchestra.run.smithi012.stdout:1249 trunc from 0x959c6f2 to 0xa9c4409 2024-09-11T05:22:05.206 INFO:teuthology.orchestra.run.smithi012.stdout:1250 read 0x2389642 thru 0x2393b96 (0xa555 bytes) 2024-09-11T05:22:05.206 INFO:teuthology.orchestra.run.smithi012.stdout:1252 read 0xa4f4359 thru 0xa503363 (0xf00b bytes) 2024-09-11T05:22:05.206 INFO:teuthology.orchestra.run.smithi012.stdout:1253 writesame 0x110bedf thru 0x1119c49 data_size 0x1(0xdd6b bytes) 2024-09-11T05:22:05.233 INFO:teuthology.orchestra.run.smithi012.stdout:1258 write 0x10c9a88 thru 0x10d1da9 (0x8322 bytes) 2024-09-11T05:22:05.236 INFO:teuthology.orchestra.run.smithi012.stdout:1259 read 0x83d1382 thru 0x83df961 (0xe5e0 bytes) 2024-09-11T05:22:05.236 INFO:teuthology.orchestra.run.smithi012.stdout:1261 punch from 0x92e4721 to 0x92ed62a, (0x8f09 bytes) 2024-09-11T05:22:05.247 INFO:teuthology.orchestra.run.smithi012.stdout:1262 write 0xecd7337 thru 0xece565d (0xe327 bytes) 2024-09-11T05:22:05.249 INFO:teuthology.orchestra.run.smithi012.stdout:1263 write 0x6f679b7 thru 0x6f6ef54 (0x759e bytes) 2024-09-11T05:22:05.252 INFO:teuthology.orchestra.run.smithi012.stdout:1264 write 0x7b03827 thru 0x7b0962e (0x5e08 bytes) 2024-09-11T05:22:05.255 INFO:teuthology.orchestra.run.smithi012.stdout:1265 read 0xdd9ba0f thru 0xdda2298 (0x688a bytes) 2024-09-11T05:22:05.255 INFO:teuthology.orchestra.run.smithi012.stdout:1266 write 0xe83f401 thru 0xe847843 (0x8443 bytes) 2024-09-11T05:22:05.258 INFO:teuthology.orchestra.run.smithi012.stdout:1267 read 0xd97107e thru 0xd973755 (0x26d8 bytes) 2024-09-11T05:22:05.269 INFO:teuthology.orchestra.run.smithi012.stdout:1268 trunc from 0xece565e to 0x5384afc 2024-09-11T05:22:05.280 INFO:teuthology.orchestra.run.smithi012.stdout:1270 punch from 0x468ccf2 to 0x4698bf3, (0xbf01 bytes) 2024-09-11T05:22:05.280 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.285 INFO:teuthology.orchestra.run.smithi012.stdout:1273 write 0x5628c47 thru 0x562c8cc (0x3c86 bytes) 2024-09-11T05:22:05.287 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.287 INFO:teuthology.orchestra.run.smithi012.stdout:1275 read 0xd36cab thru 0xd37b92 (0xee8 bytes) 2024-09-11T05:22:05.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:05.294+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:05.306 INFO:teuthology.orchestra.run.smithi012.stdout:1276 write 0xea4798e thru 0xea50a9d (0x9110 bytes) 2024-09-11T05:22:05.309 INFO:teuthology.orchestra.run.smithi012.stdout:1277 read 0x2ef2610 thru 0x2efa666 (0x8057 bytes) 2024-09-11T05:22:05.309 INFO:teuthology.orchestra.run.smithi012.stdout:1279 read 0x4c65784 thru 0x4c69767 (0x3fe4 bytes) 2024-09-11T05:22:05.309 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.311 INFO:teuthology.orchestra.run.smithi012.stdout:1282 trunc from 0xea50a9e to 0xc342f9a 2024-09-11T05:22:05.312 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:05.312 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:05.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:05.322 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.322 INFO:teuthology.orchestra.run.smithi012.stdout:1285 punch from 0xaa576a0 to 0xaa5e476, (0x6dd6 bytes) 2024-09-11T05:22:05.329 INFO:teuthology.orchestra.run.smithi012.stdout:1288 write 0xe1a85b9 thru 0xe1b6339 (0xdd81 bytes) 2024-09-11T05:22:05.347 INFO:teuthology.orchestra.run.smithi012.stdout:1289 trunc from 0xe1b633a to 0x5a03d2 2024-09-11T05:22:05.377 INFO:teuthology.orchestra.run.smithi012.stdout:1290 write 0xc700f33 thru 0xc703376 (0x2444 bytes) 2024-09-11T05:22:05.381 INFO:teuthology.orchestra.run.smithi012.stdout:1291 punch from 0x4fa5f01 to 0x4faf3a9, (0x94a8 bytes) 2024-09-11T05:22:05.381 INFO:teuthology.orchestra.run.smithi012.stdout:1292 read 0x13f426f thru 0x13fbe7b (0x7c0d bytes) 2024-09-11T05:22:05.381 INFO:teuthology.orchestra.run.smithi012.stdout:1293 read 0x3e06904 thru 0x3e11d2d (0xb42a bytes) 2024-09-11T05:22:05.381 INFO:teuthology.orchestra.run.smithi012.stdout:1297 read 0x3932dda thru 0x393e6d0 (0xb8f7 bytes) 2024-09-11T05:22:05.391 INFO:teuthology.orchestra.run.smithi012.stdout:1299 trunc from 0xc703377 to 0x2a6eb5a 2024-09-11T05:22:05.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:05.395+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:05.410 INFO:teuthology.orchestra.run.smithi012.stdout:1300 write 0x4674fe2 thru 0x4677448 (0x2467 bytes) 2024-09-11T05:22:05.413 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.413 INFO:teuthology.orchestra.run.smithi012.stdout:1302 read 0xb47f87 thru 0xb53d0c (0xbd86 bytes) 2024-09-11T05:22:05.413 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.414 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.414 INFO:teuthology.orchestra.run.smithi012.stdout:1307 read 0x1e7029 thru 0x1f2de2 (0xbdba bytes) 2024-09-11T05:22:05.431 INFO:teuthology.orchestra.run.smithi012.stdout:1308 write 0xdc8bf51 thru 0xdc91e2c (0x5edc bytes) 2024-09-11T05:22:05.434 INFO:teuthology.orchestra.run.smithi012.stdout:1309 write 0x7980a82 thru 0x7982f53 (0x24d2 bytes) 2024-09-11T05:22:05.436 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.436 INFO:teuthology.orchestra.run.smithi012.stdout:1311 write 0x16a8009 thru 0x16aa502 (0x24fa bytes) 2024-09-11T05:22:05.440 INFO:teuthology.orchestra.run.smithi012.stdout:1312 read 0x2458d31 thru 0x2467db7 (0xf087 bytes) 2024-09-11T05:22:05.440 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.440 INFO:teuthology.orchestra.run.smithi012.stdout:1315 write 0x96b7187 thru 0x96b915a (0x1fd4 bytes) 2024-09-11T05:22:05.442 INFO:teuthology.orchestra.run.smithi012.stdout:1317 write 0xdc2ea78 thru 0xdc3e6d9 (0xfc62 bytes) 2024-09-11T05:22:05.444 INFO:teuthology.orchestra.run.smithi012.stdout:1318 read 0x25e07c0 thru 0x25e386b (0x30ac bytes) 2024-09-11T05:22:05.444 INFO:teuthology.orchestra.run.smithi012.stdout:1321 read 0x549f2b6 thru 0x54a8347 (0x9092 bytes) 2024-09-11T05:22:05.444 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.445 INFO:teuthology.orchestra.run.smithi012.stdout:1323 writesame 0x742cf35 thru 0x743225d data_size 0x1(0x5329 bytes) 2024-09-11T05:22:05.451 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:05.451 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:05.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:05.468 INFO:teuthology.orchestra.run.smithi012.stdout:1325 trunc from 0xdc91e2d to 0x379bdb6 2024-09-11T05:22:05.478 INFO:teuthology.orchestra.run.smithi012.stdout:1326 write 0x205ee0e thru 0x2063902 (0x4af5 bytes) 2024-09-11T05:22:05.488 INFO:teuthology.orchestra.run.smithi012.stdout:1327 write 0x4f09104 thru 0x4f12956 (0x9853 bytes) 2024-09-11T05:22:05.491 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.492 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.492 INFO:teuthology.orchestra.run.smithi012.stdout:1330 punch from 0x16b212 to 0x172cde, (0x7acc bytes) 2024-09-11T05:22:05.492 INFO:teuthology.orchestra.run.smithi012.stdout:1332 clone 11 order 20 su 32768 sc 14 2024-09-11T05:22:05.492 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:22:05.492 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:22:05.492 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-09-11T05:22:05.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 6 2024-09-11T05:22:05.515 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:22:05.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:05.515+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:05.586 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:05.587 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:05.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:05.596+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:05.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:05.636 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-11T05:22:05.650 INFO:teuthology.orchestra.run.smithi012.stdout:1333 write 0x8ce570a thru 0x8ce9912 (0x4209 bytes) 2024-09-11T05:22:05.664 INFO:teuthology.orchestra.run.smithi012.stdout:1335 write 0xc3e8dcd thru 0xc3f31c0 (0xa3f4 bytes) 2024-09-11T05:22:05.668 INFO:teuthology.orchestra.run.smithi012.stdout:1336 writesame 0x71ddc7e thru 0x71e2656 data_size 0x13(0x49d9 bytes) 2024-09-11T05:22:05.672 INFO:teuthology.orchestra.run.smithi012.stdout:1337 write 0xbab4cc thru 0xbb663f (0xb174 bytes) 2024-09-11T05:22:05.682 INFO:teuthology.orchestra.run.smithi012.stdout:1338 read 0x97fabaa thru 0x98097d0 (0xec27 bytes) 2024-09-11T05:22:05.686 INFO:teuthology.orchestra.run.smithi012.stdout:1339 trunc from 0xc3f31c1 to 0x9513d1c 2024-09-11T05:22:05.696 INFO:teuthology.orchestra.run.smithi012.stdout:1340 write 0x26ca670 thru 0x26cad70 (0x701 bytes) 2024-09-11T05:22:05.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:05.697+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:05.700 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.701 INFO:teuthology.orchestra.run.smithi012.stdout:1347 write 0x2eea849 thru 0x2eeda94 (0x324c bytes) 2024-09-11T05:22:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:1356 read 0x315c62 thru 0x31975a (0x3af9 bytes) 2024-09-11T05:22:05.704 INFO:teuthology.orchestra.run.smithi012.stdout:1357 writesame 0x1cfef0b thru 0x1d03184 data_size 0x2(0x427a bytes) 2024-09-11T05:22:05.713 INFO:teuthology.orchestra.run.smithi012.stdout:1358 trunc from 0x9513d1c to 0xaf099d5 2024-09-11T05:22:05.719 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.719 INFO:teuthology.orchestra.run.smithi012.stdout:1360 write 0x5ecc67e thru 0x5edbc7a (0xf5fd bytes) 2024-09-11T05:22:05.731 INFO:teuthology.orchestra.run.smithi012.stdout:1362 trunc from 0xaf099d5 to 0x56c188c 2024-09-11T05:22:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:1363 read 0x45f82bb thru 0x4604d88 (0xcace bytes) 2024-09-11T05:22:05.749 INFO:teuthology.orchestra.run.smithi012.stdout:1365 write 0x77074f9 thru 0x77096e8 (0x21f0 bytes) 2024-09-11T05:22:05.753 INFO:teuthology.orchestra.run.smithi012.stdout:1366 punch from 0x3a749fb to 0x3a7f3bc, (0xa9c1 bytes) 2024-09-11T05:22:05.753 INFO:teuthology.orchestra.run.smithi012.stdout:1369 read 0x44b8051 thru 0x44c5676 (0xd626 bytes) 2024-09-11T05:22:05.760 INFO:teuthology.orchestra.run.smithi012.stdout:1370 trunc from 0x77096e9 to 0xd7db0bb 2024-09-11T05:22:05.766 INFO:teuthology.orchestra.run.smithi012.stdout:1371 writesame 0xce991f1 thru 0xcea356e data_size 0x11(0xa37e bytes) 2024-09-11T05:22:05.772 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:05.773 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:05.779 INFO:teuthology.orchestra.run.smithi012.stdout:1372 trunc from 0xd7db0bb to 0x6916c44 2024-09-11T05:22:05.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:05.789 INFO:teuthology.orchestra.run.smithi012.stdout:1373 punch from 0x15f971d to 0x1605518, (0xbdfb bytes) 2024-09-11T05:22:05.796 INFO:teuthology.orchestra.run.smithi012.stdout:1374 write 0x78383cd thru 0x7841927 (0x955b bytes) 2024-09-11T05:22:05.798 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:05.797+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:05.799 INFO:teuthology.orchestra.run.smithi012.stdout:1375 read 0x3a26e0c thru 0x3a35b42 (0xed37 bytes) 2024-09-11T05:22:05.799 INFO:teuthology.orchestra.run.smithi012.stdout:1377 read 0x764dd4d thru 0x765c730 (0xe9e4 bytes) 2024-09-11T05:22:05.807 INFO:teuthology.orchestra.run.smithi012.stdout:1378 trunc from 0x7841928 to 0xd68e4c9 2024-09-11T05:22:05.813 INFO:teuthology.orchestra.run.smithi012.stdout:1380 punch from 0x1636f8c to 0x163db2c, (0x6ba0 bytes) 2024-09-11T05:22:05.813 INFO:teuthology.orchestra.run.smithi012.stdout:1381 write 0x30a7305 thru 0x30aadbc (0x3ab8 bytes) 2024-09-11T05:22:05.816 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.816 INFO:teuthology.orchestra.run.smithi012.stdout:1383 read 0x9aacbfc thru 0x9ab161e (0x4a23 bytes) 2024-09-11T05:22:05.816 INFO:teuthology.orchestra.run.smithi012.stdout:1385 write 0x86a6d41 thru 0x86b54ce (0xe78e bytes) 2024-09-11T05:22:05.821 INFO:teuthology.orchestra.run.smithi012.stdout:1386 write 0x172248d thru 0x1729710 (0x7284 bytes) 2024-09-11T05:22:05.826 INFO:teuthology.orchestra.run.smithi012.stdout:1387 read 0xd2b0632 thru 0xd2bfecd (0xf89c bytes) 2024-09-11T05:22:05.827 INFO:teuthology.orchestra.run.smithi012.stdout:1388 punch from 0x1e3e1a2 to 0x1e4d5b4, (0xf412 bytes) 2024-09-11T05:22:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:1389 write 0xe2f79bc thru 0xe2fb949 (0x3f8e bytes) 2024-09-11T05:22:05.837 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.846 INFO:teuthology.orchestra.run.smithi012.stdout:1391 trunc from 0xe2fb94a to 0x60a812a 2024-09-11T05:22:05.848 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:22:05.848+0000 7f4182606640 -1 mon.a@0(leader).osd e41 definitely_dead 0 2024-09-11T05:22:05.859 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.864 INFO:teuthology.orchestra.run.smithi012.stdout:1393 trunc from 0x60a812a to 0x24f3953 2024-09-11T05:22:05.890 INFO:teuthology.orchestra.run.smithi012.stdout:1394 read 0x2266ad4 thru 0x226ba35 (0x4f62 bytes) 2024-09-11T05:22:05.891 INFO:teuthology.orchestra.run.smithi012.stdout:1395 trunc from 0x24f3953 to 0x1b0b7c3 2024-09-11T05:22:05.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:05.899+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:05.923 INFO:teuthology.orchestra.run.smithi012.stdout:1396 punch from 0x353656 to 0x361905, (0xe2af bytes) 2024-09-11T05:22:05.926 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:05.926 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:05.934 INFO:teuthology.orchestra.run.smithi012.stdout:1397 writesame 0x686f1c4 thru 0x6875e93 data_size 0x8(0x6cd0 bytes) 2024-09-11T05:22:05.934 INFO:teuthology.orchestra.run.smithi012.stdout:1399 punch from 0x1ad88b1 to 0x1adf91f, (0x706e bytes) 2024-09-11T05:22:05.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:1400 writesame 0xd948a48 thru 0xd94e585 data_size 0x11(0x5b3e bytes) 2024-09-11T05:22:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:1401 punch from 0x8b35d46 to 0x8b3ce80, (0x713a bytes) 2024-09-11T05:22:05.953 INFO:teuthology.orchestra.run.smithi012.stdout:1403 writesame 0xded1956 thru 0xded2dfe data_size 0x29(0x14a9 bytes) 2024-09-11T05:22:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:1404 read 0x47b9d09 thru 0x47c9a2e (0xfd26 bytes) 2024-09-11T05:22:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:05.954 INFO:teuthology.orchestra.run.smithi012.stdout:1407 writesame 0x4e4a26b thru 0x4e58188 data_size 0x1(0xdf1e bytes) 2024-09-11T05:22:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:1409 punch from 0xc8bf03c to 0xc8c46e4, (0x56a8 bytes) 2024-09-11T05:22:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:1410 read 0x16d1427 thru 0x16deb19 (0xd6f3 bytes) 2024-09-11T05:22:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:1411 read 0x63979ef thru 0x639b1da (0x37ec bytes) 2024-09-11T05:22:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:1415 read 0x7499f51 thru 0x749df2a (0x3fda bytes) 2024-09-11T05:22:05.983 INFO:teuthology.orchestra.run.smithi012.stdout:1418 write 0xec2aa6f thru 0xec2ef21 (0x44b3 bytes) 2024-09-11T05:22:05.985 INFO:teuthology.orchestra.run.smithi012.stdout:1419 writesame 0xa4e4f03 thru 0xa4e73c2 data_size 0x54(0x24c0 bytes) 2024-09-11T05:22:05.989 INFO:teuthology.orchestra.run.smithi012.stdout:1422 flatten 2024-09-11T05:22:06.000 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:06.000+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:06.033 INFO:teuthology.orchestra.run.smithi012.stdout:1423 punch from 0xcd34330 to 0xcd40db7, (0xca87 bytes) 2024-09-11T05:22:06.033 INFO:teuthology.orchestra.run.smithi012.stdout:1424 writesame 0x6f95199 thru 0x6f9c90f data_size 0x11(0x7777 bytes) 2024-09-11T05:22:06.037 INFO:teuthology.orchestra.run.smithi012.stdout:1425 punch from 0x2166cfb to 0x217447b, (0xd780 bytes) 2024-09-11T05:22:06.037 INFO:teuthology.orchestra.run.smithi012.stdout:1426 read 0xbc936ff thru 0xbc9394e (0x250 bytes) 2024-09-11T05:22:06.043 INFO:teuthology.orchestra.run.smithi012.stdout:1427 trunc from 0xec2ef22 to 0x93e299a 2024-09-11T05:22:06.053 INFO:teuthology.orchestra.run.smithi012.stdout:1428 punch from 0x7148bf7 to 0x71527d3, (0x9bdc bytes) 2024-09-11T05:22:06.053 INFO:teuthology.orchestra.run.smithi012.stdout:1429 punch from 0x664e76 to 0x674097, (0xf221 bytes) 2024-09-11T05:22:06.053 INFO:teuthology.orchestra.run.smithi012.stdout:1430 read 0x791fdb2 thru 0x792f4b5 (0xf704 bytes) 2024-09-11T05:22:06.053 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.053 INFO:teuthology.orchestra.run.smithi012.stdout:1433 punch from 0x849ed0 to 0x8546a6, (0xa7d6 bytes) 2024-09-11T05:22:06.059 INFO:teuthology.orchestra.run.smithi012.stdout:1434 trunc from 0x93e299a to 0x368c4c7 2024-09-11T05:22:06.073 INFO:teuthology.orchestra.run.smithi012.stdout:1435 read 0xcfe995 thru 0xd00d89 (0x23f5 bytes) 2024-09-11T05:22:06.073 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.073 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.078 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:06.078 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:06.081 INFO:teuthology.orchestra.run.smithi012.stdout:1439 writesame 0x579ce70 thru 0x579cfc2 data_size 0x1(0x153 bytes) 2024-09-11T05:22:06.081 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:06.095 INFO:teuthology.orchestra.run.smithi012.stdout:1441 write 0xcd77f38 thru 0xcd83461 (0xb52a bytes) 2024-09-11T05:22:06.099 INFO:teuthology.orchestra.run.smithi012.stdout:1442 punch from 0x400cbdd to 0x4013eb9, (0x72dc bytes) 2024-09-11T05:22:06.099 INFO:teuthology.orchestra.run.smithi012.stdout:1443 read 0x694f1fe thru 0x695d5c3 (0xe3c6 bytes) 2024-09-11T05:22:06.100 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.100 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.100 INFO:teuthology.orchestra.run.smithi012.stdout:1447 read 0x63c13c3 thru 0x63c91ba (0x7df8 bytes) 2024-09-11T05:22:06.100 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.100 INFO:teuthology.orchestra.run.smithi012.stdout:1449 write 0xa3c9877 thru 0xa3d404b (0xa7d5 bytes) 2024-09-11T05:22:06.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:06.101+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:06.102 INFO:teuthology.orchestra.run.smithi012.stdout:1450 write 0x1b56c2a thru 0x1b61edc (0xb2b3 bytes) 2024-09-11T05:22:06.110 INFO:teuthology.orchestra.run.smithi012.stdout:1451 trunc from 0xcd83462 to 0x80496f9 2024-09-11T05:22:06.119 INFO:teuthology.orchestra.run.smithi012.stdout:1453 write 0x39806d5 thru 0x3987542 (0x6e6e bytes) 2024-09-11T05:22:06.122 INFO:teuthology.orchestra.run.smithi012.stdout:1454 read 0x392591d thru 0x3932f67 (0xd64b bytes) 2024-09-11T05:22:06.133 INFO:teuthology.orchestra.run.smithi012.stdout:1455 write 0xd305835 thru 0xd30f2ab (0x9a77 bytes) 2024-09-11T05:22:06.143 INFO:teuthology.orchestra.run.smithi012.stdout:1456 trunc from 0xd30f2ac to 0x8115b3f 2024-09-11T05:22:06.156 INFO:teuthology.orchestra.run.smithi012.stdout:1458 trunc from 0x8115b3f to 0x96fb8fe 2024-09-11T05:22:06.162 INFO:teuthology.orchestra.run.smithi012.stdout:1460 read 0x4598f59 thru 0x459d743 (0x47eb bytes) 2024-09-11T05:22:06.162 INFO:teuthology.orchestra.run.smithi012.stdout:1461 read 0x1a53fa9 thru 0x1a60f21 (0xcf79 bytes) 2024-09-11T05:22:06.172 INFO:teuthology.orchestra.run.smithi012.stdout:1463 write 0xd1a88bd thru 0xd1b01f5 (0x7939 bytes) 2024-09-11T05:22:06.178 INFO:teuthology.orchestra.run.smithi012.stdout:1464 read 0x6b58135 thru 0x6b67839 (0xf705 bytes) 2024-09-11T05:22:06.189 INFO:teuthology.orchestra.run.smithi012.stdout:1465 trunc from 0xd1b01f6 to 0x3ad1d3c 2024-09-11T05:22:06.202 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:06.202+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:06.203 INFO:teuthology.orchestra.run.smithi012.stdout:1466 trunc from 0x3ad1d3c to 0x293e4 2024-09-11T05:22:06.224 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:06.224 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:06.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:06.249 INFO:teuthology.orchestra.run.smithi012.stdout:1468 write 0xbd3dff2 thru 0xbd4cac4 (0xead3 bytes) 2024-09-11T05:22:06.258 INFO:teuthology.orchestra.run.smithi012.stdout:1470 trunc from 0xbd4cac5 to 0xdd73f18 2024-09-11T05:22:06.264 INFO:teuthology.orchestra.run.smithi012.stdout:1471 punch from 0x5c8b5ad to 0x5c99526, (0xdf79 bytes) 2024-09-11T05:22:06.265 INFO:teuthology.orchestra.run.smithi012.stdout:1472 read 0xa5031b7 thru 0xa51166d (0xe4b7 bytes) 2024-09-11T05:22:06.265 INFO:teuthology.orchestra.run.smithi012.stdout:1473 writesame 0xc3fed5a thru 0xc40a107 data_size 0x6d(0xb3ae bytes) 2024-09-11T05:22:06.276 INFO:teuthology.orchestra.run.smithi012.stdout:1474 write 0xe7a176b thru 0xe7aba9b (0xa331 bytes) 2024-09-11T05:22:06.279 INFO:teuthology.orchestra.run.smithi012.stdout:1475 read 0xc052bd4 thru 0xc05b6e6 (0x8b13 bytes) 2024-09-11T05:22:06.280 INFO:teuthology.orchestra.run.smithi012.stdout:1476 write 0xa8caf33 thru 0xa8d86cd (0xd79b bytes) 2024-09-11T05:22:06.285 INFO:teuthology.orchestra.run.smithi012.stdout:1479 trunc from 0xe7aba9c to 0xd5cef54 2024-09-11T05:22:06.295 INFO:teuthology.orchestra.run.smithi012.stdout:1480 read 0xc86de32 thru 0xc872a84 (0x4c53 bytes) 2024-09-11T05:22:06.295 INFO:teuthology.orchestra.run.smithi012.stdout:1481 write 0x409766f thru 0x409df11 (0x68a3 bytes) 2024-09-11T05:22:06.302 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:06.302+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:06.304 INFO:teuthology.orchestra.run.smithi012.stdout:1482 trunc from 0xd5cef54 to 0xa8ec3a5 2024-09-11T05:22:06.326 INFO:teuthology.orchestra.run.smithi012.stdout:1483 write 0xd47878b thru 0xd47b8b6 (0x312c bytes) 2024-09-11T05:22:06.329 INFO:teuthology.orchestra.run.smithi012.stdout:1484 write 0xaceb6a9 thru 0xacf8638 (0xcf90 bytes) 2024-09-11T05:22:06.335 INFO:teuthology.orchestra.run.smithi012.stdout:1485 punch from 0x9c14d70 to 0x9c1f352, (0xa5e2 bytes) 2024-09-11T05:22:06.335 INFO:teuthology.orchestra.run.smithi012.stdout:1486 writesame 0x930a70f thru 0x931032c data_size 0xd(0x5c1e bytes) 2024-09-11T05:22:06.339 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.339 INFO:teuthology.orchestra.run.smithi012.stdout:1488 read 0x7ffb3f thru 0x8044f0 (0x49b2 bytes) 2024-09-11T05:22:06.340 INFO:teuthology.orchestra.run.smithi012.stdout:1491 read 0x49ad78f thru 0x49b47a7 (0x7019 bytes) 2024-09-11T05:22:06.353 INFO:teuthology.orchestra.run.smithi012.stdout:1492 trunc from 0xd47b8b7 to 0x1f4b10a 2024-09-11T05:22:06.364 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.365 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.365 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.375 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:06.375 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:06.381 INFO:teuthology.orchestra.run.smithi012.stdout:1497 write 0xb891467 thru 0xb89ebce (0xd768 bytes) 2024-09-11T05:22:06.386 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:06.386 INFO:teuthology.orchestra.run.smithi012.stdout:1498 write 0x58ac4e5 thru 0x58b1d87 (0x58a3 bytes) 2024-09-11T05:22:06.390 INFO:teuthology.orchestra.run.smithi012.stdout:1499 read 0x661f043 thru 0x661f9dc (0x99a bytes) 2024-09-11T05:22:06.392 INFO:teuthology.orchestra.run.smithi012.stdout:1500 trunc from 0xb89ebcf to 0xd842d38 2024-09-11T05:22:06.397 INFO:teuthology.orchestra.run.smithi012.stdout:1501 write 0xba564aa thru 0xba5ecd3 (0x882a bytes) 2024-09-11T05:22:06.399 INFO:teuthology.orchestra.run.smithi012.stdout:1505 punch from 0x24b295 to 0x24eae5, (0x3850 bytes) 2024-09-11T05:22:06.399 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.399 INFO:teuthology.orchestra.run.smithi012.stdout:1509 writesame 0x6880c37 thru 0x68839db data_size 0x39(0x2da5 bytes) 2024-09-11T05:22:06.402 INFO:teuthology.orchestra.run.smithi012.stdout:1512 punch from 0x7dcd54d to 0x7dcfa3d, (0x24f0 bytes) 2024-09-11T05:22:06.402 INFO:teuthology.orchestra.run.smithi012.stdout:1513 punch from 0x6a9696c to 0x6a9e7a1, (0x7e35 bytes) 2024-09-11T05:22:06.402 INFO:teuthology.orchestra.run.smithi012.stdout:1514 writesame 0xb89b67e thru 0xb89b834 data_size 0x1(0x1b7 bytes) 2024-09-11T05:22:06.403 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.403 INFO:teuthology.orchestra.run.smithi012.stdout:1518 punch from 0xaf55a92 to 0xaf63c0c, (0xe17a bytes) 2024-09-11T05:22:06.403 INFO:teuthology.orchestra.run.smithi012.stdout:1523 read 0xd66c9fd thru 0xd677a46 (0xb04a bytes) 2024-09-11T05:22:06.404 INFO:teuthology.orchestra.run.smithi012.stdout:1524 read 0x1a3442d thru 0x1a3fb89 (0xb75d bytes) 2024-09-11T05:22:06.404 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.404 INFO:teuthology.orchestra.run.smithi012.stdout:1526 read 0x5083493 thru 0x508b550 (0x80be bytes) 2024-09-11T05:22:06.408 INFO:teuthology.orchestra.run.smithi012.stdout:1527 trunc from 0xd842d38 to 0x95f9137 2024-09-11T05:22:06.428 INFO:teuthology.orchestra.run.smithi012.stdout:1529 writesame 0xe3bd8b2 thru 0xe3c27b8 data_size 0x1(0x4f07 bytes) 2024-09-11T05:22:06.428 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.428 INFO:teuthology.orchestra.run.smithi012.stdout:1531 write 0x22a98ab thru 0x22b3320 (0x9a76 bytes) 2024-09-11T05:22:06.432 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:06.430+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:06.433 INFO:teuthology.orchestra.run.smithi012.stdout:1532 read 0x41bf33b thru 0x41cbdfb (0xcac1 bytes) 2024-09-11T05:22:06.433 INFO:teuthology.orchestra.run.smithi012.stdout:1533 writesame 0x1fdb02d thru 0x1fea24d data_size 0xa1(0xf221 bytes) 2024-09-11T05:22:06.435 INFO:teuthology.orchestra.run.smithi012.stdout:1535 writesame 0xd33be04 thru 0xd33d320 data_size 0x5(0x151d bytes) 2024-09-11T05:22:06.439 INFO:teuthology.orchestra.run.smithi012.stdout:1536 read 0x63deb28 thru 0x63ea687 (0xbb60 bytes) 2024-09-11T05:22:06.439 INFO:teuthology.orchestra.run.smithi012.stdout:1537 read 0xb303ad6 thru 0xb31336f (0xf89a bytes) 2024-09-11T05:22:06.439 INFO:teuthology.orchestra.run.smithi012.stdout:1538 write 0xa82c839 thru 0xa83c782 (0xff4a bytes) 2024-09-11T05:22:06.443 INFO:teuthology.orchestra.run.smithi012.stdout:1540 writesame 0xb0cb3a4 thru 0xb0dac9e data_size 0x1(0xf8fb bytes) 2024-09-11T05:22:06.463 INFO:teuthology.orchestra.run.smithi012.stdout:1541 write 0x1e3c01f thru 0x1e4b3fd (0xf3df bytes) 2024-09-11T05:22:06.466 INFO:teuthology.orchestra.run.smithi012.stdout:1543 writesame 0x3d1545a thru 0x3d16c26 data_size 0x3(0x17cd bytes) 2024-09-11T05:22:06.469 INFO:teuthology.orchestra.run.smithi012.stdout:1544 punch from 0x988b063 to 0x988e9f6, (0x3993 bytes) 2024-09-11T05:22:06.470 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.470 INFO:teuthology.orchestra.run.smithi012.stdout:1546 writesame 0xdb8dcfb thru 0xdb97c15 data_size 0x1(0x9f1b bytes) 2024-09-11T05:22:06.487 INFO:teuthology.orchestra.run.smithi012.stdout:1548 read 0x8756594 thru 0x8760fa1 (0xaa0e bytes) 2024-09-11T05:22:06.487 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.487 INFO:teuthology.orchestra.run.smithi012.stdout:1552 punch from 0x97e5a6f to 0x97eb7ad, (0x5d3e bytes) 2024-09-11T05:22:06.500 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:06.500 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:06.500 INFO:teuthology.orchestra.run.smithi012.stdout:1554 trunc from 0xe3c27b9 to 0x27ba73f 2024-09-11T05:22:06.504 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:06.504+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:06.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:marked in osd.6. 2024-09-11T05:22:06.521 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.521 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:06.521 INFO:teuthology.orchestra.run.smithi012.stdout:1558 read 0x19af816 thru 0x19b481a (0x5005 bytes) 2024-09-11T05:22:06.524 INFO:teuthology.orchestra.run.smithi012.stdout:1561 trunc from 0x27ba73f to 0x73634a 2024-09-11T05:22:06.535 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-09-11T05:22:06.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:06.604+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:06.655 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:06.655 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:06.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:06.707 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:06.707+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:06.766 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:06.766 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:06.775 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:06.806 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:06.806+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:06.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:06.907 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:06.907+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:06.918 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:06.918 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:06.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:06.977 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:06.978 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:06.995 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:07.010 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:07.011 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:07.010+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:07.026 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:07.045 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:07.045 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:07.059 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:07.070 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:07.070 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:07.071 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:07.071 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:07.071 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:07.076 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:07.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:07.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:07.093 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:07.108 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:07.108+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:07.209 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:07.209+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:07.226 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:07.226 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:07.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:07.226 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:07.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.226 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.226 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6287171090000001, 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:07.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6284896129999993, 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6282347989999995, 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.235 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:07.239 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6278659040000001, 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.243 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6277043580000008, 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6272616230000008, 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.62511473, 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.6230841779999992, 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:07.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.623063793, 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:07.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.268 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4058799880000006, 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:07.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:07.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4058589640000001, 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.273 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:07.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:07.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4058347090000005, 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:07.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:07.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.281 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4041556249999996, 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.282 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:07.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4041362789999994, 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4041155070000002, 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:07.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:07.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.404096097, 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:07.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:07.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4040756279999993, 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4040567379999995, 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.3947189449999993, 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.3947081190000006, 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.313 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.317 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:07.319 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:07.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:07.318+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:07.419 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:07.419+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:07.464 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:07.465 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:07.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:07.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:22:07.558 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:07.558+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:07.616 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:07.617 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:07.617 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:07.617 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:07.617 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:07.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:07.621+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:07.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:07.722 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:07.722+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:07.770 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:07.770 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:07.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:07.770 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:07.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:2884 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:head [write 294912~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:48.678482+0000", 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.090693654999999, 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039034730000000002, 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2884 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678482+0000", 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678482+0000", 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678484+0000", 2024-09-11T05:22:07.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6559999999999999e-06 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678505+0000", 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1563999999999999e-05 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678520+0000", 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4817999999999999e-05 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678527+0000", 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.849e-06 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678580+0000", 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3227999999999999e-05 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678639+0000", 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8730000000000002e-05 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.678712+0000", 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3608000000000004e-05 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.679381+0000", 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00066901500000000002 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.682322+0000", 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029404510000000002 2024-09-11T05:22:07.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.682356+0000", 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3813000000000003e-05 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:48.682385+0000", 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9740999999999999e-05 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3304 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:5 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.050147069000001, 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036699689999999999, 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3304 2024-09-11T05:22:07.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719029+0000", 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.34e-07 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719030+0000", 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0750000000000001e-06 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719033+0000", 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.932e-06 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719036+0000", 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.729e-06 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722506+0000", 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034706590000000001 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722587+0000", 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0753000000000004e-05 2024-09-11T05:22:07.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722699+0000", 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000111587 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3305 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:5 [read 753664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.719040+0000", 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.050135238999999, 2024-09-11T05:22:07.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038602720000000001, 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3305 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719040+0000", 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719040+0000", 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719041+0000", 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8099999999999999e-07 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719047+0000", 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.55e-06 2024-09-11T05:22:07.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719053+0000", 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719058+0000", 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6299999999999997e-06 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722733+0000", 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036753649999999999 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722808+0000", 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4493000000000007e-05 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722901+0000", 2024-09-11T05:22:07.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2696999999999997e-05 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3306 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:5 [read 901120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.050109701, 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039343149999999999, 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.786 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3306 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719068+0000", 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8989999999999999e-06 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719072+0000", 2024-09-11T05:22:07.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7689999999999998e-06 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719076+0000", 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722913+0000", 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038379439999999998 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722959+0000", 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5414000000000003e-05 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.723000+0000", 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1337000000000001e-05 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10509 3.10 3:0e4b85b7:::rbd_data.117977dc529b.0000000000000006:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.790 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.237047931999999, 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081221729999999999, 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10509 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:07.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532129+0000", 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.052e-06 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532146+0000", 2024-09-11T05:22:07.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6931000000000001e-05 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532158+0000", 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2207e-05 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532164+0000", 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2210000000000002e-06 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532223+0000", 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9338e-05 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532325+0000", 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101656 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.540250+0000", 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079247680000000004 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10994 3.10 3:0b01f203:::rbd_data.117977dc529b.0000000000000017:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.208174505000001, 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052453930000000001, 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10994 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561003+0000", 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.323e-06 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561010+0000", 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6420000000000001e-06 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561029+0000", 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8564999999999999e-05 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561039+0000", 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0046e-05 2024-09-11T05:22:07.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561107+0000", 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7922999999999993e-05 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561253+0000", 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014678200000000001 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.566247+0000", 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049931120000000001 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:11697 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.606149+0000", 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.163026584000001, 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035728240000000001, 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:07.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11697 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606149+0000", 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606149+0000", 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606151+0000", 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9939999999999999e-06 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606159+0000", 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606179+0000", 2024-09-11T05:22:07.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9748000000000001e-05 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606190+0000", 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606261+0000", 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0428999999999999e-05 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606349+0000", 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8140000000000007e-05 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.606522+0000", 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017370100000000001 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.607684+0000", 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001161182 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.609627+0000", 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019434400000000001 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.609683+0000", 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5968999999999999e-05 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.609722+0000", 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8911000000000001e-05 2024-09-11T05:22:07.804 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15281 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.795596599, 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035275279999999998, 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15281 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973579+0000", 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973582+0000", 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973588+0000", 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.635e-06 2024-09-11T05:22:07.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.973593+0000", 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0259999999999998e-06 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976966+0000", 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003372154 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977041+0000", 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5523000000000002e-05 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977107+0000", 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5463999999999995e-05 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15377 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:07.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.794627589999999, 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039582419999999998, 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15377 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:07.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974549+0000", 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3200000000000005e-07 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974551+0000", 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.706e-06 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974559+0000", 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4390000000000003e-06 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974564+0000", 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5249999999999996e-06 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977991+0000", 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003426742 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978091+0000", 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9469000000000006e-05 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978506+0000", 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00041572899999999999 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.813 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15378 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.794603073999999, 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00436718, 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15378 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974575+0000", 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3250000000000002e-06 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974582+0000", 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.951e-06 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974589+0000", 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0269999999999998e-06 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978537+0000", 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039479529999999997 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978616+0000", 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8851999999999997e-05 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978940+0000", 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000323572 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.818 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15379 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.7945788, 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045646519999999998, 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15379 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:07.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974599+0000", 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2139999999999999e-06 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974615+0000", 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5330999999999999e-05 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974621+0000", 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8069999999999996e-06 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978989+0000", 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043679410000000002 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979086+0000", 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7297e-05 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979161+0000", 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5617000000000005e-05 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15380 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.794546605000001, 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00473859, 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.823 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15380 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4900000000000001e-07 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974636+0000", 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974644+0000", 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4719999999999998e-06 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974649+0000", 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4210000000000003e-06 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979201+0000", 2024-09-11T05:22:07.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045517919999999998 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979287+0000", 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5981000000000002e-05 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979368+0000", 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0873999999999999e-05 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15506 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.792610117000001, 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035932709999999999, 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15506 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.828 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976566+0000", 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976569+0000", 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5229999999999998e-06 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976576+0000", 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1489999999999997e-06 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976582+0000", 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0009999999999998e-06 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979827+0000", 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032456730000000001 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979873+0000", 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.596e-05 2024-09-11T05:22:07.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980159+0000", 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000285493 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15507 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 229376~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.976980+0000", 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.792195694, 2024-09-11T05:22:07.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035477939999999999, 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15507 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976980+0000", 2024-09-11T05:22:07.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976980+0000", 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976981+0000", 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8500000000000001e-07 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976984+0000", 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6950000000000002e-06 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.976993+0000", 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7150000000000004e-06 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977000+0000", 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5350000000000001e-06 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980202+0000", 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032027700000000002 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980261+0000", 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9049999999999999e-05 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980528+0000", 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026634400000000001 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.836 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15508 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.977010+0000", 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.792165503, 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039256689999999997, 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15508 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977010+0000", 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977010+0000", 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977011+0000", 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977013+0000", 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977020+0000", 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9090000000000003e-06 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977025+0000", 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2449999999999998e-06 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980552+0000", 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035271959999999998 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980621+0000", 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9010000000000005e-05 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.980936+0000", 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031442999999999998 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.841 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16758 3.10 3:0ff05fec:::rbd_data.1179c3639760.000000000000000a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.411257783, 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0180985, 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16758 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357923+0000", 2024-09-11T05:22:07.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3120000000000001e-06 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357935+0000", 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2104e-05 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357951+0000", 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5818999999999999e-05 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357961+0000", 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5980000000000003e-06 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358021+0000", 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0650999999999999e-05 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358125+0000", 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103479 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.361575+0000", 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034500619999999998 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375931+0000", 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014355698 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375944+0000", 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3328e-05 2024-09-11T05:22:07.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375980+0000", 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5760999999999999e-05 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.376016+0000", 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6687999999999998e-05 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16758 3.10 e32/22 ondisk, result = 0)", 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.400753012999999, 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075142530000000003, 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:07.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368424+0000", 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3120000000000001e-06 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368431+0000", 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8129999999999998e-06 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368448+0000", 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6980999999999999e-05 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368458+0000", 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375910+0000", 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074519 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375918+0000", 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9589999999999995e-06 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375937+0000", 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8527999999999999e-05 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.851 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16860 3.a 3:55f78c79:::rbd_data.1179c3639760.000000000000000e:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.237367534000001, 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014769262999999999, 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16860 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531809+0000", 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531813+0000", 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3730000000000003e-06 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531824+0000", 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0494e-05 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531829+0000", 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1669999999999998e-06 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531878+0000", 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9027999999999999e-05 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531974+0000", 2024-09-11T05:22:07.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5874999999999999e-05 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.534209+0000", 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022353020000000002 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546470+0000", 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012260630999999999 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546499+0000", 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9436000000000001e-05 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546545+0000", 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5445999999999998e-05 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546577+0000", 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2536999999999997e-05 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.857 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16860 3.a e32/22 ondisk, result = 0)", 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.227051686999999, 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044590660000000002, 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542125+0000", 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.096e-06 2024-09-11T05:22:07.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542128+0000", 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0639999999999998e-06 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542139+0000", 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0915e-05 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542148+0000", 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6060000000000003e-06 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546490+0000", 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043424780000000003 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546496+0000", 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0000000000000002e-06 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546583+0000", 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6907e-05 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39459 3.a 3:54bd4aae:::rbd_data.1179ab1e2350.0000000000000015:head [write 0~0] snapc a=[a] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.9306290520000005, 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041154470000000004, 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39459 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2099999999999997e-07 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838550+0000", 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4540000000000001e-06 2024-09-11T05:22:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838555+0000", 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838558+0000", 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4709999999999999e-06 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839659+0000", 2024-09-11T05:22:07.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011004089999999999 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839734+0000", 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4967000000000002e-05 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839916+0000", 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018229300000000001 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:07.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842435+0000", 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002519257 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842572+0000", 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013645199999999999 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:07.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842619+0000", 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7586000000000001e-05 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842662+0000", 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2879000000000001e-05 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:07.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:07.869 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:07.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:07.870 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:07.869+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:07.971 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:07.971+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:08.014 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:08.015 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:08.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:08.072 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:08.072+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:08.126 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:08.127 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:08.127 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:08.127 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:08.127 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:08.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:08.180 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:08.180+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:08.241 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.489904889999998, 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13304 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1671168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486863140000001, 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016884531000000001, 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13304 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753658+0000", 2024-09-11T05:22:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.41e-07 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753660+0000", 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.68e-06 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753666+0000", 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9889999999999997e-06 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753670+0000", 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:22:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770413+0000", 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016742694999999998 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770479+0000", 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5858999999999994e-05 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770542+0000", 2024-09-11T05:22:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3689000000000006e-05 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13309 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 2048000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753675+0000", 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486845626999999, 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016881598000000001, 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13309 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753675+0000", 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753675+0000", 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753676+0000", 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753677+0000", 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.562e-06 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753683+0000", 2024-09-11T05:22:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5110000000000003e-06 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753689+0000", 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9309999999999996e-06 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770404+0000", 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016715601 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770469+0000", 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4344999999999995e-05 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770557+0000", 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8121000000000006e-05 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486826327999999, 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486809028, 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486782993, 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486766767000001, 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486744311000001, 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486710232, 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486672610999999, 2024-09-11T05:22:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486107771, 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.486058673, 2024-09-11T05:22:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.201403595, 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.201383977000001, 2024-09-11T05:22:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.198793923, 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16063 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 344064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.198405148000001, 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016861359999999999, 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16063 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042116+0000", 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:22:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042118+0000", 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0710000000000002e-06 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042125+0000", 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4690000000000002e-06 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042130+0000", 2024-09-11T05:22:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1789999999999999e-06 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058816+0000", 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016686014999999998 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058885+0000", 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9671000000000004e-05 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058977+0000", 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1584999999999998e-05 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.198363780999999, 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.198329361000001, 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.147239046999999, 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0767874300000004, 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:08.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:08.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:08.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:08.336 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:08.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:08.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:08.337+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:08.401 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:22:08.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:08.438+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:08.460 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:08.461 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:08.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:08.503 INFO:teuthology.orchestra.run.smithi012.stdout:1562 write 0x239b2f1 thru 0x23a6f38 (0xbc48 bytes) 2024-09-11T05:22:08.508 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:08.508 INFO:teuthology.orchestra.run.smithi012.stdout:1564 read 0x1946f47 thru 0x1956a7c (0xfb36 bytes) 2024-09-11T05:22:08.524 INFO:teuthology.orchestra.run.smithi012.stdout:1566 write 0x9abca6b thru 0x9ac5316 (0x88ac bytes) 2024-09-11T05:22:08.529 INFO:teuthology.orchestra.run.smithi012.stdout:1567 read 0x94930e4 thru 0x949f456 (0xc373 bytes) 2024-09-11T05:22:08.535 INFO:teuthology.orchestra.run.smithi012.stdout:1571 trunc from 0x9ac5317 to 0x4e40a53 2024-09-11T05:22:08.538 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:08.538+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:08.545 INFO:teuthology.orchestra.run.smithi012.stdout:1572 read 0x4085aa1 thru 0x408f34d (0x98ad bytes) 2024-09-11T05:22:08.559 INFO:teuthology.orchestra.run.smithi012.stdout:1573 write 0xc83073b thru 0xc83f670 (0xef36 bytes) 2024-09-11T05:22:08.566 INFO:teuthology.orchestra.run.smithi012.stdout:1575 write 0x2b28efc thru 0x2b293a1 (0x4a6 bytes) 2024-09-11T05:22:08.570 INFO:teuthology.orchestra.run.smithi012.stdout:1576 writesame 0x73206c9 thru 0x7321c12 data_size 0xa(0x154a bytes) 2024-09-11T05:22:08.574 INFO:teuthology.orchestra.run.smithi012.stdout:1577 punch from 0x42cbd89 to 0x42db0f8, (0xf36f bytes) 2024-09-11T05:22:08.574 INFO:teuthology.orchestra.run.smithi012.stdout:1578 writesame 0x94c6a8e thru 0x94d2f76 data_size 0x9(0xc4e9 bytes) 2024-09-11T05:22:08.588 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:08.588 INFO:teuthology.orchestra.run.smithi012.stdout:1581 write 0x30b11c9 thru 0x30bad90 (0x9bc8 bytes) 2024-09-11T05:22:08.592 INFO:teuthology.orchestra.run.smithi012.stdout:1583 read 0x7069167 thru 0x70748e8 (0xb782 bytes) 2024-09-11T05:22:08.592 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:08.592 INFO:teuthology.orchestra.run.smithi012.stdout:1585 trunc from 0xc83f671 to 0xbf4d9aa 2024-09-11T05:22:08.602 INFO:teuthology.orchestra.run.smithi012.stdout:1586 clone 12 order 23 su 524288 sc 9 2024-09-11T05:22:08.636 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:08.636 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:08.636 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:08.636 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:08.636 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:08.639 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:08.640+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:08.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:08.741 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:08.740+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13634 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779383+0000", 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.024227988, 2024-09-11T05:22:08.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024926967000000001, 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13634 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779383+0000", 2024-09-11T05:22:08.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779383+0000", 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779384+0000", 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779390+0000", 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.942e-06 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779396+0000", 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779401+0000", 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0980000000000001e-06 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804162+0000", 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02476105 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804228+0000", 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6277000000000003e-05 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804310+0000", 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1882e-05 2024-09-11T05:22:08.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13638 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.024203421999999, 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025061597000000001, 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.810 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13638 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779410+0000", 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779416+0000", 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9909999999999999e-06 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779421+0000", 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0209999999999999e-06 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804340+0000", 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024918549000000002 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804406+0000", 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6568000000000004e-05 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804469+0000", 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2989000000000003e-05 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13643 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:08.814 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.024164880000001, 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025233829999999999, 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13643 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:08.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779447+0000", 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.75e-07 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779449+0000", 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779455+0000", 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1500000000000004e-06 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779461+0000", 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1260000000000003e-06 2024-09-11T05:22:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804514+0000", 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025052479999999999 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804583+0000", 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9029000000000006e-05 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804680+0000", 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7545000000000002e-05 2024-09-11T05:22:08.818 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13652 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 294912~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.024068652, 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025318401000000001, 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.819 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13652 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:08.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779545+0000", 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.891e-06 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779551+0000", 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9549999999999997e-06 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779556+0000", 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7110000000000003e-06 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804709+0000", 2024-09-11T05:22:08.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025153117999999999 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804776+0000", 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6981000000000001e-05 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804861+0000", 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5323999999999998e-05 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.823 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13886 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 1622016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.786580+0000", 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.017030982, 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024917567000000002, 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13886 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786580+0000", 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786580+0000", 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786581+0000", 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786583+0000", 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9460000000000001e-06 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786589+0000", 2024-09-11T05:22:08.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0839999999999997e-06 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786594+0000", 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8040000000000001e-06 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.811359+0000", 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024764936000000001 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.811428+0000", 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9968000000000005e-05 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.811498+0000", 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299000000000002e-05 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.828 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13911 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1114112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787384+0000", 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.016226810999999, 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025001367, 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13911 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787384+0000", 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787384+0000", 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787385+0000", 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7299999999999996e-07 2024-09-11T05:22:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787387+0000", 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.057e-06 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787394+0000", 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787399+0000", 2024-09-11T05:22:08.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812235+0000", 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024836231 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812300+0000", 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5411000000000001e-05 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812386+0000", 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5377000000000006e-05 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13921 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1589248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.016184688999999, 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025139273, 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13921 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787429+0000", 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0760000000000001e-06 2024-09-11T05:22:08.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787437+0000", 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9440000000000005e-06 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787442+0000", 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4269999999999999e-06 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812415+0000", 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024972437 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812485+0000", 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0278999999999996e-05 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812566+0000", 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0607999999999998e-05 2024-09-11T05:22:08.837 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13925 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1687552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.016138132, 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025253827999999999, 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.838 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13925 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787474+0000", 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787483+0000", 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4499999999999993e-06 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787492+0000", 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1360000000000003e-06 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787498+0000", 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5709999999999997e-06 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812594+0000", 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025096207999999998 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812660+0000", 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6450000000000002e-05 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812727+0000", 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6470999999999994e-05 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13928 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1867776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.016048421000001, 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025330478, 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13928 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.843 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:08.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787565+0000", 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787573+0000", 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7239999999999992e-06 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787578+0000", 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3399999999999997e-06 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812757+0000", 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025178493999999999 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812820+0000", 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2948999999999996e-05 2024-09-11T05:22:08.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812893+0000", 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3484000000000003e-05 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13937 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.015997302000001, 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025471521, 2024-09-11T05:22:08.847 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13937 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1200000000000003e-07 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787617+0000", 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3999999999999999e-06 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787624+0000", 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4869999999999996e-06 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787630+0000", 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812924+0000", 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025294265999999999 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812992+0000", 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7691e-05 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813085+0000", 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3604999999999996e-05 2024-09-11T05:22:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13942 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 131072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.015940204, 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025635227, 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.852 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13942 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7300000000000001e-07 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787673+0000", 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787680+0000", 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1600000000000001e-06 2024-09-11T05:22:08.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787686+0000", 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.434e-06 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813152+0000", 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025466329999999999 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813216+0000", 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4162e-05 2024-09-11T05:22:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813306+0000", 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9821000000000006e-05 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13956 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.01580635, 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025691571, 2024-09-11T05:22:08.856 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13956 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787806+0000", 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4799999999999998e-07 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787816+0000", 2024-09-11T05:22:08.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0158e-05 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787825+0000", 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5140000000000007e-06 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787832+0000", 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4779999999999996e-06 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813341+0000", 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025509245 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813410+0000", 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-05 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813496+0000", 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428000000000007e-05 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13967 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.015769665000001, 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02584034, 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13967 2024-09-11T05:22:08.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:08.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787845+0000", 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787852+0000", 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4479999999999997e-06 2024-09-11T05:22:08.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787858+0000", 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6930000000000004e-06 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813529+0000", 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025671619999999999 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813601+0000", 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1988000000000003e-05 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813682+0000", 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0479e-05 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13970 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.015746144, 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025988694, 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13970 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787866+0000", 2024-09-11T05:22:08.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7399999999999998e-07 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787868+0000", 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0880000000000002e-06 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787874+0000", 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3670000000000002e-06 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787879+0000", 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1850000000000003e-06 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813706+0000", 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025827096000000001 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813777+0000", 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0894000000000003e-05 2024-09-11T05:22:08.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813854+0000", 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6589999999999997e-05 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13977 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 589824~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.015678556999999, 2024-09-11T05:22:08.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026082164000000001, 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13977 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:08.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3499999999999996e-07 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787935+0000", 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.221e-06 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787942+0000", 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787947+0000", 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813878+0000", 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025930385 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813939+0000", 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0980000000000002e-05 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814015+0000", 2024-09-11T05:22:08.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6143000000000006e-05 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13980 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 15.015656870999999, 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026221787999999999, 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.875 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13980 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:08.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787955+0000", 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787957+0000", 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0339999999999999e-06 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787964+0000", 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7830000000000001e-06 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787969+0000", 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2660000000000001e-06 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814039+0000", 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026070336 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814099+0000", 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0109000000000003e-05 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814176+0000", 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6903999999999994e-05 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15856 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 196608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.762375522999999, 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024896165000000001, 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15856 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:08.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041246+0000", 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7259999999999997e-06 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041253+0000", 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041258+0000", 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4199999999999998e-06 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.065782+0000", 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024524293999999999 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.065826+0000", 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3934999999999999e-05 2024-09-11T05:22:08.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066132+0000", 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00030564200000000001 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15857 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.762346099, 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025310777999999999, 2024-09-11T05:22:08.884 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15857 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041266+0000", 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041268+0000", 2024-09-11T05:22:08.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-06 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041274+0000", 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041278+0000", 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6240000000000001e-06 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066166+0000", 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024887713999999998 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066250+0000", 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3984000000000001e-05 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066576+0000", 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000325927 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.888 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15858 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.762327246, 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025727013, 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15858 2024-09-11T05:22:08.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9799999999999999e-07 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041286+0000", 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9240000000000001e-06 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041292+0000", 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6289999999999998e-06 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041296+0000", 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5410000000000002e-06 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066624+0000", 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025327692999999998 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066719+0000", 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5425000000000002e-05 2024-09-11T05:22:08.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.067011+0000", 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00029150299999999998 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59621 3.18 e40/22 3:1e993c26:::rbd_data.117971c15f82.0000000000000000:head v 40'416, mlcod=40'414)", 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.641454338, 2024-09-11T05:22:08.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029790078000000001, 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:08.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162160+0000", 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9809999999999999e-06 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165939+0000", 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003779634 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165978+0000", 2024-09-11T05:22:08.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8043000000000002e-05 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165988+0000", 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0624e-05 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166085+0000", 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6847000000000003e-05 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166115+0000", 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9808e-05 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191879+0000", 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025764502000000002 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191947+0000", 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7638999999999994e-05 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.897 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.898 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.898 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:08.898 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:08.898 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:08.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:08.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:08.899+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:09.000 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:09.000+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:09.047 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:09.047 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:09.048 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:09.048 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:09.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:09.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:09.101+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:09.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:09.164 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:09.165 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:09.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:09.202 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:09.201+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:09.231 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:09.231 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:09.248 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:09.249 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:09.265 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:09.265 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:09.281 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:09.282 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:09.283 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:09.284 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:09.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:09.299 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:09.299 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:09.302 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:09.302+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:09.403 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:09.403+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:09.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:09.504 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:09.504+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:09.539 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:09.560 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:09.564 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:09.565 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:09.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:09.605 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:09.605+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:09.707 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:09.706+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:09.722 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:09.722 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:09.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:09.808 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:09.808+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:09.838 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:09.839 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:09.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:09.909 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:09.908+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:09.994 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:09.994 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:10.010 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:10.009+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:10.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:10.110+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:10.111 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:10.111 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.119 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:10.211 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:10.211+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:10.235 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:10.235 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.244 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:10.312 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:10.312+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:10.348 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:10.348 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.356 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:10.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:10.413+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:10.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:22:10.500 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:10.501 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.509 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:10.514 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:10.514+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:10.614 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:10.614+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:10.617 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:10.617 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:10.685 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-11T05:22:10.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:10.715+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:10.770 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:10.771 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.775 INFO:teuthology.orchestra.run.smithi012.stdout:1587 punch from 0x61c60bb to 0x61d3ae3, (0xda28 bytes) 2024-09-11T05:22:10.778 INFO:teuthology.orchestra.run.smithi012.stdout:1588 read 0x81d37fe thru 0x81da425 (0x6c28 bytes) 2024-09-11T05:22:10.779 INFO:teuthology.orchestra.run.smithi012.stdout:1590 punch from 0x1cf50d4 to 0x1cfdc29, (0x8b55 bytes) 2024-09-11T05:22:10.779 INFO:teuthology.orchestra.run.smithi012.stdout:1591 write 0x60e14d4 thru 0x60e48ab (0x33d8 bytes) 2024-09-11T05:22:10.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:10.783 INFO:teuthology.orchestra.run.smithi012.stdout:1592 write 0x617be98 thru 0x6182559 (0x66c2 bytes) 2024-09-11T05:22:10.790 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:1595 write 0xd4165ab thru 0xd41b0f1 (0x4b47 bytes) 2024-09-11T05:22:10.801 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:10.801 INFO:teuthology.orchestra.run.smithi012.stdout:1597 writesame 0xaade506 thru 0xaae343d data_size 0x8(0x4f38 bytes) 2024-09-11T05:22:10.805 INFO:teuthology.orchestra.run.smithi012.stdout:1598 read 0xcef03f0 thru 0xcef1413 (0x1024 bytes) 2024-09-11T05:22:10.806 INFO:teuthology.orchestra.run.smithi012.stdout:1599 punch from 0x32da2b7 to 0x32dee72, (0x4bbb bytes) 2024-09-11T05:22:10.806 INFO:teuthology.orchestra.run.smithi012.stdout:1600 writesame 0x3418566 thru 0x341a4c2 data_size 0x7(0x1f5d bytes) 2024-09-11T05:22:10.815 INFO:teuthology.orchestra.run.smithi012.stdout:1602 trunc from 0xd41b0f2 to 0xae85d6c 2024-09-11T05:22:10.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:10.815+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:10.840 INFO:teuthology.orchestra.run.smithi012.stdout:1603 writesame 0xe86d398 thru 0xe875435 data_size 0x1(0x809e bytes) 2024-09-11T05:22:10.840 INFO:teuthology.orchestra.run.smithi012.stdout:1605 read 0xd799674 thru 0xd79b98f (0x231c bytes) 2024-09-11T05:22:10.840 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:10.840 INFO:teuthology.orchestra.run.smithi012.stdout:1607 write 0x4a6716c thru 0x4a6ab62 (0x39f7 bytes) 2024-09-11T05:22:10.842 INFO:teuthology.orchestra.run.smithi012.stdout:1608 read 0x76b58d7 thru 0x76ba23f (0x4969 bytes) 2024-09-11T05:22:10.842 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:10.842 INFO:teuthology.orchestra.run.smithi012.stdout:1610 punch from 0xbf2ee06 to 0xbf3ad3c, (0xbf36 bytes) 2024-09-11T05:22:10.845 INFO:teuthology.orchestra.run.smithi012.stdout:1611 trunc from 0xe875436 to 0xaefc8c3 2024-09-11T05:22:10.852 INFO:teuthology.orchestra.run.smithi012.stdout:1612 read 0x9bacfed thru 0x9bbba50 (0xea64 bytes) 2024-09-11T05:22:10.853 INFO:teuthology.orchestra.run.smithi012.stdout:1614 writesame 0x6d8f66d thru 0x6d99007 data_size 0x1(0x999b bytes) 2024-09-11T05:22:10.880 INFO:teuthology.orchestra.run.smithi012.stdout:1615 trunc from 0xaefc8c3 to 0xe8e3400 2024-09-11T05:22:10.885 INFO:teuthology.orchestra.run.smithi012.stdout:1617 write 0x24d64c1 thru 0x24dcea8 (0x69e8 bytes) 2024-09-11T05:22:10.889 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:10.890 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:10.890 INFO:teuthology.orchestra.run.smithi012.stdout:1618 read 0xd810807 thru 0xd8205a7 (0xfda1 bytes) 2024-09-11T05:22:10.890 INFO:teuthology.orchestra.run.smithi012.stdout:1620 write 0xab9e68e thru 0xaba56e0 (0x7053 bytes) 2024-09-11T05:22:10.891 INFO:teuthology.orchestra.run.smithi012.stdout:1621 write 0x79c9e68 thru 0x79cc659 (0x27f2 bytes) 2024-09-11T05:22:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:1622 punch from 0x2a1fa06 to 0x2a24051, (0x464b bytes) 2024-09-11T05:22:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:1623 trunc from 0xe8e3400 to 0xe6cea1b 2024-09-11T05:22:10.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:10.900 INFO:teuthology.orchestra.run.smithi012.stdout:1624 write 0x35c8894 thru 0x35d2dfc (0xa569 bytes) 2024-09-11T05:22:10.905 INFO:teuthology.orchestra.run.smithi012.stdout:1625 read 0x501d70a thru 0x501ed01 (0x15f8 bytes) 2024-09-11T05:22:10.905 INFO:teuthology.orchestra.run.smithi012.stdout:1626 punch from 0xce1c32a to 0xce2b5da, (0xf2b0 bytes) 2024-09-11T05:22:10.920 INFO:teuthology.orchestra.run.smithi012.stdout:1627 trunc from 0xe6cea1b to 0xf38529 2024-09-11T05:22:10.942 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:10.942+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:10.955 INFO:teuthology.orchestra.run.smithi012.stdout:1629 writesame 0x35151eb thru 0x35182a0 data_size 0x2b(0x30b6 bytes) 2024-09-11T05:22:10.956 INFO:teuthology.orchestra.run.smithi012.stdout:1630 read 0x34e2221 thru 0x34ebd88 (0x9b68 bytes) 2024-09-11T05:22:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:1632 write 0x4af4236 thru 0x4afc2f3 (0x80be bytes) 2024-09-11T05:22:10.969 INFO:teuthology.orchestra.run.smithi012.stdout:1635 read 0x3856e15 thru 0x385a9b8 (0x3ba4 bytes) 2024-09-11T05:22:10.969 INFO:teuthology.orchestra.run.smithi012.stdout:1636 read 0x1f20264 thru 0x1f26f0d (0x6caa bytes) 2024-09-11T05:22:10.969 INFO:teuthology.orchestra.run.smithi012.stdout:1638 read 0x1317636 thru 0x131f24e (0x7c19 bytes) 2024-09-11T05:22:10.969 INFO:teuthology.orchestra.run.smithi012.stdout:1639 write 0x3cfcad5 thru 0x3d095cd (0xcaf9 bytes) 2024-09-11T05:22:10.980 INFO:teuthology.orchestra.run.smithi012.stdout:1640 writesame 0x5f0e470 thru 0x5f10080 data_size 0x5(0x1c11 bytes) 2024-09-11T05:22:10.980 INFO:teuthology.orchestra.run.smithi012.stdout:truncating to largest ever: 0xedb6923 2024-09-11T05:22:10.990 INFO:teuthology.orchestra.run.smithi012.stdout:1641 trunc from 0x5f10081 to 0xedb6923 2024-09-11T05:22:10.995 INFO:teuthology.orchestra.run.smithi012.stdout:1644 write 0x9014bda thru 0x901b54c (0x6973 bytes) 2024-09-11T05:22:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:1645 punch from 0xb0f354a to 0xb0fb62e, (0x80e4 bytes) 2024-09-11T05:22:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:1648 read 0xc3b192a thru 0xc3b831b (0x69f2 bytes) 2024-09-11T05:22:11.008 INFO:teuthology.orchestra.run.smithi012.stdout:1649 trunc from 0xedb6923 to 0x5f5571a 2024-09-11T05:22:11.010 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:11.010 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:11.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:11.016+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:11.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.026 INFO:teuthology.orchestra.run.smithi012.stdout:1652 trunc from 0x5f5571a to 0x6ffbe4 2024-09-11T05:22:11.053 INFO:teuthology.orchestra.run.smithi012.stdout:1653 write 0x69583ba thru 0x6960bcb (0x8812 bytes) 2024-09-11T05:22:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:1655 read 0x3faa841 thru 0x3fad97a (0x313a bytes) 2024-09-11T05:22:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:1656 read 0x410996f thru 0x4118cbf (0xf351 bytes) 2024-09-11T05:22:11.057 INFO:teuthology.orchestra.run.smithi012.stdout:1657 trunc from 0x6960bcc to 0x78ce6de 2024-09-11T05:22:11.075 INFO:teuthology.orchestra.run.smithi012.stdout:1659 writesame 0xe2dce32 thru 0xe2ea9e9 data_size 0x59(0xdbb8 bytes) 2024-09-11T05:22:11.075 INFO:teuthology.orchestra.run.smithi012.stdout:1660 writesame 0x8e93d4e thru 0x8e94192 data_size 0x1(0x445 bytes) 2024-09-11T05:22:11.078 INFO:teuthology.orchestra.run.smithi012.stdout:1661 writesame 0x5fc54be thru 0x5fc9a34 data_size 0x1(0x4577 bytes) 2024-09-11T05:22:11.088 INFO:teuthology.orchestra.run.smithi012.stdout:1664 punch from 0x8add189 to 0x8ae7f62, (0xadd9 bytes) 2024-09-11T05:22:11.088 INFO:teuthology.orchestra.run.smithi012.stdout:1665 writesame 0xd034261 thru 0xd034329 data_size 0x1(0xc9 bytes) 2024-09-11T05:22:11.091 INFO:teuthology.orchestra.run.smithi012.stdout:1667 writesame 0x3f39c61 thru 0x3f3c49a data_size 0x13(0x283a bytes) 2024-09-11T05:22:11.092 INFO:teuthology.orchestra.run.smithi012.stdout:1668 write 0xae2e5d thru 0xaefa44 (0xcbe8 bytes) 2024-09-11T05:22:11.094 INFO:teuthology.orchestra.run.smithi012.stdout:1670 writesame 0x4defd8e thru 0x4df6fdf data_size 0x1(0x7252 bytes) 2024-09-11T05:22:11.108 INFO:teuthology.orchestra.run.smithi012.stdout:1673 read 0x74cd519 thru 0x74d9769 (0xc251 bytes) 2024-09-11T05:22:11.108 INFO:teuthology.orchestra.run.smithi012.stdout:1674 writesame 0xd2c388b thru 0xd2cd3ae data_size 0x2(0x9b24 bytes) 2024-09-11T05:22:11.117 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:11.117+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:1676 punch from 0x9aaf82e to 0x9abd54b, (0xdd1d bytes) 2024-09-11T05:22:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:1677 write 0x46c0a16 thru 0x46c4fb2 (0x459d bytes) 2024-09-11T05:22:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:1679 punch from 0x21ff1e8 to 0x220b2d4, (0xc0ec bytes) 2024-09-11T05:22:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:1680 read 0x6efdaad thru 0x6f0d34e (0xf8a2 bytes) 2024-09-11T05:22:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.127 INFO:teuthology.orchestra.run.smithi012.stdout:1688 write 0xe3cc3fc thru 0xe3db3b8 (0xefbd bytes) 2024-09-11T05:22:11.130 INFO:teuthology.orchestra.run.smithi012.stdout:1690 write 0xe122daf thru 0xe12a31c (0x756e bytes) 2024-09-11T05:22:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:1691 write 0x5110d6c thru 0x5112e7d (0x2112 bytes) 2024-09-11T05:22:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:1696 read 0x1dfe571 thru 0x1e0c717 (0xe1a7 bytes) 2024-09-11T05:22:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:1697 read 0x3d13613 thru 0x3d21723 (0xe111 bytes) 2024-09-11T05:22:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.137 INFO:teuthology.orchestra.run.smithi012.stdout:1701 writesame 0x5d7be40 thru 0x5d85584 data_size 0x5(0x9745 bytes) 2024-09-11T05:22:11.141 INFO:teuthology.orchestra.run.smithi012.stdout:1702 write 0x4fc6148 thru 0x4fd309c (0xcf55 bytes) 2024-09-11T05:22:11.143 INFO:teuthology.orchestra.run.smithi012.stdout:1705 writesame 0x4b26d47 thru 0x4b28fa3 data_size 0x1(0x225d bytes) 2024-09-11T05:22:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:1706 punch from 0x7ceac2 to 0x7d2cf8, (0x4236 bytes) 2024-09-11T05:22:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:1709 writesame 0x9c6f53d thru 0x9c79807 data_size 0x5(0xa2cb bytes) 2024-09-11T05:22:11.153 INFO:teuthology.orchestra.run.smithi012.stdout:1711 write 0x5674554 thru 0x567ba9b (0x7548 bytes) 2024-09-11T05:22:11.156 INFO:teuthology.orchestra.run.smithi012.stdout:1712 punch from 0x5a2e3eb to 0x5a3840e, (0xa023 bytes) 2024-09-11T05:22:11.156 INFO:teuthology.orchestra.run.smithi012.stdout:1717 write 0x5c5ef59 thru 0x5c643b9 (0x5461 bytes) 2024-09-11T05:22:11.158 INFO:teuthology.orchestra.run.smithi012.stdout:1719 read 0x72671a4 thru 0x72767af (0xf60c bytes) 2024-09-11T05:22:11.159 INFO:teuthology.orchestra.run.smithi012.stdout:1721 write 0xe2859e0 thru 0xe285f9e (0x5bf bytes) 2024-09-11T05:22:11.162 INFO:teuthology.orchestra.run.smithi012.stdout:1722 write 0x71f50ed thru 0x71faf0f (0x5e23 bytes) 2024-09-11T05:22:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:1723 write 0xbbbd8f0 thru 0xbbbe2ae (0x9bf bytes) 2024-09-11T05:22:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:1725 write 0xa8e52b0 thru 0xa8f26fd (0xd44e bytes) 2024-09-11T05:22:11.167 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.167 INFO:teuthology.orchestra.run.smithi012.stdout:1727 clone 13 order 20 su 131072 sc 5 2024-09-11T05:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:11.168 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:11.177 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:11.218 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:11.219+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:11.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:11.320+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:11.320 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:11.321 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:11.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:11.421 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:11.421+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:11.432 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:11.432 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:11.441 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:11.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:11.522+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:11.536 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:22:11.536 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:22:11.536 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T05:22:11.536 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 1.000000 2024-09-11T05:22:11.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-11T05:22:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:22:11.547 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:11.547 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:11.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:11.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:11.604 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone12 from 0xe3db3b9 (overlap 0x6ffbe4) to 0x37fdf2 2024-09-11T05:22:11.622 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:11.622+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:11.667 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:11.667 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:11.675 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-11T05:22:11.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:11.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:11.723+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:11.749 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:11.776 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:11.776 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:11.795 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:11.802 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:11.802 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:11.812 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:11.823 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:11.823 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:11.824 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:11.823+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:11.841 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:11.841 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:11.858 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:11.876 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:11.893 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:11.912 INFO:teuthology.orchestra.run.smithi012.stdout:1728 write 0x62e2fe4 thru 0x62e98ff (0x691c bytes) 2024-09-11T05:22:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:1729 punch from 0x48a5210 to 0x48b45fe, (0xf3ee bytes) 2024-09-11T05:22:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:1730 write 0x8f09ef2 thru 0x8f0f320 (0x542f bytes) 2024-09-11T05:22:11.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:11.924+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:11.925 INFO:teuthology.orchestra.run.smithi012.stdout:1732 read 0x986b861 thru 0x986f9cf (0x416f bytes) 2024-09-11T05:22:11.925 INFO:teuthology.orchestra.run.smithi012.stdout:1734 write 0xdd6e961 thru 0xdd71302 (0x29a2 bytes) 2024-09-11T05:22:11.929 INFO:teuthology.orchestra.run.smithi012.stdout:1735 write 0xddbdc7 thru 0xdeac83 (0xeebd bytes) 2024-09-11T05:22:11.935 INFO:teuthology.orchestra.run.smithi012.stdout:1736 write 0x25e7614 thru 0x25f4b3f (0xd52c bytes) 2024-09-11T05:22:11.938 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:11.938 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:11.940 INFO:teuthology.orchestra.run.smithi012.stdout:1737 write 0x140a583 thru 0x1417e06 (0xd884 bytes) 2024-09-11T05:22:11.944 INFO:teuthology.orchestra.run.smithi012.stdout:1738 write 0xa68bb99 thru 0xa68fdaf (0x4217 bytes) 2024-09-11T05:22:11.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:11.952 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.952 INFO:teuthology.orchestra.run.smithi012.stdout:1741 writesame 0x36b23c6 thru 0x36b9e9b data_size 0x9(0x7ad6 bytes) 2024-09-11T05:22:11.954 INFO:teuthology.orchestra.run.smithi012.stdout:1742 punch from 0x8cfc921 to 0x8d06476, (0x9b55 bytes) 2024-09-11T05:22:11.955 INFO:teuthology.orchestra.run.smithi012.stdout:1743 write 0x3e99653 thru 0x3e9f491 (0x5e3f bytes) 2024-09-11T05:22:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:1744 punch from 0x50d440f to 0x50d6df3, (0x29e4 bytes) 2024-09-11T05:22:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:1747 read 0x3e85fc0 thru 0x3e949b3 (0xe9f4 bytes) 2024-09-11T05:22:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:1749 punch from 0xd8eac9b to 0xd8ee392, (0x36f7 bytes) 2024-09-11T05:22:11.960 INFO:teuthology.orchestra.run.smithi012.stdout:1750 read 0xe3a823e thru 0xe3a8906 (0x6c9 bytes) 2024-09-11T05:22:11.960 INFO:teuthology.orchestra.run.smithi012.stdout:1751 read 0x1a10837 thru 0x1a1f326 (0xeaf0 bytes) 2024-09-11T05:22:11.971 INFO:teuthology.orchestra.run.smithi012.stdout:1755 trunc from 0xe3db3b9 to 0x4554946 2024-09-11T05:22:12.009 INFO:teuthology.orchestra.run.smithi012.stdout:1757 writesame 0xc83315c thru 0xc83886c data_size 0x1(0x5711 bytes) 2024-09-11T05:22:12.018 INFO:teuthology.orchestra.run.smithi012.stdout:1758 trunc from 0xc83886d to 0x436fba3 2024-09-11T05:22:12.024 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:12.024+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:12.025 INFO:teuthology.orchestra.run.smithi012.stdout:1759 punch from 0x2dfb3f0 to 0x2e0af5b, (0xfb6b bytes) 2024-09-11T05:22:12.025 INFO:teuthology.orchestra.run.smithi012.stdout:1760 read 0x400e2b2 thru 0x401a9a3 (0xc6f2 bytes) 2024-09-11T05:22:12.025 INFO:teuthology.orchestra.run.smithi012.stdout:1761 read 0x1ba929b thru 0x1bb881b (0xf581 bytes) 2024-09-11T05:22:12.025 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.037 INFO:teuthology.orchestra.run.smithi012.stdout:1766 trunc from 0x436fba3 to 0xe24b9fe 2024-09-11T05:22:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:1769 read 0x52ea049 thru 0x52f8fdd (0xef95 bytes) 2024-09-11T05:22:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:1771 read 0x71b07bc thru 0x71b91e4 (0x8a29 bytes) 2024-09-11T05:22:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:1772 write 0x6f011df thru 0x6f075fb (0x641d bytes) 2024-09-11T05:22:12.045 INFO:teuthology.orchestra.run.smithi012.stdout:1773 read 0x6c74129 thru 0x6c758ea (0x17c2 bytes) 2024-09-11T05:22:12.045 INFO:teuthology.orchestra.run.smithi012.stdout:1775 write 0x7048fa1 thru 0x70495f3 (0x653 bytes) 2024-09-11T05:22:12.046 INFO:teuthology.orchestra.run.smithi012.stdout:1777 read 0x2310a95 thru 0x231c352 (0xb8be bytes) 2024-09-11T05:22:12.046 INFO:teuthology.orchestra.run.smithi012.stdout:1779 write 0xddda2f5 thru 0xdde68b0 (0xc5bc bytes) 2024-09-11T05:22:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:1780 punch from 0x3e7c35e to 0x3e7d16f, (0xe11 bytes) 2024-09-11T05:22:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:1781 read 0x94fb70 thru 0x95a432 (0xa8c3 bytes) 2024-09-11T05:22:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:1782 write 0x73e97f4 thru 0x73f566a (0xbe77 bytes) 2024-09-11T05:22:12.054 INFO:teuthology.orchestra.run.smithi012.stdout:1783 writesame 0xc59c69e thru 0xc59df2e data_size 0x1(0x1891 bytes) 2024-09-11T05:22:12.058 INFO:teuthology.orchestra.run.smithi012.stdout:1784 read 0x553c932 thru 0x55480c9 (0xb798 bytes) 2024-09-11T05:22:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:1785 writesame 0xc27e9b9 thru 0xc280f47 data_size 0x1(0x258f bytes) 2024-09-11T05:22:12.077 INFO:teuthology.orchestra.run.smithi012.stdout:1786 trunc from 0xe24b9fe to 0x24869ca 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13634 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779383+0000", 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.299909354, 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024926967000000001, 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13634 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779383+0000", 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779383+0000", 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779384+0000", 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779390+0000", 2024-09-11T05:22:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.942e-06 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779396+0000", 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779401+0000", 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0980000000000001e-06 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804162+0000", 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02476105 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804228+0000", 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6277000000000003e-05 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804310+0000", 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1882e-05 2024-09-11T05:22:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13638 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.299884788, 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025061597000000001, 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13638 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779410+0000", 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779416+0000", 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9909999999999999e-06 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779421+0000", 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0209999999999999e-06 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804340+0000", 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024918549000000002 2024-09-11T05:22:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804406+0000", 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6568000000000004e-05 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804469+0000", 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2989000000000003e-05 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13643 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.299846246000001, 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025233829999999999, 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13643 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779447+0000", 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.75e-07 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779449+0000", 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779455+0000", 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1500000000000004e-06 2024-09-11T05:22:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779461+0000", 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1260000000000003e-06 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804514+0000", 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025052479999999999 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804583+0000", 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9029000000000006e-05 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804680+0000", 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7545000000000002e-05 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13652 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 294912~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.299750018000001, 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025318401000000001, 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13652 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779545+0000", 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.891e-06 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779551+0000", 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9549999999999997e-06 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779556+0000", 2024-09-11T05:22:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7110000000000003e-06 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804709+0000", 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025153117999999999 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804776+0000", 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6981000000000001e-05 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804861+0000", 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5323999999999998e-05 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13886 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 1622016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.786580+0000", 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.292712347999998, 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024917567000000002, 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13886 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786580+0000", 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786580+0000", 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786581+0000", 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786583+0000", 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9460000000000001e-06 2024-09-11T05:22:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786589+0000", 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0839999999999997e-06 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.786594+0000", 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8040000000000001e-06 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.811359+0000", 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024764936000000001 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.811428+0000", 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9968000000000005e-05 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.811498+0000", 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299000000000002e-05 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13911 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1114112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787384+0000", 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291908177, 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025001367, 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13911 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787384+0000", 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787384+0000", 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787385+0000", 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7299999999999996e-07 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787387+0000", 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.057e-06 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787394+0000", 2024-09-11T05:22:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787399+0000", 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812235+0000", 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024836231 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812300+0000", 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5411000000000001e-05 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812386+0000", 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5377000000000006e-05 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13921 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1589248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291866055, 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025139273, 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13921 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787429+0000", 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0760000000000001e-06 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787437+0000", 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9440000000000005e-06 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787442+0000", 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4269999999999999e-06 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812415+0000", 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024972437 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812485+0000", 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0278999999999996e-05 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812566+0000", 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0607999999999998e-05 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13925 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1687552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291819497999999, 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025253827999999999, 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13925 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787474+0000", 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787483+0000", 2024-09-11T05:22:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4499999999999993e-06 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787492+0000", 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1360000000000003e-06 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787498+0000", 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5709999999999997e-06 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812594+0000", 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025096207999999998 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812660+0000", 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6450000000000002e-05 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812727+0000", 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6470999999999994e-05 2024-09-11T05:22:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13928 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1867776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291729787000001, 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025330478, 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13928 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787565+0000", 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787573+0000", 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7239999999999992e-06 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787578+0000", 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3399999999999997e-06 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812757+0000", 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025178493999999999 2024-09-11T05:22:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812820+0000", 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2948999999999996e-05 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812893+0000", 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3484000000000003e-05 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13937 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291678667999999, 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025471521, 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13937 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1200000000000003e-07 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787617+0000", 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3999999999999999e-06 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787624+0000", 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4869999999999996e-06 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787630+0000", 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812924+0000", 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025294265999999999 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812992+0000", 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7691e-05 2024-09-11T05:22:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813085+0000", 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3604999999999996e-05 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13942 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 131072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.29162157, 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025635227, 2024-09-11T05:22:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13942 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7300000000000001e-07 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787673+0000", 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787680+0000", 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1600000000000001e-06 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787686+0000", 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.434e-06 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813152+0000", 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025466329999999999 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813216+0000", 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4162e-05 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813306+0000", 2024-09-11T05:22:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9821000000000006e-05 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13956 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291487715999999, 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025691571, 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13956 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787806+0000", 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4799999999999998e-07 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787816+0000", 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0158e-05 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787825+0000", 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5140000000000007e-06 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787832+0000", 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4779999999999996e-06 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813341+0000", 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025509245 2024-09-11T05:22:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813410+0000", 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-05 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813496+0000", 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428000000000007e-05 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13967 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291451031000001, 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02584034, 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13967 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787845+0000", 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787852+0000", 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4479999999999997e-06 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787858+0000", 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6930000000000004e-06 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813529+0000", 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025671619999999999 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813601+0000", 2024-09-11T05:22:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1988000000000003e-05 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813682+0000", 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0479e-05 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13970 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291427509999998, 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025988694, 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13970 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787866+0000", 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7399999999999998e-07 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787868+0000", 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0880000000000002e-06 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787874+0000", 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3670000000000002e-06 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787879+0000", 2024-09-11T05:22:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1850000000000003e-06 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813706+0000", 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025827096000000001 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813777+0000", 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0894000000000003e-05 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813854+0000", 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6589999999999997e-05 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13977 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 589824~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291359923000002, 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026082164000000001, 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13977 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3499999999999996e-07 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787935+0000", 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.221e-06 2024-09-11T05:22:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787942+0000", 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787947+0000", 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813878+0000", 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025930385 2024-09-11T05:22:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813939+0000", 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0980000000000002e-05 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814015+0000", 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6143000000000006e-05 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13980 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.291338237000001, 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026221787999999999, 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13980 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787955+0000", 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787957+0000", 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0339999999999999e-06 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787964+0000", 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7830000000000001e-06 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787969+0000", 2024-09-11T05:22:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2660000000000001e-06 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814039+0000", 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026070336 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814099+0000", 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0109000000000003e-05 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814176+0000", 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6903999999999994e-05 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15856 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 196608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.038056889, 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024896165000000001, 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15856 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041236+0000", 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041246+0000", 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7259999999999997e-06 2024-09-11T05:22:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041253+0000", 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041258+0000", 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4199999999999998e-06 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.065782+0000", 2024-09-11T05:22:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024524293999999999 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.065826+0000", 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3934999999999999e-05 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066132+0000", 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00030564200000000001 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15857 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.038027464999999, 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025310777999999999, 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15857 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041266+0000", 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:22:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041268+0000", 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-06 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041274+0000", 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041278+0000", 2024-09-11T05:22:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6240000000000001e-06 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066166+0000", 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024887713999999998 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066250+0000", 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3984000000000001e-05 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066576+0000", 2024-09-11T05:22:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000325927 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15858 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.038008611999999, 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025727013, 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15858 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9799999999999999e-07 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041286+0000", 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9240000000000001e-06 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041292+0000", 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6289999999999998e-06 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041296+0000", 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5410000000000002e-06 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066624+0000", 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025327692999999998 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066719+0000", 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5425000000000002e-05 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.067011+0000", 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00029150299999999998 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59621 3.18 e40/22 3:1e993c26:::rbd_data.117971c15f82.0000000000000000:head v 40'416, mlcod=40'414)", 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.9171357039999997, 2024-09-11T05:22:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029790078000000001, 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162160+0000", 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9809999999999999e-06 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165939+0000", 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003779634 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165978+0000", 2024-09-11T05:22:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8043000000000002e-05 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165988+0000", 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0624e-05 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166085+0000", 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6847000000000003e-05 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166115+0000", 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9808e-05 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191879+0000", 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025764502000000002 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191947+0000", 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7638999999999994e-05 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.177 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:12.178 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:12.179 INFO:teuthology.orchestra.run.smithi012.stdout:1788 write 0x990192f thru 0x990610f (0x47e1 bytes) 2024-09-11T05:22:12.179 INFO:teuthology.orchestra.run.smithi012.stdout:1789 writesame 0x90c3e73 thru 0x90cbc3e data_size 0x4(0x7dcc bytes) 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:1790 read 0x32c93dc thru 0x32d829f (0xeec4 bytes) 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:1793 writesame 0xdab552 thru 0xdb55fc data_size 0x1(0xa0ab bytes) 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:1794 write 0x7be84a thru 0x7ca108 (0xb8bf bytes) 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:1796 read 0x2f9d684 thru 0x2fac6f5 (0xf072 bytes) 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:1799 punch from 0x87cf5be to 0x87d547e, (0x5ec0 bytes) 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:1802 trunc from 0x9906110 to 0x81a7b 2024-09-11T05:22:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:1803 punch from 0x744f1 to 0x77642, (0x3151 bytes) 2024-09-11T05:22:12.180 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:12.177+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:12.187 INFO:teuthology.orchestra.run.smithi012.stdout:1804 write 0x466d457 thru 0x4670be5 (0x378f bytes) 2024-09-11T05:22:12.190 INFO:teuthology.orchestra.run.smithi012.stdout:1806 punch from 0x45d0cdf to 0x45d8cff, (0x8020 bytes) 2024-09-11T05:22:12.190 INFO:teuthology.orchestra.run.smithi012.stdout:1807 punch from 0x419f674 to 0x41abe35, (0xc7c1 bytes) 2024-09-11T05:22:12.207 INFO:teuthology.orchestra.run.smithi012.stdout:1809 write 0xece9ad3 thru 0xecf2d5e (0x928c bytes) 2024-09-11T05:22:12.210 INFO:teuthology.orchestra.run.smithi012.stdout:1811 write 0xca403d7 thru 0xca43718 (0x3342 bytes) 2024-09-11T05:22:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:1812 read 0x81a4eff thru 0x81ac435 (0x7537 bytes) 2024-09-11T05:22:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:1813 read 0x4ac5c08 thru 0x4acffe2 (0xa3db bytes) 2024-09-11T05:22:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:1814 write 0x748e2b3 thru 0x74921a1 (0x3eef bytes) 2024-09-11T05:22:12.216 INFO:teuthology.orchestra.run.smithi012.stdout:1815 write 0xe1f1bb0 thru 0xe1f58dd (0x3d2e bytes) 2024-09-11T05:22:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:1816 read 0xcc9f9d9 thru 0xcca8fec (0x9614 bytes) 2024-09-11T05:22:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:1817 trunc from 0xecf2d5f to 0x2c945f3 2024-09-11T05:22:12.243 INFO:teuthology.orchestra.run.smithi012.stdout:1818 trunc from 0x2c945f3 to 0x3688285 2024-09-11T05:22:12.252 INFO:teuthology.orchestra.run.smithi012.stdout:1819 writesame 0x3a278b2 thru 0x3a3367f data_size 0xa(0xbdce bytes) 2024-09-11T05:22:12.252 INFO:teuthology.orchestra.run.smithi012.stdout:1820 write 0x31c4cb5 thru 0x31c66af (0x19fb bytes) 2024-09-11T05:22:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:1821 read 0x210df87 thru 0x2116b4f (0x8bc9 bytes) 2024-09-11T05:22:12.269 INFO:teuthology.orchestra.run.smithi012.stdout:1823 write 0xb6577f2 thru 0xb662820 (0xb02f bytes) 2024-09-11T05:22:12.273 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.273 INFO:teuthology.orchestra.run.smithi012.stdout:1825 write 0xb4f1e2f thru 0xb4f41ce (0x23a0 bytes) 2024-09-11T05:22:12.275 INFO:teuthology.orchestra.run.smithi012.stdout:1826 write 0x613bb14 thru 0x613fd21 (0x420e bytes) 2024-09-11T05:22:12.278 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:12.278+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:12.279 INFO:teuthology.orchestra.run.smithi012.stdout:1828 trunc from 0xb662821 to 0xc219af6 2024-09-11T05:22:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:1829 read 0x6376e1 thru 0x6411d7 (0x9af7 bytes) 2024-09-11T05:22:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:1830 write 0x7955b97 thru 0x795acea (0x5154 bytes) 2024-09-11T05:22:12.287 INFO:teuthology.orchestra.run.smithi012.stdout:1831 write 0x5b4601b thru 0x5b5543a (0xf420 bytes) 2024-09-11T05:22:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:1832 punch from 0x32c3364 to 0x32ce294, (0xaf30 bytes) 2024-09-11T05:22:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:1834 punch from 0xa8d5819 to 0xa8d90fc, (0x38e3 bytes) 2024-09-11T05:22:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:1839 trunc from 0xc219af6 to 0xd4677a3 2024-09-11T05:22:12.298 INFO:teuthology.orchestra.run.smithi012.stdout:1840 trunc from 0xd4677a3 to 0xc0ea206 2024-09-11T05:22:12.304 INFO:teuthology.orchestra.run.smithi012.stdout:1841 read 0x737b666 thru 0x737c830 (0x11cb bytes) 2024-09-11T05:22:12.304 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.304 INFO:teuthology.orchestra.run.smithi012.stdout:1843 writesame 0xb3095a1 thru 0xb30c03e data_size 0x5(0x2a9e bytes) 2024-09-11T05:22:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:1844 read 0x7cf47d6 thru 0x7cf7761 (0x2f8c bytes) 2024-09-11T05:22:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:1845 punch from 0x61f02b6 to 0x61fbdd0, (0xbb1a bytes) 2024-09-11T05:22:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:1846 write 0x5eae838 thru 0x5eb86d5 (0x9e9e bytes) 2024-09-11T05:22:12.310 INFO:teuthology.orchestra.run.smithi012.stdout:1848 writesame 0x31951df thru 0x319f2c4 data_size 0xf(0xa0e6 bytes) 2024-09-11T05:22:12.311 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:12.311 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:12.314 INFO:teuthology.orchestra.run.smithi012.stdout:1849 read 0x64aed77 thru 0x64b4210 (0x549a bytes) 2024-09-11T05:22:12.321 INFO:teuthology.orchestra.run.smithi012.stdout:1850 trunc from 0xc0ea206 to 0x59aee68 2024-09-11T05:22:12.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:12.331 INFO:teuthology.orchestra.run.smithi012.stdout:1851 clone 14 order 20 su 32768 sc 7 2024-09-11T05:22:12.380 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:12.380+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:12.437 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:12.438 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:12.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:12.490 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:12.490+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:12.543 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-11T05:22:12.564 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13276 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 851968~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755723+0000", 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804315945999999, 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011567298, 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13276 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755723+0000", 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755723+0000", 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755723+0000", 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9700000000000002e-07 2024-09-11T05:22:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755725+0000", 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.934e-06 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755731+0000", 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1260000000000003e-06 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755736+0000", 2024-09-11T05:22:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.425e-06 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767178+0000", 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011441731 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767229+0000", 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1511999999999997e-05 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767290+0000", 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1173000000000005e-05 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13285 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1032192~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804286349000002, 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011665867, 2024-09-11T05:22:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13285 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755756+0000", 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.225e-06 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755763+0000", 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4509999999999997e-06 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755768+0000", 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9389999999999996e-06 2024-09-11T05:22:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767311+0000", 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011543589999999999 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767359+0000", 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7320000000000001e-05 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767418+0000", 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9902999999999999e-05 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13288 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1490944~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804263666000001, 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011792074, 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13288 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755776+0000", 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2199999999999999e-07 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755778+0000", 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755785+0000", 2024-09-11T05:22:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7000000000000008e-06 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755790+0000", 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0769999999999998e-06 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767439+0000", 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011648067 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767496+0000", 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7098000000000001e-05 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767567+0000", 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13298 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1949696~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804241738999998, 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011903945000000001, 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13298 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755798+0000", 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2e-07 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755800+0000", 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.934e-06 2024-09-11T05:22:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755806+0000", 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2899999999999999e-06 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755811+0000", 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8210000000000001e-06 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767588+0000", 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011776963999999999 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767636+0000", 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8304999999999999e-05 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767701+0000", 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5210999999999996e-05 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13305 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 2048000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804222254999999, 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996071000000001, 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13305 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755819+0000", 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.888e-06 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755825+0000", 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9190000000000004e-06 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755830+0000", 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5740000000000003e-06 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767722+0000", 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011891273000000001 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767769+0000", 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7144000000000001e-05 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767813+0000", 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3863000000000003e-05 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13308 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1769472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804200589000001, 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012084722000000001, 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13308 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755839+0000", 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755841+0000", 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755847+0000", 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1859999999999997e-06 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755852+0000", 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767833+0000", 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011981331 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767880+0000", 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6350000000000002e-05 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767923+0000", 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3568e-05 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13314 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1769472~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804181036999999, 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012198718000000001, 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13314 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755860+0000", 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7719999999999999e-06 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755867+0000", 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9260000000000003e-06 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755872+0000", 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767948+0000", 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012076643 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767995+0000", 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6461999999999997e-05 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768057+0000", 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1846000000000004e-05 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13322 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804152905999999, 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012296951, 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13322 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755889+0000", 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755896+0000", 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8560000000000001e-06 2024-09-11T05:22:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755901+0000", 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1019999999999996e-06 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768078+0000", 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012177248999999999 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768126+0000", 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929000000000001e-05 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768183+0000", 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7005000000000001e-05 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13325 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.804130978, 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01241014, 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13325 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755924+0000", 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5636000000000001e-05 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755931+0000", 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9500000000000004e-06 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755936+0000", 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1120000000000004e-06 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768203+0000", 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012267072 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768254+0000", 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0766000000000001e-05 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768318+0000", 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4233000000000007e-05 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13333 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 573440~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.803383957000001, 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011798149000000001, 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13333 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756656+0000", 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4099999999999998e-07 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756659+0000", 2024-09-11T05:22:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6219999999999998e-06 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756668+0000", 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5210000000000002e-06 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756674+0000", 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8130000000000001e-06 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768339+0000", 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011665310999999999 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768391+0000", 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2179000000000003e-05 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768453+0000", 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2062000000000003e-05 2024-09-11T05:22:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13341 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802641028, 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011660811, 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13341 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8299999999999997e-07 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757402+0000", 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3100000000000001e-06 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757411+0000", 2024-09-11T05:22:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6460000000000005e-06 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757417+0000", 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6579999999999999e-06 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768876+0000", 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011459186999999999 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768958+0000", 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1736999999999993e-05 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769059+0000", 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010079 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13343 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802614096999999, 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011833961, 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13343 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757428+0000", 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757437+0000", 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757443+0000", 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769090+0000", 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011647014000000001 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769166+0000", 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5998e-05 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769259+0000", 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2699000000000001e-05 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13344 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1818624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802588783000001, 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996009, 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13344 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757451+0000", 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6699999999999999e-07 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757453+0000", 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:22:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757462+0000", 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1649999999999995e-06 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757467+0000", 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4890000000000003e-06 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769291+0000", 2024-09-11T05:22:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011823422 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769370+0000", 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8658999999999993e-05 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769446+0000", 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6604e-05 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13348 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802551502, 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.016500531999999998, 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13348 2024-09-11T05:22:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757488+0000", 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.82e-07 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757491+0000", 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8080000000000001e-06 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757502+0000", 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1245e-05 2024-09-11T05:22:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757510+0000", 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0669999999999992e-06 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769949+0000", 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012439131000000001 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770026+0000", 2024-09-11T05:22:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6464000000000005e-05 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.773988+0000", 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039622349999999997 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13351 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802520010999999, 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012814249, 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13351 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.75e-07 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757522+0000", 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1739999999999999e-06 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757531+0000", 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8519999999999999e-06 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757539+0000", 2024-09-11T05:22:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.763e-06 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770160+0000", 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012621267 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770234+0000", 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3619000000000001e-05 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770333+0000", 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9098999999999994e-05 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13353 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802490127999999, 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012966811999999999, 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13353 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757552+0000", 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3209999999999999e-06 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757559+0000", 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2779999999999996e-06 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757564+0000", 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770358+0000", 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012793617 2024-09-11T05:22:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770426+0000", 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8201000000000007e-05 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770516+0000", 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9889000000000006e-05 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13409 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 49152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802455409, 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013098782999999999, 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13409 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757588+0000", 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1609999999999996e-06 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757598+0000", 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5189999999999998e-06 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757604+0000", 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770540+0000", 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012935854 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770605+0000", 2024-09-11T05:22:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5505000000000004e-05 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770682+0000", 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7296e-05 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13413 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802426003000001, 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013233299, 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13413 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757616+0000", 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1270000000000001e-06 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757624+0000", 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4470000000000006e-06 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757629+0000", 2024-09-11T05:22:12.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2220000000000001e-06 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770705+0000", 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013075646 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770770+0000", 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4678000000000007e-05 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770846+0000", 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6723000000000004e-05 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13419 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.802402498999999, 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013374044, 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13419 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:12.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757637+0000", 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757639+0000", 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9e-06 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757649+0000", 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7909999999999999e-06 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757654+0000", 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.378e-06 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770870+0000", 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013215873 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770935+0000", 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4887000000000004e-05 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.771010+0000", 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5778999999999994e-05 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:59624 3.19 3:9b48071f:::rbd_data.117971c15f82.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.3973547929999999, 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.032257185000000001, 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 59624 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162689+0000", 2024-09-11T05:22:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165796+0000", 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031078490000000002 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165845+0000", 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8242000000000003e-05 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165867+0000", 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2005e-05 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165990+0000", 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012330199999999999 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166150+0000", 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016035999999999999 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166799+0000", 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064827299999999999 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191931+0000", 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025131982000000001 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194856+0000", 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002925825 2024-09-11T05:22:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194897+0000", 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0252e-05 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194941+0000", 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4746000000000002e-05 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:12.658 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:12.658 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:12.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone13 from 0x59aee68 (overlap 0x81a7b) to 0x19ee5 2024-09-11T05:22:12.660 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:12.658+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:12.679 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-11T05:22:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:1852 read 0x4cfe46e thru 0x4d02522 (0x40b5 bytes) 2024-09-11T05:22:12.686 INFO:teuthology.orchestra.run.smithi012.stdout:1853 read 0x4f12c6c thru 0x4f18a1a (0x5daf bytes) 2024-09-11T05:22:12.697 INFO:teuthology.orchestra.run.smithi012.stdout:1856 write 0x82dfe7a thru 0x82e263b (0x27c2 bytes) 2024-09-11T05:22:12.701 INFO:teuthology.orchestra.run.smithi012.stdout:1857 read 0x289ecaf thru 0x28ae3af (0xf701 bytes) 2024-09-11T05:22:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:1858 writesame 0xb313701 thru 0xb3213e9 data_size 0x7(0xdce9 bytes) 2024-09-11T05:22:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.713 INFO:teuthology.orchestra.run.smithi012.stdout:1861 trunc from 0xb3213ea to 0x8783b80 2024-09-11T05:22:12.718 INFO:teuthology.orchestra.run.smithi012.stdout:1862 read 0x81c5029 thru 0x81cb024 (0x5ffc bytes) 2024-09-11T05:22:12.718 INFO:teuthology.orchestra.run.smithi012.stdout:1863 read 0x453f7a thru 0x45c5f8 (0x867f bytes) 2024-09-11T05:22:12.719 INFO:teuthology.orchestra.run.smithi012.stdout:1864 write 0x2e16368 thru 0x2e22df4 (0xca8d bytes) 2024-09-11T05:22:12.726 INFO:teuthology.orchestra.run.smithi012.stdout:1865 writesame 0x32ce207 thru 0x32da75e data_size 0x3c(0xc558 bytes) 2024-09-11T05:22:12.731 INFO:teuthology.orchestra.run.smithi012.stdout:1866 read 0x12b2118 thru 0x12bcb1a (0xaa03 bytes) 2024-09-11T05:22:12.731 INFO:teuthology.orchestra.run.smithi012.stdout:1869 write 0x6f5aa2c thru 0x6f6a933 (0xff08 bytes) 2024-09-11T05:22:12.738 INFO:teuthology.orchestra.run.smithi012.stdout:1871 writesame 0x723d5e6 thru 0x7244106 data_size 0x5(0x6b21 bytes) 2024-09-11T05:22:12.744 INFO:teuthology.orchestra.run.smithi012.stdout:1872 read 0x81a5a51 thru 0x81b0fee (0xb59e bytes) 2024-09-11T05:22:12.754 INFO:teuthology.orchestra.run.smithi012.stdout:1873 writesame 0xcf475f2 thru 0xcf4df01 data_size 0x29(0x6910 bytes) 2024-09-11T05:22:12.755 INFO:teuthology.orchestra.run.smithi012.stdout:1874 write 0x67cf57f thru 0x67d9b62 (0xa5e4 bytes) 2024-09-11T05:22:12.759 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:12.759+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:12.764 INFO:teuthology.orchestra.run.smithi012.stdout:1875 write 0xd7ced9 thru 0xd8332a (0x6452 bytes) 2024-09-11T05:22:12.770 INFO:teuthology.orchestra.run.smithi012.stdout:1876 write 0xa4f244f thru 0xa4f8ba3 (0x6755 bytes) 2024-09-11T05:22:12.782 INFO:teuthology.orchestra.run.smithi012.stdout:1877 trunc from 0xcf4df02 to 0x90a2fef 2024-09-11T05:22:12.792 INFO:teuthology.orchestra.run.smithi012.stdout:1878 read 0x2e8dcd8 thru 0x2e8f795 (0x1abe bytes) 2024-09-11T05:22:12.793 INFO:teuthology.orchestra.run.smithi012.stdout:1879 read 0x61bb1a5 thru 0x61c1bd7 (0x6a33 bytes) 2024-09-11T05:22:12.793 INFO:teuthology.orchestra.run.smithi012.stdout:1880 write 0x58ec21e thru 0x58fa9e9 (0xe7cc bytes) 2024-09-11T05:22:12.801 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:12.801 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:12.801 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:12.801 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:12.803 INFO:teuthology.orchestra.run.smithi012.stdout:1882 punch from 0x20ad0b8 to 0x20b1de8, (0x4d30 bytes) 2024-09-11T05:22:12.803 INFO:teuthology.orchestra.run.smithi012.stdout:1883 write 0x578252c thru 0x578c229 (0x9cfe bytes) 2024-09-11T05:22:12.809 INFO:teuthology.orchestra.run.smithi012.stdout:1884 read 0x1a5dece thru 0x1a6a19a (0xc2cd bytes) 2024-09-11T05:22:12.809 INFO:teuthology.orchestra.run.smithi012.stdout:1885 write 0x46337cc thru 0x463a660 (0x6e95 bytes) 2024-09-11T05:22:12.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:12.813 INFO:teuthology.orchestra.run.smithi012.stdout:1886 writesame 0x6c5c7a7 thru 0x6c66a13 data_size 0x1(0xa26d bytes) 2024-09-11T05:22:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:1887 write 0x136f24a thru 0x1373f47 (0x4cfe bytes) 2024-09-11T05:22:12.832 INFO:teuthology.orchestra.run.smithi012.stdout:1888 punch from 0x630ce9b to 0x6311555, (0x46ba bytes) 2024-09-11T05:22:12.834 INFO:teuthology.orchestra.run.smithi012.stdout:1890 trunc from 0x90a2fef to 0xaaa65ab 2024-09-11T05:22:12.849 INFO:teuthology.orchestra.run.smithi012.stdout:1892 write 0xee5aee9 thru 0xee60402 (0x551a bytes) 2024-09-11T05:22:12.856 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:12.860+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:1894 trunc from 0xee60403 to 0x57b784b 2024-09-11T05:22:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:1896 read 0x39222f1 thru 0x392cb0b (0xa81b bytes) 2024-09-11T05:22:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:1897 write 0x2cdffae thru 0x2ce980d (0x9860 bytes) 2024-09-11T05:22:12.889 INFO:teuthology.orchestra.run.smithi012.stdout:1899 write 0xc1398c thru 0xc14699 (0xd0e bytes) 2024-09-11T05:22:12.891 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:1901 writesame 0xcd2147e thru 0xcd227f4 data_size 0xb(0x1377 bytes) 2024-09-11T05:22:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:1903 read 0xab47c42 thru 0xab4d084 (0x5443 bytes) 2024-09-11T05:22:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:1905 read 0x97c4b8a thru 0x97d018f (0xb606 bytes) 2024-09-11T05:22:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:1906 write 0x30e9e8 thru 0x31381e (0x4e37 bytes) 2024-09-11T05:22:12.910 INFO:teuthology.orchestra.run.smithi012.stdout:1907 writesame 0x5ade56c thru 0x5aea5bd data_size 0x67(0xc052 bytes) 2024-09-11T05:22:12.912 INFO:teuthology.orchestra.run.smithi012.stdout:1909 read 0x7f2b52 thru 0x7fc9b7 (0x9e66 bytes) 2024-09-11T05:22:12.912 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.912 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.913 INFO:teuthology.orchestra.run.smithi012.stdout:1914 write 0x2522bc6 thru 0x2532132 (0xf56d bytes) 2024-09-11T05:22:12.916 INFO:teuthology.orchestra.run.smithi012.stdout:1916 read 0x18deb36 thru 0x18eeb0d (0xffd8 bytes) 2024-09-11T05:22:12.917 INFO:teuthology.orchestra.run.smithi012.stdout:1917 write 0x2dd3ca2 thru 0x2de1298 (0xd5f7 bytes) 2024-09-11T05:22:12.921 INFO:teuthology.orchestra.run.smithi012.stdout:1918 punch from 0x39cbb11 to 0x39d1901, (0x5df0 bytes) 2024-09-11T05:22:12.921 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.921 INFO:teuthology.orchestra.run.smithi012.stdout:1921 punch from 0x9b97674 to 0x9ba1fe3, (0xa96f bytes) 2024-09-11T05:22:12.935 INFO:teuthology.orchestra.run.smithi012.stdout:1922 trunc from 0xcd227f5 to 0x6f4b05 2024-09-11T05:22:12.935 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:12.935 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:12.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:12.953 INFO:teuthology.orchestra.run.smithi012.stdout:1923 read 0x8d3af thru 0x8f212 (0x1e64 bytes) 2024-09-11T05:22:12.954 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:12.954 INFO:teuthology.orchestra.run.smithi012.stdout:1925 read 0x187f90 thru 0x18a024 (0x2095 bytes) 2024-09-11T05:22:12.954 INFO:teuthology.orchestra.run.smithi012.stdout:1926 read 0x262ee5 thru 0x26f447 (0xc563 bytes) 2024-09-11T05:22:12.961 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:12.960+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:1927 trunc from 0x6f4b05 to 0xc3b812a 2024-09-11T05:22:12.972 INFO:teuthology.orchestra.run.smithi012.stdout:1928 write 0x28d661c thru 0x28dfaa9 (0x948e bytes) 2024-09-11T05:22:12.987 INFO:teuthology.orchestra.run.smithi012.stdout:1929 writesame 0xe323fc7 thru 0xe332ed1 data_size 0x1(0xef0b bytes) 2024-09-11T05:22:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:1931 trunc from 0xe332ed2 to 0xa47f4b6 2024-09-11T05:22:13.004 INFO:teuthology.orchestra.run.smithi012.stdout:1932 write 0xbb88b57 thru 0xbb96d14 (0xe1be bytes) 2024-09-11T05:22:13.011 INFO:teuthology.orchestra.run.smithi012.stdout:1933 punch from 0x52d5796 to 0x52dc0c3, (0x692d bytes) 2024-09-11T05:22:13.017 INFO:teuthology.orchestra.run.smithi012.stdout:1934 trunc from 0xbb96d15 to 0x6a74eb1 2024-09-11T05:22:13.036 INFO:teuthology.orchestra.run.smithi012.stdout:1937 trunc from 0x6a74eb1 to 0xea472ed 2024-09-11T05:22:13.044 INFO:teuthology.orchestra.run.smithi012.stdout:1938 trunc from 0xea472ed to 0xcde0a2b 2024-09-11T05:22:13.049 INFO:teuthology.orchestra.run.smithi012.stdout:1940 writesame 0xc1986cb thru 0xc1a660e data_size 0x42(0xdf44 bytes) 2024-09-11T05:22:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:1941 write 0x563a10e thru 0x5644a36 (0xa929 bytes) 2024-09-11T05:22:13.061 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:13.061+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:13.064 INFO:teuthology.orchestra.run.smithi012.stdout:1942 write 0x44ccb79 thru 0x44d4919 (0x7da1 bytes) 2024-09-11T05:22:13.071 INFO:teuthology.orchestra.run.smithi012.stdout:1943 read 0x8dbd832 thru 0x8dc8306 (0xaad5 bytes) 2024-09-11T05:22:13.071 INFO:teuthology.orchestra.run.smithi012.stdout:1944 write 0x100d695 thru 0x101abfd (0xd569 bytes) 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58270 3.4 e40/22 3:262c4575:::rbd_data.11794a93f042.0000000000000025:head v 40'97, mlcod=39'93)", 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.4598147390000005, 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.005817745, 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616992+0000", 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-07 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617010+0000", 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8865e-05 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617020+0000", 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3400000000000004e-06 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617026+0000", 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0059999999999998e-06 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619296+0000", 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002270022 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619333+0000", 2024-09-11T05:22:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7619e-05 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622766+0000", 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034327899999999998 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622809+0000", 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2425999999999997e-05 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58386 3.9 e40/22 3:904d4ffe:::rbd_data.11794a93f042.0000000000000053:head v 40'82, mlcod=40'80)", 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.4305278549999993, 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004810847, 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-07 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646283+0000", 2024-09-11T05:22:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646293+0000", 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6169999999999996e-06 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646297+0000", 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.639e-06 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646339+0000", 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1848999999999999e-05 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646356+0000", 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.698e-05 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651047+0000", 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046910700000000003 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651089+0000", 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1298000000000003e-05 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58412 3.1e e40/37 3:7bbe3ffa:::rbd_data.11794a93f042.0000000000000063:head v 40'93, mlcod=40'91)", 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.4187140199999995, 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047628849999999997, 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4700000000000001e-07 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658101+0000", 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5229999999999995e-06 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658115+0000", 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3776e-05 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658124+0000", 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3030000000000005e-06 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658183+0000", 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9382000000000002e-05 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658207+0000", 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3507999999999999e-05 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662817+0000", 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046103150000000002 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662854+0000", 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7431000000000001e-05 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.4 epoch 40/22 rep_tid 266 entries 40'102 (0'0) error 3:207494c7:::rbd_data.11794a93f042.0000000000000070:head by client.4473.0:58427 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'100)", 2024-09-11T05:22:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.663810+0000", 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.4129952299999999, 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046219039999999996, 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663810+0000", 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663810+0000", 2024-09-11T05:22:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663811+0000", 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2799999999999996e-07 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663820+0000", 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5320000000000006e-06 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663839+0000", 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9947000000000001e-05 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663853+0000", 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3804e-05 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663926+0000", 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2855000000000006e-05 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.668432+0000", 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045061379999999998 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58436 3.0 e40/22 3:01dc6865:::rbd_data.11794a93f042.000000000000006e:head v 40'96, mlcod=40'93)", 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.4107914469999994, 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051595490000000003, 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666015+0000", 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666019+0000", 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3170000000000003e-06 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666028+0000", 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4080000000000004e-06 2024-09-11T05:22:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666035+0000", 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666084+0000", 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9490999999999998e-05 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666108+0000", 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3728000000000001e-05 2024-09-11T05:22:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671117+0000", 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050084129999999998 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671174+0000", 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7130999999999999e-05 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58444 3.4 e40/22 3:207494c7:::rbd_data.11794a93f042.0000000000000070:head v 40'103, mlcod=40'101)", 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.4076235320000006, 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048760670000000004, 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669183+0000", 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5400000000000001e-07 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669189+0000", 2024-09-11T05:22:13.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1449999999999996e-06 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669202+0000", 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2819999999999999e-05 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669209+0000", 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3540000000000002e-06 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669257+0000", 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7490000000000001e-05 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669270+0000", 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3018e-05 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674028+0000", 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047580419999999997 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674058+0000", 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0543999999999998e-05 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58574 3.9 e40/22 3:96a6d2a0:::rbd_data.11794a93f042.00000000000000b3:head v 40'84, mlcod=40'82)", 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.3642001019999999, 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048300169999999998, 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.104 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:13.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712612+0000", 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712622+0000", 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9340000000000001e-06 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712628+0000", 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3069999999999999e-06 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712676+0000", 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7731000000000001e-05 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712688+0000", 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1659e-05 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717368+0000", 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046800399999999999 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717436+0000", 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7885999999999993e-05 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58579 3.4 e40/22 3:27d97e3d:::rbd_data.11794a93f042.00000000000000b6:head v 40'111, mlcod=40'109)", 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.715584+0000", 2024-09-11T05:22:13.108 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.3612217520000005, 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004716067, 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715584+0000", 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715584+0000", 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715585+0000", 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5799999999999999e-07 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715592+0000", 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4819999999999997e-06 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715605+0000", 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3148e-05 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715614+0000", 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8759999999999994e-06 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715664+0000", 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9675000000000001e-05 2024-09-11T05:22:13.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715684+0000", 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0715000000000001e-05 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.720249+0000", 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045647700000000001 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.720300+0000", 2024-09-11T05:22:13.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0742999999999999e-05 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.0 epoch 40/22 rep_tid 289 entries 40'101 (0'0) error 3:07044964:::rbd_data.11794a93f042.00000000000000c0:head by client.4473.0:58588 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'99)", 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.718128+0000", 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.3586772719999995, 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004590088, 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718128+0000", 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718128+0000", 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718129+0000", 2024-09-11T05:22:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2300000000000001e-07 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718141+0000", 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1712999999999999e-05 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718165+0000", 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4206000000000002e-05 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718182+0000", 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7501000000000001e-05 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718264+0000", 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1818999999999997e-05 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.722718+0000", 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0044542260000000004 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 397 entries 40'85 (0'0) error 3:9228f1d6:::rbd_data.11794a93f042.00000000000000d9:head by client.4473.0:58643 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'83)", 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.3371353199999998, 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004918164, 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739671+0000", 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3300000000000002e-07 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739678+0000", 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:22:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739694+0000", 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6099999999999998e-05 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739703+0000", 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3489999999999998e-06 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739776+0000", 2024-09-11T05:22:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2795999999999999e-05 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744588+0000", 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004812424 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 988 entries 40'98 (0'0) error 3:7aa91a15:::rbd_data.11794a93f042.00000000000000da:head by client.4473.0:58645 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'96)", 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.3370115170000005, 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047959609999999996, 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739795+0000", 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3600000000000003e-07 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739803+0000", 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5499999999999995e-06 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739823+0000", 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0182000000000001e-05 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739838+0000", 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4618e-05 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739894+0000", 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6373999999999999e-05 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744590+0000", 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046956009999999998 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58825 3.4 e40/22 3:20d0ea81:::rbd_data.11794a93f042.0000000000000129:head v 40'117, mlcod=40'115)", 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.288457846, 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048385770000000002, 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788353+0000", 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0309999999999998e-06 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788362+0000", 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2600000000000005e-06 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788368+0000", 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.964e-06 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788419+0000", 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1829000000000001e-05 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788437+0000", 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7671000000000001e-05 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793143+0000", 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047061539999999997 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793186+0000", 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3137999999999999e-05 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 439 entries 40'95 (0'0) error 3:906e0365:::rbd_data.11794a93f042.0000000000000142:head by client.4473.0:58870 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'93)", 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.804743+0000", 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2720626660000001, 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046608550000000002, 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804743+0000", 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804743+0000", 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804744+0000", 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9599999999999998e-07 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804752+0000", 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3790000000000006e-06 2024-09-11T05:22:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804773+0000", 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1168000000000001e-05 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804792+0000", 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8561000000000001e-05 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804877+0000", 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4920999999999996e-05 2024-09-11T05:22:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809404+0000", 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045270299999999996 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.0 epoch 40/22 rep_tid 309 entries 40'109 (0'0) error 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head by client.4473.0:58874 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2699621109999999, 2024-09-11T05:22:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051466819999999996, 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806844+0000", 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9400000000000005e-07 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806852+0000", 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806873+0000", 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0216000000000001e-05 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806890+0000", 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7002000000000001e-05 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806949+0000", 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9206999999999997e-05 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.811990+0000", 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050413639999999996 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1034 entries 40'110 (0'0) error 3:7a5c3482:::rbd_data.11794a93f042.0000000000000147:head by client.4473.0:58878 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2670954069999993, 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050452520000000001, 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809711+0000", 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5099999999999999e-07 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809719+0000", 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1699999999999997e-06 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809741+0000", 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2204999999999998e-05 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809760+0000", 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8855000000000002e-05 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809835+0000", 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4746999999999994e-05 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.814755+0000", 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049206240000000002 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58889 3.0 e40/22 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head v 40'110, mlcod=40'108)", 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2642303019999996, 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050379939999999996, 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812576+0000", 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5300000000000003e-07 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812581+0000", 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9150000000000004e-06 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812591+0000", 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.73e-06 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812597+0000", 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812641+0000", 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4471999999999997e-05 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812659+0000", 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8397e-05 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817574+0000", 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049149750000000002 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817613+0000", 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8899000000000001e-05 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1037 entries 40'111 (0'0) error 3:7a47fa34:::rbd_data.11794a93f042.000000000000014e:head by client.4473.0:58896 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'109)", 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2613858780000005, 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048999350000000002, 2024-09-11T05:22:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815421+0000", 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5899999999999995e-07 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815428+0000", 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.695e-06 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815447+0000", 2024-09-11T05:22:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9063999999999999e-05 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815468+0000", 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1129e-05 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815560+0000", 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1926e-05 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820320+0000", 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047592620000000002 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 442 entries 40'97 (0'0) error 3:97796a0c:::rbd_data.11794a93f042.0000000000000150:head by client.4473.0:58898 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'95)", 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815713+0000", 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2610922139999996, 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004601824, 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815713+0000", 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815713+0000", 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815714+0000", 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815730+0000", 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6039e-05 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815750+0000", 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9837999999999999e-05 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815764+0000", 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4433000000000001e-05 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815907+0000", 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014263599999999999 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820315+0000", 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0044082360000000003 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58903 3.1e e40/37 3:7a5c3482:::rbd_data.11794a93f042.0000000000000147:head v 40'112, mlcod=40'109)", 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815788+0000", 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2610178340000004, 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045724099999999998, 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815788+0000", 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815788+0000", 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815789+0000", 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9899999999999999e-07 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815796+0000", 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0210000000000002e-06 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815807+0000", 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1837e-05 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815814+0000", 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9020000000000002e-06 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815869+0000", 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4778000000000003e-05 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815888+0000", 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8924e-05 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820323+0000", 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0044347129999999998 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820360+0000", 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7435999999999999e-05 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59625 3.1e e40/37 3:788c33b7:::rbd_data.117971c15f82.0000000000000007:head v 40'119, mlcod=40'117)", 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.9080368649999997, 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.023475949999999999, 2024-09-11T05:22:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168771+0000", 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4399999999999999e-06 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171485+0000", 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0027135879999999999 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171507+0000", 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2240000000000001e-05 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171519+0000", 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1625e-05 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171595+0000", 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6513000000000004e-05 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171620+0000", 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4960000000000002e-05 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192195+0000", 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.020575192999999999 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192245+0000", 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9391000000000002e-05 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.160 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:13.161 INFO:teuthology.orchestra.run.smithi012.stdout:1945 write 0x76a5f62 thru 0x76b241a (0xc4b9 bytes) 2024-09-11T05:22:13.162 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:13.163 INFO:teuthology.orchestra.run.smithi012.stdout:1947 write 0xa4a3044 thru 0xa4a6c9a (0x3c57 bytes) 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1948 write 0x4531206 thru 0x453d675 (0xc470 bytes) 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1951 punch from 0xaee1dc1 to 0xaeecc1b, (0xae5a bytes) 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1952 write 0x9423786 thru 0x942ef3a (0xb7b5 bytes) 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1954 trunc from 0xcde0a2b to 0x7e0823 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1955 trunc from 0x7e0823 to 0x24d2cea 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1959 read 0x1cf4e7e thru 0x1d015ef (0xc772 bytes) 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1964 writesame 0x55ec150 thru 0x55f4a69 data_size 0x17(0x891a bytes) 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1965 trunc from 0x55f4a6a to 0x14f73cc 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1968 read 0x4c3ecd thru 0x4ce61f (0xa753 bytes) 2024-09-11T05:22:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:1969 read 0x9325f thru 0x9a580 (0x7322 bytes) 2024-09-11T05:22:13.165 INFO:teuthology.orchestra.run.smithi012.stdout:1970 punch from 0x6d3f9f to 0x6d44b4, (0x515 bytes) 2024-09-11T05:22:13.165 INFO:teuthology.orchestra.run.smithi012.stdout:1972 read 0x126e064 thru 0x12744a4 (0x6441 bytes) 2024-09-11T05:22:13.165 INFO:teuthology.orchestra.run.smithi012.stdout:1973 punch from 0x4edb0c to 0x4ee4d6, (0x9ca bytes) 2024-09-11T05:22:13.167 INFO:teuthology.orchestra.run.smithi012.stdout:1974 write 0x9c07d31 thru 0x9c0a6fb (0x29cb bytes) 2024-09-11T05:22:13.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:13.167+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:13.171 INFO:teuthology.orchestra.run.smithi012.stdout:1976 read 0x20e5736 thru 0x20e7982 (0x224d bytes) 2024-09-11T05:22:13.171 INFO:teuthology.orchestra.run.smithi012.stdout:1977 punch from 0x7ba0baf to 0x7ba3c9e, (0x30ef bytes) 2024-09-11T05:22:13.171 INFO:teuthology.orchestra.run.smithi012.stdout:1980 punch from 0x45db741 to 0x45e0c90, (0x554f bytes) 2024-09-11T05:22:13.171 INFO:teuthology.orchestra.run.smithi012.stdout:1981 write 0x7739417 thru 0x773ec62 (0x584c bytes) 2024-09-11T05:22:13.176 INFO:teuthology.orchestra.run.smithi012.stdout:1982 write 0x15015bc thru 0x150b1ad (0x9bf2 bytes) 2024-09-11T05:22:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:1983 read 0xc6b9fd thru 0xc6ed86 (0x338a bytes) 2024-09-11T05:22:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:1985 read 0x62a34da thru 0x62a3ba8 (0x6cf bytes) 2024-09-11T05:22:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:1986 read 0x65191e0 thru 0x6521226 (0x8047 bytes) 2024-09-11T05:22:13.183 INFO:teuthology.orchestra.run.smithi012.stdout:1987 trunc from 0x9c0a6fc to 0xdff461f 2024-09-11T05:22:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:1989 punch from 0x2ea4434 to 0x2eb04a6, (0xc072 bytes) 2024-09-11T05:22:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:1990 write 0x9e2a140 thru 0x9e2ab68 (0xa29 bytes) 2024-09-11T05:22:13.205 INFO:teuthology.orchestra.run.smithi012.stdout:1991 trunc from 0xdff461f to 0xb5e398 2024-09-11T05:22:13.223 INFO:teuthology.orchestra.run.smithi012.stdout:1992 trunc from 0xb5e398 to 0x8f302a6 2024-09-11T05:22:13.229 INFO:teuthology.orchestra.run.smithi012.stdout:1993 read 0x2cece94 thru 0x2cfbe5a (0xefc7 bytes) 2024-09-11T05:22:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:1994 write 0x97de253 thru 0x97e36ca (0x5478 bytes) 2024-09-11T05:22:13.238 INFO:teuthology.orchestra.run.smithi012.stdout:1995 read 0x13b044d thru 0x13b26c6 (0x227a bytes) 2024-09-11T05:22:13.238 INFO:teuthology.orchestra.run.smithi012.stdout:1996 read 0x949ef79 thru 0x94a26ab (0x3733 bytes) 2024-09-11T05:22:13.244 INFO:teuthology.orchestra.run.smithi012.stdout:1997 write 0x9c1352c thru 0x9c1c238 (0x8d0d bytes) 2024-09-11T05:22:13.251 INFO:teuthology.orchestra.run.smithi012.stdout:1998 read 0x7f51b71 thru 0x7f56455 (0x48e5 bytes) 2024-09-11T05:22:13.251 INFO:teuthology.orchestra.run.smithi012.stdout:1999 writesame 0x346e405 thru 0x3474348 data_size 0x5b(0x5f44 bytes) 2024-09-11T05:22:13.257 INFO:teuthology.orchestra.run.smithi012.stdout:2000 clone 15 order 23 su 2097152 sc 11 2024-09-11T05:22:13.266 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:13.266+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:13.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:13.367 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:13.367+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:13.439 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:13.440 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:13.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:13.469 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:13.468+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:13.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:22:13.560 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.814401459000001, 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:13.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:13.566 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.814389571, 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:13.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.814352351, 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.571 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.814337569999999, 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.814326233999999, 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.813175433, 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.813160977999999, 2024-09-11T05:22:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.813150498000001, 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.813140031, 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.813121670999999, 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.810412598999999, 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.810389599000001, 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.810368236, 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.810346717, 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.81032579, 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.808492365999999, 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.808482053000001, 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.80847168, 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.808456651, 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.808446643, 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:13.657 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:13.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:13.659 INFO:teuthology.orchestra.run.smithi012.stdout:flattening image image_client.0-clone14 2024-09-11T05:22:13.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:13.658+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:13.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:13.759+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:13.776 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-11T05:22:13.777 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:13.777 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:13.777 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:13.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:13.785 INFO:teuthology.orchestra.run.smithi012.stdout:2001 write 0xa285b2b thru 0xa28af0c (0x53e2 bytes) 2024-09-11T05:22:13.789 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:13.789 INFO:teuthology.orchestra.run.smithi012.stdout:2003 writesame 0x92fe5c6 thru 0x92fee43 data_size 0x1(0x87e bytes) 2024-09-11T05:22:13.797 INFO:teuthology.orchestra.run.smithi012.stdout:2004 trunc from 0xa28af0d to 0xdd5dc15 2024-09-11T05:22:13.803 INFO:teuthology.orchestra.run.smithi012.stdout:2005 clone 16 order 22 su 32768 sc 12 2024-09-11T05:22:13.860 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:13.859+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:13.880 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:13.880 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:13.881 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:13.881 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:13.881 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:13.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:13.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:13.973 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:13.973+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:14.033 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:14.033 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:14.034 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36838 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.400745533, 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059077179, 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36838 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632957+0000", 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632959+0000", 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1390000000000002e-06 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632966+0000", 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8990000000000004e-06 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632977+0000", 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1574e-05 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689825+0000", 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.056847555000000001 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689904+0000", 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9449000000000005e-05 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692033+0000", 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021291130000000002 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.400714804, 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36845 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1921024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.398593512, 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059196066999999998, 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36845 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635109+0000", 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635111+0000", 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4380000000000002e-06 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635117+0000", 2024-09-11T05:22:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.161e-06 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635122+0000", 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.831e-06 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694031+0000", 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058908380000000003 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694099+0000", 2024-09-11T05:22:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8046000000000005e-05 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694304+0000", 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000205749 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.398573282999999, 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.398551719, 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.398537707999999, 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36851 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1994752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396723017999999, 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059218845999999999, 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36851 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636980+0000", 2024-09-11T05:22:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9600000000000008e-07 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636984+0000", 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000004e-06 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636986+0000", 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6029999999999999e-06 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695889+0000", 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058902788999999997 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695961+0000", 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1365999999999994e-05 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696198+0000", 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023703299999999999 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396712407000001, 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396697804, 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396680499, 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.39665639, 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396628314000001, 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396601322, 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396560763, 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.396537375999999, 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37893 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3084288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.300575548999999, 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058980038999999998, 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37893 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733127+0000", 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1699999999999998e-07 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733129+0000", 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4449999999999999e-06 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733138+0000", 2024-09-11T05:22:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3850000000000002e-06 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733143+0000", 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3310000000000003e-06 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791800+0000", 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058656610999999997 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791877+0000", 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7525000000000001e-05 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792106+0000", 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000229125 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.108 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.300552269000001, 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.300532709000001, 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.300513494, 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.300492694000001, 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:14.126 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:14.127 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:14.127 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:14.128 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:14.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:14.129 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:14.127+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:14.129 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:14.130 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:14.130 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:14.130 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:14.130 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:14.131 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:14.133 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:14.133 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:14.149 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:14.149 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:14.228 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:14.228+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:14.272 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:14.272 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:14.281 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:14.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:14.329+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:14.384 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:14.385 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:14.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:14.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:14.430+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:14.496 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:14.496 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:14.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:14.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:14.531+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:14.551 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:22:14.613 INFO:teuthology.orchestra.run.smithi012.stdout:leaving image image_client.0-clone15 intact 2024-09-11T05:22:14.614 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:14.614 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:14.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:14.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:14.632+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:14.727 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:14.728 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:14.733 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:14.733+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:14.737 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-11T05:22:14.834 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:14.834+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:14.881 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:14.882 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:14.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:14.930 INFO:teuthology.orchestra.run.smithi012.stdout:2006 punch from 0xbb05fdd to 0xbb0bc72, (0x5c95 bytes) 2024-09-11T05:22:14.934 INFO:teuthology.orchestra.run.smithi012.stdout:2007 flatten 2024-09-11T05:22:14.935 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:14.935+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:15.021 INFO:teuthology.orchestra.run.smithi012.stdout:2008 write 0x1090a40 thru 0x1090ab6 (0x77 bytes) 2024-09-11T05:22:15.022 INFO:teuthology.orchestra.run.smithi012.stdout:2009 write 0xa70f0b7 thru 0xa71e8d0 (0xf81a bytes) 2024-09-11T05:22:15.031 INFO:teuthology.orchestra.run.smithi012.stdout:2010 punch from 0x153081a to 0x153f58d, (0xed73 bytes) 2024-09-11T05:22:15.031 INFO:teuthology.orchestra.run.smithi012.stdout:2011 writesame 0xa3c7887 thru 0xa3ceebe data_size 0x4e(0x7638 bytes) 2024-09-11T05:22:15.035 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:15.036+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:15.037 INFO:teuthology.orchestra.run.smithi012.stdout:2012 read 0x4c8489f thru 0x4c88b37 (0x4299 bytes) 2024-09-11T05:22:15.037 INFO:teuthology.orchestra.run.smithi012.stdout:2013 write 0x5003f6f thru 0x501088e (0xc920 bytes) 2024-09-11T05:22:15.045 INFO:teuthology.orchestra.run.smithi012.stdout:2014 read 0x10a3095 thru 0x10a554c (0x24b8 bytes) 2024-09-11T05:22:15.045 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.045 INFO:teuthology.orchestra.run.smithi012.stdout:2016 writesame 0x6c4a6af thru 0x6c51269 data_size 0x1d(0x6bbb bytes) 2024-09-11T05:22:15.052 INFO:teuthology.orchestra.run.smithi012.stdout:2017 write 0xaf50fc4 thru 0xaf5fe30 (0xee6d bytes) 2024-09-11T05:22:15.055 INFO:teuthology.orchestra.run.smithi012.stdout:2018 write 0x228cbad thru 0x228db04 (0xf58 bytes) 2024-09-11T05:22:15.057 INFO:teuthology.orchestra.run.smithi012.stdout:2019 read 0x1ab6be0 thru 0x1ab887a (0x1c9b bytes) 2024-09-11T05:22:15.057 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.057 INFO:teuthology.orchestra.run.smithi012.stdout:2021 punch from 0x5ec5836 to 0x5ecab7b, (0x5345 bytes) 2024-09-11T05:22:15.058 INFO:teuthology.orchestra.run.smithi012.stdout:2023 punch from 0x759fad to 0x768a1b, (0xea6e bytes) 2024-09-11T05:22:15.059 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:15.059 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:15.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:15.069 INFO:teuthology.orchestra.run.smithi012.stdout:2026 trunc from 0xdd5dc15 to 0x3bef305 2024-09-11T05:22:15.083 INFO:teuthology.orchestra.run.smithi012.stdout:2028 read 0x262830b thru 0x2630eda (0x8bd0 bytes) 2024-09-11T05:22:15.083 INFO:teuthology.orchestra.run.smithi012.stdout:2030 punch from 0x2fa02df to 0x2faff46, (0xfc67 bytes) 2024-09-11T05:22:15.084 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.084 INFO:teuthology.orchestra.run.smithi012.stdout:2037 read 0x1eddca1 thru 0x1ee8717 (0xaa77 bytes) 2024-09-11T05:22:15.084 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.084 INFO:teuthology.orchestra.run.smithi012.stdout:2039 punch from 0x31995a4 to 0x31a3577, (0x9fd3 bytes) 2024-09-11T05:22:15.084 INFO:teuthology.orchestra.run.smithi012.stdout:2041 read 0x78bb95 thru 0x79affd (0xf469 bytes) 2024-09-11T05:22:15.085 INFO:teuthology.orchestra.run.smithi012.stdout:2043 read 0x3bd435c thru 0x3bd46db (0x380 bytes) 2024-09-11T05:22:15.085 INFO:teuthology.orchestra.run.smithi012.stdout:2045 read 0x68a10 thru 0x741d9 (0xb7ca bytes) 2024-09-11T05:22:15.099 INFO:teuthology.orchestra.run.smithi012.stdout:2046 write 0x8829c44 thru 0x882fe97 (0x6254 bytes) 2024-09-11T05:22:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:2048 read 0x736f28d thru 0x737d10d (0xde81 bytes) 2024-09-11T05:22:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:2049 write 0x3624a18 thru 0x362ca54 (0x803d bytes) 2024-09-11T05:22:15.117 INFO:teuthology.orchestra.run.smithi012.stdout:2050 writesame 0xe69cbcf thru 0xe6ab772 data_size 0x42(0xeba4 bytes) 2024-09-11T05:22:15.117 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.117 INFO:teuthology.orchestra.run.smithi012.stdout:2054 write 0x8279285 thru 0x82857e8 (0xc564 bytes) 2024-09-11T05:22:15.123 INFO:teuthology.orchestra.run.smithi012.stdout:2056 punch from 0xd970355 to 0xd97c856, (0xc501 bytes) 2024-09-11T05:22:15.123 INFO:teuthology.orchestra.run.smithi012.stdout:2057 write 0x4fe89d8 thru 0x4fea147 (0x1770 bytes) 2024-09-11T05:22:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:2060 punch from 0xaaae72b to 0xaabae58, (0xc72d bytes) 2024-09-11T05:22:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:2062 write 0x17b1f90 thru 0x17b7169 (0x51da bytes) 2024-09-11T05:22:15.128 INFO:teuthology.orchestra.run.smithi012.stdout:2063 read 0xb0e33b thru 0xb0fcc1 (0x1987 bytes) 2024-09-11T05:22:15.128 INFO:teuthology.orchestra.run.smithi012.stdout:2064 write 0x972387b thru 0x9725edf (0x2665 bytes) 2024-09-11T05:22:15.137 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:15.136+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:15.143 INFO:teuthology.orchestra.run.smithi012.stdout:2065 trunc from 0xe6ab773 to 0x2fab02a 2024-09-11T05:22:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:2067 trunc from 0x2fab02a to 0xa1b6761 2024-09-11T05:22:15.170 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.170 INFO:teuthology.orchestra.run.smithi012.stdout:2069 write 0x41e157d thru 0x41e7aba (0x653e bytes) 2024-09-11T05:22:15.173 INFO:teuthology.orchestra.run.smithi012.stdout:2070 writesame 0x65a1a0e thru 0x65a400d data_size 0x40(0x2600 bytes) 2024-09-11T05:22:15.176 INFO:teuthology.orchestra.run.smithi012.stdout:2071 read 0x1dae791 thru 0x1db5379 (0x6be9 bytes) 2024-09-11T05:22:15.177 INFO:teuthology.orchestra.run.smithi012.stdout:2073 write 0x92be171 thru 0x92be374 (0x204 bytes) 2024-09-11T05:22:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:2074 read 0x645c239 thru 0x645dceb (0x1ab3 bytes) 2024-09-11T05:22:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:2075 writesame 0x2f05379 thru 0x2f0acd0 data_size 0xc(0x5958 bytes) 2024-09-11T05:22:15.182 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:15.182 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:15.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:15.193 INFO:teuthology.orchestra.run.smithi012.stdout:2076 trunc from 0xa1b6761 to 0x12e110c 2024-09-11T05:22:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:2078 read 0x9676cf thru 0x96dded (0x671f bytes) 2024-09-11T05:22:15.217 INFO:teuthology.orchestra.run.smithi012.stdout:2079 writesame 0x4a100bd thru 0x4a1d500 data_size 0x5f(0xd444 bytes) 2024-09-11T05:22:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:2080 write 0x7cabebc thru 0x7cb845a (0xc59f bytes) 2024-09-11T05:22:15.231 INFO:teuthology.orchestra.run.smithi012.stdout:2081 punch from 0x3b01ca2 to 0x3b066f4, (0x4a52 bytes) 2024-09-11T05:22:15.231 INFO:teuthology.orchestra.run.smithi012.stdout:2083 write 0x3baf438 thru 0x3bb757f (0x8148 bytes) 2024-09-11T05:22:15.235 INFO:teuthology.orchestra.run.smithi012.stdout:2084 write 0x7a78f3e thru 0x7a7acbc (0x1d7f bytes) 2024-09-11T05:22:15.236 INFO:teuthology.orchestra.run.smithi012.stdout:2088 writesame 0x3f582d5 thru 0x3f5bbbf data_size 0x3(0x38eb bytes) 2024-09-11T05:22:15.247 INFO:teuthology.orchestra.run.smithi012.stdout:2089 writesame 0x847841c thru 0x847baae data_size 0x1(0x3693 bytes) 2024-09-11T05:22:15.247 INFO:teuthology.orchestra.run.smithi012.stdout:2090 read 0x67167a8 thru 0x67241ec (0xda45 bytes) 2024-09-11T05:22:15.248 INFO:teuthology.orchestra.run.smithi012.stdout:2091 punch from 0x4341404 to 0x4348a6c, (0x7668 bytes) 2024-09-11T05:22:15.248 INFO:teuthology.orchestra.run.smithi012.stdout:2092 read 0x16e8cad thru 0x16f3a8c (0xade0 bytes) 2024-09-11T05:22:15.256 INFO:teuthology.orchestra.run.smithi012.stdout:2095 writesame 0xa624175 thru 0xa62a89b data_size 0x1(0x6727 bytes) 2024-09-11T05:22:15.260 INFO:teuthology.orchestra.run.smithi012.stdout:2097 trunc from 0xa62a89c to 0xe48de40 2024-09-11T05:22:15.272 INFO:teuthology.orchestra.run.smithi012.stdout:2098 writesame 0xed6dc64 thru 0xed733b0 data_size 0x1(0x574d bytes) 2024-09-11T05:22:15.273 INFO:teuthology.orchestra.run.smithi012.stdout:2099 trunc from 0xed733b1 to 0xea583f1 2024-09-11T05:22:15.276 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:15.276+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:15.279 INFO:teuthology.orchestra.run.smithi012.stdout:2101 clone 17 order 21 su 16384 sc 11 2024-09-11T05:22:15.339 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:15.338+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:15.340 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:15.340 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:15.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:15.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:15.440+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:15.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:15.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:15.549+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:15.618 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:15.618 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:15.627 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:15.641 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:15.640+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:15.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:15.741+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:15.780 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-11T05:22:15.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:15.843 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:15.842+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:15.943 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:15.943+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:15.948 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:15.948 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:15.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:16.045 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:16.045+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:16.068 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:16.068 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:16.069 INFO:teuthology.orchestra.run.smithi012.stdout:2102 trunc from 0xea583f1 to 0x321613a 2024-09-11T05:22:16.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:16.109 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:16.123 INFO:teuthology.orchestra.run.smithi012.stdout:2105 writesame 0xac2aee9 thru 0xac30981 data_size 0x9(0x5a99 bytes) 2024-09-11T05:22:16.123 INFO:teuthology.orchestra.run.smithi012.stdout:2106 punch from 0x2c688cf to 0x2c76221, (0xd952 bytes) 2024-09-11T05:22:16.126 INFO:teuthology.orchestra.run.smithi012.stdout:2107 trunc from 0xac30982 to 0x820fbae 2024-09-11T05:22:16.131 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:16.142 INFO:teuthology.orchestra.run.smithi012.stdout:2109 write 0xd7f90b8 thru 0xd808d7d (0xfcc6 bytes) 2024-09-11T05:22:16.145 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:16.145+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:16.152 INFO:teuthology.orchestra.run.smithi012.stdout:2110 read 0x32b9eb8 thru 0x32bb35b (0x14a4 bytes) 2024-09-11T05:22:16.153 INFO:teuthology.orchestra.run.smithi012.stdout:2111 punch from 0x68b86bc to 0x68bfa8f, (0x73d3 bytes) 2024-09-11T05:22:16.153 INFO:teuthology.orchestra.run.smithi012.stdout:2112 write 0xcecb4c1 thru 0xcecc9bd (0x14fd bytes) 2024-09-11T05:22:16.156 INFO:teuthology.orchestra.run.smithi012.stdout:2113 writesame 0x3c6988b thru 0x3c6a6d1 data_size 0x5(0xe47 bytes) 2024-09-11T05:22:16.158 INFO:teuthology.orchestra.run.smithi012.stdout:2114 write 0xa968ba4 thru 0xa970138 (0x7595 bytes) 2024-09-11T05:22:16.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:16.162 INFO:teuthology.orchestra.run.smithi012.stdout:2115 read 0x9ece4b4 thru 0x9ede31d (0xfe6a bytes) 2024-09-11T05:22:16.162 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:16.162 INFO:teuthology.orchestra.run.smithi012.stdout:2118 write 0x5ac9113 thru 0x5ad22e5 (0x91d3 bytes) 2024-09-11T05:22:16.167 INFO:teuthology.orchestra.run.smithi012.stdout:2120 write 0xbec6d9a thru 0xbed1ce2 (0xaf49 bytes) 2024-09-11T05:22:16.176 INFO:teuthology.orchestra.run.smithi012.stdout:2121 write 0xc7e684c thru 0xc7ead85 (0x453a bytes) 2024-09-11T05:22:16.178 INFO:teuthology.orchestra.run.smithi012.stdout:2122 read 0x56ff74 thru 0x570fe6 (0x1073 bytes) 2024-09-11T05:22:16.178 INFO:teuthology.orchestra.run.smithi012.stdout:2124 read 0xdf3df3 thru 0xdf5672 (0x1880 bytes) 2024-09-11T05:22:16.179 INFO:teuthology.orchestra.run.smithi012.stdout:2125 write 0xb60bb1e thru 0xb60c62c (0xb0f bytes) 2024-09-11T05:22:16.181 INFO:teuthology.orchestra.run.smithi012.stdout:2126 write 0x6f78e90 thru 0x6f7fb70 (0x6ce1 bytes) 2024-09-11T05:22:16.200 INFO:teuthology.orchestra.run.smithi012.stdout:2128 trunc from 0xd808d7e to 0x2c7db 2024-09-11T05:22:16.201 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:16.202 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:16.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:16.257 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:16.257+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:16.293 INFO:teuthology.orchestra.run.smithi012.stdout:2131 read 0x1f52e thru 0x2c7da (0xd2ad bytes) 2024-09-11T05:22:16.309 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:16.310 INFO:teuthology.orchestra.run.smithi012.stdout:2132 write 0xa092bc8 thru 0xa09b971 (0x8daa bytes) 2024-09-11T05:22:16.323 INFO:teuthology.orchestra.run.smithi012.stdout:2133 writesame 0xa28c3c2 thru 0xa28e992 data_size 0x7(0x25d1 bytes) 2024-09-11T05:22:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:16.334 INFO:teuthology.orchestra.run.smithi012.stdout:2134 write 0xe17cbb3 thru 0xe187249 (0xa697 bytes) 2024-09-11T05:22:16.338 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:16.338 INFO:teuthology.orchestra.run.smithi012.stdout:2136 punch from 0x694c161 to 0x694cf97, (0xe36 bytes) 2024-09-11T05:22:16.339 INFO:teuthology.orchestra.run.smithi012.stdout:2138 write 0x36a5549 thru 0x36ae96f (0x9427 bytes) 2024-09-11T05:22:16.347 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:16.346+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:16.347 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:16.347 INFO:teuthology.orchestra.run.smithi012.stdout:2141 read 0xc9005c7 thru 0xc907edd (0x7917 bytes) 2024-09-11T05:22:16.347 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:16.347 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:16.354 INFO:teuthology.orchestra.run.smithi012.stdout:2142 trunc from 0xe18724a to 0x755fc0c 2024-09-11T05:22:16.366 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:16.366 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:16.366 INFO:teuthology.orchestra.run.smithi012.stdout:2143 write 0x471315e thru 0x47154be (0x2361 bytes) 2024-09-11T05:22:16.376 INFO:teuthology.orchestra.run.smithi012.stdout:2144 trunc from 0x755fc0c to 0xbb9c1d4 2024-09-11T05:22:16.378 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:16.378 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:16.378 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:16.378 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:16.381 INFO:teuthology.orchestra.run.smithi012.stdout:2145 flatten 2024-09-11T05:22:16.384 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:16.384 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:16.386 INFO:teuthology.orchestra.run.smithi012.stdout:2146 read 0x28b61fd thru 0x28c3a84 (0xd888 bytes) 2024-09-11T05:22:16.386 INFO:teuthology.orchestra.run.smithi012.stdout:2147 write 0x5d21635 thru 0x5d23954 (0x2320 bytes) 2024-09-11T05:22:16.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:16.389 INFO:teuthology.orchestra.run.smithi012.stdout:2148 write 0x271c5f3 thru 0x272454d (0x7f5b bytes) 2024-09-11T05:22:16.399 INFO:teuthology.orchestra.run.smithi012.stdout:2149 clone 18 order 25 su 8388608 sc 9 2024-09-11T05:22:16.403 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:16.403 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:16.420 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:16.421 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:16.437 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:16.448 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:16.447+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:16.497 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:16.498 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:16.498 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:16.498 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:16.498 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:16.506 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:16.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:16.550+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:16.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:22:16.623 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58270 3.4 e40/22 3:262c4575:::rbd_data.11794a93f042.0000000000000025:head v 40'97, mlcod=39'93)", 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 13.005598314, 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.005817745, 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616992+0000", 2024-09-11T05:22:16.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-07 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617010+0000", 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8865e-05 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617020+0000", 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3400000000000004e-06 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617026+0000", 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0059999999999998e-06 2024-09-11T05:22:16.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619296+0000", 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002270022 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619333+0000", 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7619e-05 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622766+0000", 2024-09-11T05:22:16.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034327899999999998 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622809+0000", 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2425999999999997e-05 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58386 3.9 e40/22 3:904d4ffe:::rbd_data.11794a93f042.0000000000000053:head v 40'82, mlcod=40'80)", 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:16.628 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.976311429999999, 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004810847, 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:16.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-07 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646283+0000", 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646293+0000", 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6169999999999996e-06 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646297+0000", 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.639e-06 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646339+0000", 2024-09-11T05:22:16.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1848999999999999e-05 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646356+0000", 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.698e-05 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651047+0000", 2024-09-11T05:22:16.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046910700000000003 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651089+0000", 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1298000000000003e-05 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58412 3.1e e40/37 3:7bbe3ffa:::rbd_data.11794a93f042.0000000000000063:head v 40'93, mlcod=40'91)", 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.964497594999999, 2024-09-11T05:22:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047628849999999997, 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4700000000000001e-07 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658101+0000", 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5229999999999995e-06 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658115+0000", 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3776e-05 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658124+0000", 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3030000000000005e-06 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658183+0000", 2024-09-11T05:22:16.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9382000000000002e-05 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658207+0000", 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3507999999999999e-05 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662817+0000", 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046103150000000002 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662854+0000", 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7431000000000001e-05 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.4 epoch 40/22 rep_tid 266 entries 40'102 (0'0) error 3:207494c7:::rbd_data.11794a93f042.0000000000000070:head by client.4473.0:58427 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'100)", 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.663810+0000", 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.958778805, 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046219039999999996, 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663810+0000", 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663810+0000", 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663811+0000", 2024-09-11T05:22:16.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2799999999999996e-07 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663820+0000", 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5320000000000006e-06 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663839+0000", 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9947000000000001e-05 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663853+0000", 2024-09-11T05:22:16.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3804e-05 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.663926+0000", 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2855000000000006e-05 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.668432+0000", 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045061379999999998 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58436 3.0 e40/22 3:01dc6865:::rbd_data.11794a93f042.000000000000006e:head v 40'96, mlcod=40'93)", 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.956575021999999, 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051595490000000003, 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666015+0000", 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666019+0000", 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3170000000000003e-06 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666028+0000", 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4080000000000004e-06 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666035+0000", 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666084+0000", 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9490999999999998e-05 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666108+0000", 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3728000000000001e-05 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671117+0000", 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050084129999999998 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671174+0000", 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7130999999999999e-05 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58444 3.4 e40/22 3:207494c7:::rbd_data.11794a93f042.0000000000000070:head v 40'103, mlcod=40'101)", 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.953407107, 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048760670000000004, 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:16.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669183+0000", 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5400000000000001e-07 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669189+0000", 2024-09-11T05:22:16.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1449999999999996e-06 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669202+0000", 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2819999999999999e-05 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669209+0000", 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3540000000000002e-06 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669257+0000", 2024-09-11T05:22:16.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7490000000000001e-05 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669270+0000", 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3018e-05 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674028+0000", 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047580419999999997 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674058+0000", 2024-09-11T05:22:16.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0543999999999998e-05 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58574 3.9 e40/22 3:96a6d2a0:::rbd_data.11794a93f042.00000000000000b3:head v 40'84, mlcod=40'82)", 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.909983677, 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048300169999999998, 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712612+0000", 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712622+0000", 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9340000000000001e-06 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712628+0000", 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3069999999999999e-06 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712676+0000", 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7731000000000001e-05 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712688+0000", 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1659e-05 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717368+0000", 2024-09-11T05:22:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046800399999999999 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717436+0000", 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7885999999999993e-05 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58579 3.4 e40/22 3:27d97e3d:::rbd_data.11794a93f042.00000000000000b6:head v 40'111, mlcod=40'109)", 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.715584+0000", 2024-09-11T05:22:16.654 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.907005327, 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004716067, 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715584+0000", 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715584+0000", 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715585+0000", 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5799999999999999e-07 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715592+0000", 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4819999999999997e-06 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715605+0000", 2024-09-11T05:22:16.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3148e-05 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715614+0000", 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8759999999999994e-06 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715664+0000", 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9675000000000001e-05 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.715684+0000", 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0715000000000001e-05 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.720249+0000", 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045647700000000001 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.720300+0000", 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0742999999999999e-05 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.0 epoch 40/22 rep_tid 289 entries 40'101 (0'0) error 3:07044964:::rbd_data.11794a93f042.00000000000000c0:head by client.4473.0:58588 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'99)", 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.718128+0000", 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.904460846999999, 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004590088, 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718128+0000", 2024-09-11T05:22:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718128+0000", 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718129+0000", 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2300000000000001e-07 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718141+0000", 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1712999999999999e-05 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718165+0000", 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4206000000000002e-05 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718182+0000", 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7501000000000001e-05 2024-09-11T05:22:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.718264+0000", 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1818999999999997e-05 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.722718+0000", 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0044542260000000004 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 397 entries 40'85 (0'0) error 3:9228f1d6:::rbd_data.11794a93f042.00000000000000d9:head by client.4473.0:58643 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'83)", 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.882918895, 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004918164, 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739671+0000", 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3300000000000002e-07 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739678+0000", 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739694+0000", 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6099999999999998e-05 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739703+0000", 2024-09-11T05:22:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3489999999999998e-06 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739776+0000", 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2795999999999999e-05 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744588+0000", 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004812424 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 988 entries 40'98 (0'0) error 3:7aa91a15:::rbd_data.11794a93f042.00000000000000da:head by client.4473.0:58645 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'96)", 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.882795092, 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047959609999999996, 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739795+0000", 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3600000000000003e-07 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739803+0000", 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5499999999999995e-06 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739823+0000", 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0182000000000001e-05 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739838+0000", 2024-09-11T05:22:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4618e-05 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739894+0000", 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6373999999999999e-05 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744590+0000", 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046956009999999998 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58825 3.4 e40/22 3:20d0ea81:::rbd_data.11794a93f042.0000000000000129:head v 40'117, mlcod=40'115)", 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.834241421, 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048385770000000002, 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788353+0000", 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0309999999999998e-06 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788362+0000", 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2600000000000005e-06 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788368+0000", 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.964e-06 2024-09-11T05:22:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788419+0000", 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1829000000000001e-05 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788437+0000", 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7671000000000001e-05 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793143+0000", 2024-09-11T05:22:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047061539999999997 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793186+0000", 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3137999999999999e-05 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 439 entries 40'95 (0'0) error 3:906e0365:::rbd_data.11794a93f042.0000000000000142:head by client.4473.0:58870 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'93)", 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.804743+0000", 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.817846241, 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046608550000000002, 2024-09-11T05:22:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804743+0000", 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804743+0000", 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804744+0000", 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9599999999999998e-07 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804752+0000", 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3790000000000006e-06 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804773+0000", 2024-09-11T05:22:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1168000000000001e-05 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804792+0000", 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8561000000000001e-05 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.804877+0000", 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4920999999999996e-05 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809404+0000", 2024-09-11T05:22:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045270299999999996 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.0 epoch 40/22 rep_tid 309 entries 40'109 (0'0) error 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head by client.4473.0:58874 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.815745686, 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051466819999999996, 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806844+0000", 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9400000000000005e-07 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806852+0000", 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806873+0000", 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0216000000000001e-05 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806890+0000", 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7002000000000001e-05 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806949+0000", 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9206999999999997e-05 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.811990+0000", 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050413639999999996 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1034 entries 40'110 (0'0) error 3:7a5c3482:::rbd_data.11794a93f042.0000000000000147:head by client.4473.0:58878 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.812878982000001, 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050452520000000001, 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809711+0000", 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5099999999999999e-07 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809719+0000", 2024-09-11T05:22:16.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1699999999999997e-06 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809741+0000", 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2204999999999998e-05 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809760+0000", 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8855000000000002e-05 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809835+0000", 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4746999999999994e-05 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.814755+0000", 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049206240000000002 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58889 3.0 e40/22 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head v 40'110, mlcod=40'108)", 2024-09-11T05:22:16.686 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.810013876999999, 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050379939999999996, 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812576+0000", 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5300000000000003e-07 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812581+0000", 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9150000000000004e-06 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812591+0000", 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.73e-06 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812597+0000", 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812641+0000", 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4471999999999997e-05 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812659+0000", 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8397e-05 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817574+0000", 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049149750000000002 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817613+0000", 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8899000000000001e-05 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1037 entries 40'111 (0'0) error 3:7a47fa34:::rbd_data.11794a93f042.000000000000014e:head by client.4473.0:58896 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'109)", 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.807169453, 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048999350000000002, 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815421+0000", 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5899999999999995e-07 2024-09-11T05:22:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815428+0000", 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.695e-06 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815447+0000", 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9063999999999999e-05 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815468+0000", 2024-09-11T05:22:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1129e-05 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815560+0000", 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1926e-05 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820320+0000", 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047592620000000002 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 442 entries 40'97 (0'0) error 3:97796a0c:::rbd_data.11794a93f042.0000000000000150:head by client.4473.0:58898 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'95)", 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815713+0000", 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.806875788999999, 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004601824, 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815713+0000", 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815713+0000", 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815714+0000", 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815730+0000", 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6039e-05 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815750+0000", 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9837999999999999e-05 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815764+0000", 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4433000000000001e-05 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815907+0000", 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014263599999999999 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820315+0000", 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0044082360000000003 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58903 3.1e e40/37 3:7a5c3482:::rbd_data.11794a93f042.0000000000000147:head v 40'112, mlcod=40'109)", 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815788+0000", 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.806801409, 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045724099999999998, 2024-09-11T05:22:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815788+0000", 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815788+0000", 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815789+0000", 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9899999999999999e-07 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815796+0000", 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0210000000000002e-06 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815807+0000", 2024-09-11T05:22:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1837e-05 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815814+0000", 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9020000000000002e-06 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815869+0000", 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4778000000000003e-05 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815888+0000", 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8924e-05 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820323+0000", 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0044347129999999998 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820360+0000", 2024-09-11T05:22:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7435999999999999e-05 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59625 3.1e e40/37 3:788c33b7:::rbd_data.117971c15f82.0000000000000007:head v 40'119, mlcod=40'117)", 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.453820439999999, 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.023475949999999999, 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168771+0000", 2024-09-11T05:22:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4399999999999999e-06 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171485+0000", 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0027135879999999999 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171507+0000", 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2240000000000001e-05 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171519+0000", 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1625e-05 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171595+0000", 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6513000000000004e-05 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171620+0000", 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4960000000000002e-05 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192195+0000", 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.020575192999999999 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192245+0000", 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9391000000000002e-05 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:16.707 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:16.709 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:16.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:16.708+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-11T05:22:16.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:16.809+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:16.864 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:16.865 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:16.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:16.910 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:16.910+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:16.999 INFO:teuthology.orchestra.run.smithi012.stdout:2151 writesame 0x3e72a56 thru 0x3e75d10 data_size 0x1b(0x32bb bytes) 2024-09-11T05:22:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:2152 read 0x67b9551 thru 0x67c52d4 (0xbd84 bytes) 2024-09-11T05:22:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:2153 write 0x6e80d6c thru 0x6e8ac33 (0x9ec8 bytes) 2024-09-11T05:22:17.011 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:17.011+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:17.011 INFO:teuthology.orchestra.run.smithi012.stdout:2156 read 0x5ef09c5 thru 0x5ef519b (0x47d7 bytes) 2024-09-11T05:22:17.011 INFO:teuthology.orchestra.run.smithi012.stdout:2160 read 0x454412a thru 0x4548035 (0x3f0c bytes) 2024-09-11T05:22:17.011 INFO:teuthology.orchestra.run.smithi012.stdout:2161 write 0x95c3ede thru 0x95ce0bd (0xa1e0 bytes) 2024-09-11T05:22:17.026 INFO:teuthology.orchestra.run.smithi012.stdout:2162 trunc from 0xbb9c1d4 to 0x2bacb49 2024-09-11T05:22:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:17.041 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:17.048 INFO:teuthology.orchestra.run.smithi012.stdout:2163 write 0x402154f thru 0x4026729 (0x51db bytes) 2024-09-11T05:22:17.051 INFO:teuthology.orchestra.run.smithi012.stdout:2164 read 0x3294c2c thru 0x329719c (0x2571 bytes) 2024-09-11T05:22:17.051 INFO:teuthology.orchestra.run.smithi012.stdout:2165 write 0x31b952c thru 0x31bc808 (0x32dd bytes) 2024-09-11T05:22:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:2166 read 0x20374c2 thru 0x2039a6c (0x25ab bytes) 2024-09-11T05:22:17.059 INFO:teuthology.orchestra.run.smithi012.stdout:2167 trunc from 0x402672a to 0x7b74b4d 2024-09-11T05:22:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.072 INFO:teuthology.orchestra.run.smithi012.stdout:2169 write 0x9148ac6 thru 0x9154ffd (0xc538 bytes) 2024-09-11T05:22:17.080 INFO:teuthology.orchestra.run.smithi012.stdout:2172 trunc from 0x9154ffe to 0xea49192 2024-09-11T05:22:17.085 INFO:teuthology.orchestra.run.smithi012.stdout:2175 writesame 0x71552d0 thru 0x715923d data_size 0x17(0x3f6e bytes) 2024-09-11T05:22:17.092 INFO:teuthology.orchestra.run.smithi012.stdout:2178 trunc from 0xea49192 to 0xab74e59 2024-09-11T05:22:17.110 INFO:teuthology.orchestra.run.smithi012.stdout:2182 trunc from 0xab74e59 to 0x14c0d84 2024-09-11T05:22:17.112 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:17.112+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:17.129 INFO:teuthology.orchestra.run.smithi012.stdout:2183 read 0xd7582c thru 0xd7be00 (0x65d5 bytes) 2024-09-11T05:22:17.129 INFO:teuthology.orchestra.run.smithi012.stdout:2185 read 0xb7949c thru 0xb795e7 (0x14c bytes) 2024-09-11T05:22:17.130 INFO:teuthology.orchestra.run.smithi012.stdout:2186 read 0x6445d4 thru 0x64531c (0xd49 bytes) 2024-09-11T05:22:17.130 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.130 INFO:teuthology.orchestra.run.smithi012.stdout:2188 read 0x8c3b66 thru 0x8c7db3 (0x424e bytes) 2024-09-11T05:22:17.143 INFO:teuthology.orchestra.run.smithi012.stdout:2189 trunc from 0x14c0d84 to 0xc60bdd1 2024-09-11T05:22:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:2190 punch from 0x678b9df to 0x678cdf2, (0x1413 bytes) 2024-09-11T05:22:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:2191 read 0x5843f35 thru 0x584818e (0x425a bytes) 2024-09-11T05:22:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:2192 write 0x26112d1 thru 0x261cd9b (0xbacb bytes) 2024-09-11T05:22:17.152 INFO:teuthology.orchestra.run.smithi012.stdout:2195 read 0x40980f7 thru 0x409d2ed (0x51f7 bytes) 2024-09-11T05:22:17.152 INFO:teuthology.orchestra.run.smithi012.stdout:2196 write 0x69e9b68 thru 0x69f7e1e (0xe2b7 bytes) 2024-09-11T05:22:17.158 INFO:teuthology.orchestra.run.smithi012.stdout:2198 trunc from 0xc60bdd1 to 0x83a44b1 2024-09-11T05:22:17.164 INFO:teuthology.orchestra.run.smithi012.stdout:2200 punch from 0x7e71862 to 0x7e801a8, (0xe946 bytes) 2024-09-11T05:22:17.164 INFO:teuthology.orchestra.run.smithi012.stdout:2201 read 0x1bc921 thru 0x1c621e (0x98fe bytes) 2024-09-11T05:22:17.169 INFO:teuthology.orchestra.run.smithi012.stdout:2202 trunc from 0x83a44b1 to 0x3d1eca8 2024-09-11T05:22:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:17.175 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.430840849999999, 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.430828962, 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.430791742, 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.430776960999999, 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.430765624999999, 2024-09-11T05:22:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.429614824000002, 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.429600368999999, 2024-09-11T05:22:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.429589888999999, 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.429579422, 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.429561062000001, 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.426851989999999, 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.426828990000001, 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.426807626999999, 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.426786108000002, 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.426765181, 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.424931757, 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.424921443999999, 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.424911071, 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.424896042, 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.424886034, 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.263 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:2203 read 0x1b17f6e thru 0x1b1e318 (0x63ab bytes) 2024-09-11T05:22:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:2204 write 0x1d205de thru 0x1d2f94c (0xf36f bytes) 2024-09-11T05:22:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:2205 read 0x2be8cfc thru 0x2becaa4 (0x3da9 bytes) 2024-09-11T05:22:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:2206 read 0x3544f1f thru 0x3551476 (0xc558 bytes) 2024-09-11T05:22:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:2208 read 0x276d572 thru 0x277bb1c (0xe5ab bytes) 2024-09-11T05:22:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:2210 trunc from 0x3d1eca8 to 0x15739a8 2024-09-11T05:22:17.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2212 write 0x19fae11 thru 0x1a033cd (0x85bd bytes) 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2214 write 0x6d53eaa thru 0x6d57dca (0x3f21 bytes) 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2215 read 0x125e4a8 thru 0x1260216 (0x1d6f bytes) 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2216 write 0x23565c5 thru 0x2359461 (0x2e9d bytes) 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2217 read 0x25ab9d9 thru 0x25ae8d0 (0x2ef8 bytes) 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2218 flatten 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2219 write 0xaf8bec7 thru 0xaf92d2e (0x6e68 bytes) 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:2221 read 0x118e7ab thru 0x11977d0 (0x9026 bytes) 2024-09-11T05:22:17.268 INFO:teuthology.orchestra.run.smithi012.stdout:2222 trunc from 0xaf92d2f to 0xcba858a 2024-09-11T05:22:17.268 INFO:teuthology.orchestra.run.smithi012.stdout:2223 trunc from 0xcba858a to 0x6ba6dd 2024-09-11T05:22:17.268 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:17.264+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:2225 read 0x6adf50 thru 0x6b0af9 (0x2baa bytes) 2024-09-11T05:22:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:2226 punch from 0x590b4f to 0x5970a3, (0x6554 bytes) 2024-09-11T05:22:17.295 INFO:teuthology.orchestra.run.smithi012.stdout:2227 write 0xa7387eb thru 0xa741c50 (0x9466 bytes) 2024-09-11T05:22:17.298 INFO:teuthology.orchestra.run.smithi012.stdout:2230 write 0x88c523e thru 0x88c7bd8 (0x299b bytes) 2024-09-11T05:22:17.301 INFO:teuthology.orchestra.run.smithi012.stdout:2231 write 0x6e55e15 thru 0x6e637e1 (0xd9cd bytes) 2024-09-11T05:22:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:2232 read 0x6fc7e71 thru 0x6fcfd14 (0x7ea4 bytes) 2024-09-11T05:22:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:2233 punch from 0xa06dc7b to 0xa06f462, (0x17e7 bytes) 2024-09-11T05:22:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:2234 punch from 0x919876c to 0x919945e, (0xcf2 bytes) 2024-09-11T05:22:17.306 INFO:teuthology.orchestra.run.smithi012.stdout:2235 write 0x1de555e thru 0x1df164d (0xc0f0 bytes) 2024-09-11T05:22:17.310 INFO:teuthology.orchestra.run.smithi012.stdout:2236 trunc from 0xa741c51 to 0xc206a89 2024-09-11T05:22:17.315 INFO:teuthology.orchestra.run.smithi012.stdout:2239 writesame 0x188e759 thru 0x18914c7 data_size 0x1(0x2d6f bytes) 2024-09-11T05:22:17.321 INFO:teuthology.orchestra.run.smithi012.stdout:2241 read 0xb0e6a11 thru 0xb0f6389 (0xf979 bytes) 2024-09-11T05:22:17.321 INFO:teuthology.orchestra.run.smithi012.stdout:2244 write 0x5b2cd49 thru 0x5b38b38 (0xbdf0 bytes) 2024-09-11T05:22:17.323 INFO:teuthology.orchestra.run.smithi012.stdout:2245 writesame 0x24121dc thru 0x2416741 data_size 0x2a(0x4566 bytes) 2024-09-11T05:22:17.324 INFO:teuthology.orchestra.run.smithi012.stdout:2246 write 0x8489c09 thru 0x848af9c (0x1394 bytes) 2024-09-11T05:22:17.333 INFO:teuthology.orchestra.run.smithi012.stdout:2247 trunc from 0xc206a89 to 0x81cbbf6 2024-09-11T05:22:17.342 INFO:teuthology.orchestra.run.smithi012.stdout:2249 trunc from 0x81cbbf6 to 0x5f8e378 2024-09-11T05:22:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:2251 write 0x817d3da thru 0x8187307 (0x9f2e bytes) 2024-09-11T05:22:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:2254 read 0x140945c thru 0x140fb3c (0x66e1 bytes) 2024-09-11T05:22:17.362 INFO:teuthology.orchestra.run.smithi012.stdout:2255 write 0x238b8c1 thru 0x238da88 (0x21c8 bytes) 2024-09-11T05:22:17.363 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.365 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:17.365+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:17.370 INFO:teuthology.orchestra.run.smithi012.stdout:2258 write 0x9afcf88 thru 0x9afd7ab (0x824 bytes) 2024-09-11T05:22:17.374 INFO:teuthology.orchestra.run.smithi012.stdout:2259 read 0x6f51444 thru 0x6f5474a (0x3307 bytes) 2024-09-11T05:22:17.374 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.374 INFO:teuthology.orchestra.run.smithi012.stdout:2261 write 0x22719c0 thru 0x22791be (0x77ff bytes) 2024-09-11T05:22:17.375 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:2263 read 0x7eaa964 thru 0x7eb3848 (0x8ee5 bytes) 2024-09-11T05:22:17.378 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:17.378 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:17.379 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:17.379 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:17.383 INFO:teuthology.orchestra.run.smithi012.stdout:2264 writesame 0xbec31b5 thru 0xbec8174 data_size 0x2c(0x4fc0 bytes) 2024-09-11T05:22:17.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:17.394 INFO:teuthology.orchestra.run.smithi012.stdout:2265 trunc from 0xbec8175 to 0x2a7af49 2024-09-11T05:22:17.404 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.404 INFO:teuthology.orchestra.run.smithi012.stdout:2267 read 0x1d564b5 thru 0x1d57979 (0x14c5 bytes) 2024-09-11T05:22:17.405 INFO:teuthology.orchestra.run.smithi012.stdout:2271 read 0x2754b2e thru 0x2759c2b (0x50fe bytes) 2024-09-11T05:22:17.411 INFO:teuthology.orchestra.run.smithi012.stdout:2272 trunc from 0x2a7af49 to 0x7d33795 2024-09-11T05:22:17.417 INFO:teuthology.orchestra.run.smithi012.stdout:2275 read 0x1a0c14 thru 0x1a19d5 (0xdc2 bytes) 2024-09-11T05:22:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:2276 writesame 0xe829262 thru 0xe82c6c1 data_size 0x10(0x3460 bytes) 2024-09-11T05:22:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:2278 read 0x3402f80 thru 0x3409a8b (0x6b0c bytes) 2024-09-11T05:22:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:2282 writesame 0x9a0eab6 thru 0x9a1be44 data_size 0x7(0xd38f bytes) 2024-09-11T05:22:17.435 INFO:teuthology.orchestra.run.smithi012.stdout:2283 write 0xddf07aa thru 0xddf2a58 (0x22af bytes) 2024-09-11T05:22:17.437 INFO:teuthology.orchestra.run.smithi012.stdout:2284 write 0xe25f944 thru 0xe263ded (0x44aa bytes) 2024-09-11T05:22:17.438 INFO:teuthology.orchestra.run.smithi012.stdout:2285 write 0xe15257e thru 0xe155d30 (0x37b3 bytes) 2024-09-11T05:22:17.440 INFO:teuthology.orchestra.run.smithi012.stdout:2286 read 0x31367ec thru 0x3137e91 (0x16a6 bytes) 2024-09-11T05:22:17.440 INFO:teuthology.orchestra.run.smithi012.stdout:2287 read 0x7de18f1 thru 0x7dee301 (0xca11 bytes) 2024-09-11T05:22:17.446 INFO:teuthology.orchestra.run.smithi012.stdout:2288 trunc from 0xe82c6c2 to 0x8a375b6 2024-09-11T05:22:17.453 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.453 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.453 INFO:teuthology.orchestra.run.smithi012.stdout:2294 write 0x36bcb9a thru 0x36cabdc (0xe043 bytes) 2024-09-11T05:22:17.456 INFO:teuthology.orchestra.run.smithi012.stdout:2295 read 0x89f851b thru 0x89fac0b (0x26f1 bytes) 2024-09-11T05:22:17.456 INFO:teuthology.orchestra.run.smithi012.stdout:2296 punch from 0x4ca618e to 0x4ca7d4e, (0x1bc0 bytes) 2024-09-11T05:22:17.464 INFO:teuthology.orchestra.run.smithi012.stdout:2298 write 0xb6d17a4 thru 0xb6d6072 (0x48cf bytes) 2024-09-11T05:22:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:2299 punch from 0x6ad56f4 to 0x6ae4e53, (0xf75f bytes) 2024-09-11T05:22:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:2301 read 0xaa2268a thru 0xaa2f0cc (0xca43 bytes) 2024-09-11T05:22:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:2302 read 0x1c98b3 thru 0x1cb787 (0x1ed5 bytes) 2024-09-11T05:22:17.466 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:17.466+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:2303 punch from 0x67251ee to 0x672cb0b, (0x791d bytes) 2024-09-11T05:22:17.472 INFO:teuthology.orchestra.run.smithi012.stdout:2304 trunc from 0xb6d6073 to 0x875775e 2024-09-11T05:22:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:2306 read 0x3e25f2b thru 0x3e28253 (0x2329 bytes) 2024-09-11T05:22:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:2307 punch from 0x380d358 to 0x3813e86, (0x6b2e bytes) 2024-09-11T05:22:17.482 INFO:teuthology.orchestra.run.smithi012.stdout:2309 write 0x8cebb20 thru 0x8ceefcc (0x34ad bytes) 2024-09-11T05:22:17.485 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.485 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.487 INFO:teuthology.orchestra.run.smithi012.stdout:2314 trunc from 0x8ceefcd to 0x6f6897c 2024-09-11T05:22:17.493 INFO:teuthology.orchestra.run.smithi012.stdout:2315 read 0x295b1b5 thru 0x295f32c (0x4178 bytes) 2024-09-11T05:22:17.499 INFO:teuthology.orchestra.run.smithi012.stdout:2319 trunc from 0x6f6897c to 0x2265f73 2024-09-11T05:22:17.518 INFO:teuthology.orchestra.run.smithi012.stdout:2320 trunc from 0x2265f73 to 0x93eb47f 2024-09-11T05:22:17.524 INFO:teuthology.orchestra.run.smithi012.stdout:2322 writesame 0x8ed7ec0 thru 0x8ee475e data_size 0x4d(0xc89f bytes) 2024-09-11T05:22:17.537 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:17.538 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:17.538 INFO:teuthology.orchestra.run.smithi012.stdout:2323 trunc from 0x93eb47f to 0x4ba4bc 2024-09-11T05:22:17.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:17.557 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:22:17.558 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:22:17.558 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T05:22:17.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:22:17.558 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.576 INFO:teuthology.orchestra.run.smithi012.stdout:2325 writesame 0x808a9cb thru 0x8099ed1 data_size 0x1d(0xf507 bytes) 2024-09-11T05:22:17.576 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:17.576 INFO:teuthology.orchestra.run.smithi012.stdout:2328 writesame 0x301707b thru 0x301c5c4 data_size 0x1(0x554a bytes) 2024-09-11T05:22:17.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:17.576+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:22:17.589 INFO:teuthology.orchestra.run.smithi012.stdout:2329 writesame 0x31b7a4f thru 0x31c6433 data_size 0x3(0xe9e5 bytes) 2024-09-11T05:22:17.615 INFO:teuthology.orchestra.run.smithi012.stdout:2331 write 0xdefb8ad thru 0xdefdffc (0x2750 bytes) 2024-09-11T05:22:17.616 INFO:teuthology.orchestra.run.smithi012.stdout:2332 write 0x9c453b3 thru 0x9c4e1aa (0x8df8 bytes) 2024-09-11T05:22:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:2333 read 0x3b2153d thru 0x3b25dba (0x487e bytes) 2024-09-11T05:22:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:2334 punch from 0x4409bb4 to 0x44151be, (0xb60a bytes) 2024-09-11T05:22:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:2337 read 0x76c49ba thru 0x76c60d6 (0x171d bytes) 2024-09-11T05:22:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:2338 write 0xe7b9515 thru 0xe7c548d (0xbf79 bytes) 2024-09-11T05:22:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:2339 write 0x40f11af thru 0x40ff18e (0xdfe0 bytes) 2024-09-11T05:22:17.636 INFO:teuthology.orchestra.run.smithi012.stdout:2340 trunc from 0xe7c548e to 0xafe10e1 2024-09-11T05:22:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:2341 write 0x56d193b thru 0x56de55c (0xcc22 bytes) 2024-09-11T05:22:17.651 INFO:teuthology.orchestra.run.smithi012.stdout:2343 writesame 0xc758923 thru 0xc75fc4a data_size 0x43(0x7328 bytes) 2024-09-11T05:22:17.653 INFO:teuthology.orchestra.run.smithi012.stdout:2345 write 0x559ac4b thru 0x55a25cb (0x7981 bytes) 2024-09-11T05:22:17.659 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36838 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.025772523000001, 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059077179, 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36838 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632957+0000", 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632959+0000", 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1390000000000002e-06 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632966+0000", 2024-09-11T05:22:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8990000000000004e-06 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632977+0000", 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1574e-05 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689825+0000", 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.056847555000000001 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689904+0000", 2024-09-11T05:22:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9449000000000005e-05 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692033+0000", 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021291130000000002 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.025741794000002, 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36845 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1921024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.023620502, 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059196066999999998, 2024-09-11T05:22:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36845 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635109+0000", 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635111+0000", 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4380000000000002e-06 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635117+0000", 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.161e-06 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635122+0000", 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.831e-06 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694031+0000", 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058908380000000003 2024-09-11T05:22:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694099+0000", 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8046000000000005e-05 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694304+0000", 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000205749 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.023600273, 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.023578708999999, 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.023564698000001, 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36851 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1994752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021750008000001, 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059218845999999999, 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36851 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636980+0000", 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9600000000000008e-07 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636984+0000", 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000004e-06 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636986+0000", 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6029999999999999e-06 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695889+0000", 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058902788999999997 2024-09-11T05:22:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695961+0000", 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1365999999999994e-05 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696198+0000", 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023703299999999999 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021739397000001, 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021724794000001, 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021707489000001, 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021683379999999, 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021655303999999, 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021628312000001, 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.715 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:17.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021587752999999, 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.719 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.021564366, 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.724 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:17.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:17.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:17.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37893 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3084288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.925602539, 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058980038999999998, 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.728 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37893 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733127+0000", 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1699999999999998e-07 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733129+0000", 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4449999999999999e-06 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733138+0000", 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3850000000000002e-06 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733143+0000", 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3310000000000003e-06 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791800+0000", 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058656610999999997 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791877+0000", 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7525000000000001e-05 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792106+0000", 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000229125 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.732 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.925579258999999, 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:17.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:17.736 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.925559699000001, 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:17.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.925540483999999, 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:17.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:17.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:17.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.925519684000001, 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:17.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:17.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:17.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:17.750 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:17.751 INFO:teuthology.orchestra.run.smithi012.stdout:2346 trunc from 0xc75fc4b to 0x144082b 2024-09-11T05:22:17.751 INFO:teuthology.orchestra.run.smithi012.stdout:2347 punch from 0x103dd3c to 0x104ab50, (0xce14 bytes) 2024-09-11T05:22:17.752 INFO:teuthology.orchestra.run.smithi012.stdout:2348 clone 19 order 20 su 262144 sc 14 2024-09-11T05:22:17.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:17.753 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:17.751+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:17.852 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:17.851+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:22:17.871 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 53, 2024-09-11T05:22:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "5fd14db5-8ee9-4e34-bd57-a8040293ab17", 2024-09-11T05:22:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2024-09-11T05:21:12.602514+0000", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2024-09-11T05:22:17.567845+0000", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2024-09-11T05:21:25.731933+0000", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2024-09-11T05:22:06.508184+0000", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5801984, 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "noscrub", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2024-09-11T05:22:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 4, 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 3, 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "jewel", 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "squid", 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_crimson": false, 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2024-09-11T05:22:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": ".mgr", 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:27.582783+0000", 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:22:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:22:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "17", 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2024-09-11T05:22:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:22:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:22:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_max": 32, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": {} 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 8, 2024-09-11T05:22:17.879 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 8, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.25, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 2, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 2, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 1, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:31.353652+0000", 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:22:17.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2024-09-11T05:22:17.881 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "21", 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:22:17.882 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 2, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 21, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:22:17.883 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:22:17.884 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 1.9900000095367432, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 1.9900000095367432, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 1.75, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 1.75, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 1, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.886 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "pool_client.0", 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:41.109530+0000", 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:22:17.887 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 32, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 32, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 32, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 32, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 32, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:22:17.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "52", 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 20, 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 52, 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:22:17.889 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:22:17.890 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.891 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 1.5, 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 1.5, 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 1, 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 1.5, 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 1.5, 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 1, 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:22:17.892 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e628e137-3e68-4084-a084-200022b8da35", 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 44, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.893 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.894 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/2997410357", 2024-09-11T05:22:17.897 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/2997410357", 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/2997410357", 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/2997410357", 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "26db6fe3-81d0-40ae-a4e1-9a7460fabc2c", 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.898 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 44, 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2024-09-11T05:22:17.899 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2024-09-11T05:22:17.900 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2024-09-11T05:22:17.901 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/852655937", 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/852655937", 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/852655937", 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/852655937", 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "00ff2990-a7cb-48a2-ab03-6739942d65d7", 2024-09-11T05:22:17.903 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 18, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.904 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.906 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3485488459 2024-09-11T05:22:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/3485488459", 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/3485488459", 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/3485488459", 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/3485488459", 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "d1c858fd-7b66-4e1b-aa18-e3fd567e1417", 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/2211289880", 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/2211289880", 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/2211289880", 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/2211289880", 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "586534a4-d5e3-4af4-a2e5-aa4ec052b582", 2024-09-11T05:22:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 37, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6800", 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6801", 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6802", 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6803", 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6806", 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6807", 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6804", 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6805", 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6801/1639325236", 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6803/1639325236", 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6807/1639325236", 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6805/1639325236", 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:22:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "801041dc-7a4c-4776-bfbb-68be37655407", 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 22, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6816", 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6817", 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6818", 2024-09-11T05:22:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6819", 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6822", 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6823", 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6820", 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6821", 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6817/2370940838", 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6819/2370940838", 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6823/2370940838", 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6821/2370940838", 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e0820ac1-b43f-486f-9d7b-155b46b33950", 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 45, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6826", 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6827", 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6828", 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6829", 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6832", 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6833", 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6830", 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6831", 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:22:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6827/1798055911", 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6829/1798055911", 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6833/1798055911", 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6831/1798055911", 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e22fdfda-9a13-42f2-be4f-f7c6e0ffd324", 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 37, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:22:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6808", 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6809", 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6810", 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6811", 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6814", 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6815", 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:22:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6812", 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6813", 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6809/1122624549", 2024-09-11T05:22:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6811/1122624549", 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6815/1122624549", 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6813/1122624549", 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.912439+0000", 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.788769+0000", 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.857319+0000", 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:22:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.926699+0000", 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.752975+0000", 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.222079+0000", 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.095040+0000", 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:22:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.860946+0000", 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [], 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_primaries": [], 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2024-09-11T05:22:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklist": {}, 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "range_blocklist": {}, 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [], 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2024-09-11T05:22:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {}, 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode": { 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_enabled": false, 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_bucket_count": 0, 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_bucket": 0 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:17.946 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:17.947 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:17.948 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:17.948 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:17.948 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:17.949 INFO:tasks.thrashosds.thrasher:j is {'epoch': 53, 'fsid': '5fd14db5-8ee9-4e34-bd57-a8040293ab17', 'created': '2024-09-11T05:21:12.602514+0000', 'modified': '2024-09-11T05:22:17.567845+0000', 'last_up_change': '2024-09-11T05:21:25.731933+0000', 'last_in_change': '2024-09-11T05:22:06.508184+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:21:27.582783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:21:31.353652+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:21:41.109530+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 20, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e628e137-3e68-4084-a084-200022b8da35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 44, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6808', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6809', 'nonce': 2997410357}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6810', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6811', 'nonce': 2997410357}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6814', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6815', 'nonce': 2997410357}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6812', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6813', 'nonce': 2997410357}]}, 'public_addr': '172.21.15.12:6809/2997410357', 'cluster_addr': '172.21.15.12:6811/2997410357', 'heartbeat_back_addr': '172.21.15.12:6815/2997410357', 'heartbeat_front_addr': '172.21.15.12:6813/2997410357', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '26db6fe3-81d0-40ae-a4e1-9a7460fabc2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 44, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6816', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6817', 'nonce': 852655937}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6818', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6819', 'nonce': 852655937}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6822', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6823', 'nonce': 852655937}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6820', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6821', 'nonce': 852655937}]}, 'public_addr': '172.21.15.12:6817/852655937', 'cluster_addr': '172.21.15.12:6819/852655937', 'heartbeat_back_addr': '172.21.15.12:6823/852655937', 'heartbeat_front_addr': '172.21.15.12:6821/852655937', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '00ff2990-a7cb-48a2-ab03-6739942d65d7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6824', 'nonce': 3485488459}, {'type': 'v1', 'addr': '172.21.15.12:6825', 'nonce': 3485488459}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6826', 'nonce': 3485488459}, {'type': 'v1', 'addr': '172.21.15.12:6827', 'nonce': 3485488459}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6830', 'nonce': 3485488459}, {'type': 'v1', 'addr': '172.21.15.12:6831', 'nonce': 3485488459}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6828', 'nonce': 3485488459}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 3485488459}]}, 'public_addr': '172.21.15.12:6825/3485488459', 'cluster_addr': '172.21.15.12:6827/3485488459', 'heartbeat_back_addr': '172.21.15.12:6831/3485488459', 'heartbeat_front_addr': '172.21.15.12:6829/3485488459', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'd1c858fd-7b66-4e1b-aa18-e3fd567e1417', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6800', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6801', 'nonce': 2211289880}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6802', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6803', 'nonce': 2211289880}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6806', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6807', 'nonce': 2211289880}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6804', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6805', 'nonce': 2211289880}]}, 'public_addr': '172.21.15.12:6801/2211289880', 'cluster_addr': '172.21.15.12:6803/2211289880', 'heartbeat_back_addr': '172.21.15.12:6807/2211289880', 'heartbeat_front_addr': '172.21.15.12:6805/2211289880', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '586534a4-d5e3-4af4-a2e5-aa4ec052b582', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 37, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 1639325236}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 1639325236}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 1639325236}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 1639325236}]}, 'public_addr': '172.21.15.153:6801/1639325236', 'cluster_addr': '172.21.15.153:6803/1639325236', 'heartbeat_back_addr': '172.21.15.153:6807/1639325236', 'heartbeat_front_addr': '172.21.15.153:6805/1639325236', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '801041dc-7a4c-4776-bfbb-68be37655407', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6816', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6817', 'nonce': 2370940838}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6818', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6819', 'nonce': 2370940838}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6822', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6823', 'nonce': 2370940838}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6820', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6821', 'nonce': 2370940838}]}, 'public_addr': '172.21.15.153:6817/2370940838', 'cluster_addr': '172.21.15.153:6819/2370940838', 'heartbeat_back_addr': '172.21.15.153:6823/2370940838', 'heartbeat_front_addr': '172.21.15.153:6821/2370940838', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e0820ac1-b43f-486f-9d7b-155b46b33950', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6826', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6827', 'nonce': 1798055911}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6828', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6829', 'nonce': 1798055911}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 1798055911}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6830', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6831', 'nonce': 1798055911}]}, 'public_addr': '172.21.15.153:6827/1798055911', 'cluster_addr': '172.21.15.153:6829/1798055911', 'heartbeat_back_addr': '172.21.15.153:6833/1798055911', 'heartbeat_front_addr': '172.21.15.153:6831/1798055911', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e22fdfda-9a13-42f2-be4f-f7c6e0ffd324', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 37, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6808', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6809', 'nonce': 1122624549}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6810', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6811', 'nonce': 1122624549}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6814', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6815', 'nonce': 1122624549}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6812', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6813', 'nonce': 1122624549}]}, 'public_addr': '172.21.15.153:6809/1122624549', 'cluster_addr': '172.21.15.153:6811/1122624549', 'heartbeat_back_addr': '172.21.15.153:6815/1122624549', 'heartbeat_front_addr': '172.21.15.153:6813/1122624549', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.912439+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.788769+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.857319+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.926699+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.752975+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.222079+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.095040+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.860946+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:22:17.949 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:22:17.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:17.989 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:17.989+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:18.053 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:18.053+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:18.091 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:18.092 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:18.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:18.184 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:18.184+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:18.245 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.245 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.647603089, 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:18.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:18.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:18.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.647375593, 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:18.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.647120779000002, 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:18.254 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:18.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.646751884, 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.646590337999999, 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.646147602999999, 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.64400071, 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.641970157999999, 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.641949773, 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.424765967999999, 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.424744944, 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.424720689000001, 2024-09-11T05:22:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.423041605000002, 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.423022259, 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.423001487000001, 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.422982077, 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.422961608000001, 2024-09-11T05:22:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.422942718000002, 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.413604925000001, 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.413594099000001, 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:18.346 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:22:18.349 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:22:18.350 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:18.351 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-09-11T05:22:17.573419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":355604685,"num_objects":1584,"num_object_clones":191,"num_object_copies":3168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1584,"num_whiteouts":1035,"num_read":81716,"num_read_kb":324290,"num_write":7990,"num_write_kb":147166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":6209323,"num_keys_recovered":25,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7278,"ondisk_log_size":7278,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":425012,"kb_used_data":149732,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754549708,"statfs":{"total":773094113280,"available":772658900992,"internally_reserved":0,"allocated":153325568,"data_stored":175232406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":276614707},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49412282,"num_objects":82,"num_object_clones":10,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":6,"num_read":7467,"num_read_kb":37486,"num_write":1238,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018534"},"pg_stats":[{"pgid":"3.1f","version":"51'259","reported_seq":773,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566634+0000","last_change":"2024-09-11T05:21:44.414639+0000","last_active":"2024-09-11T05:22:16.566634+0000","last_peered":"2024-09-11T05:22:16.566634+0000","last_clean":"2024-09-11T05:22:16.566634+0000","last_became_active":"2024-09-11T05:21:42.406554+0000","last_became_peered":"2024-09-11T05:21:42.406554+0000","last_unstale":"2024-09-11T05:22:16.566634+0000","last_undegraded":"2024-09-11T05:22:16.566634+0000","last_fullsized":"2024-09-11T05:22:16.566634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:12:05.223815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":9812638,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":33,"num_read":1289,"num_read_kb":5979,"num_write":276,"num_write_kb":3407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"52'296","reported_seq":4253,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.609917+0000","last_change":"2024-09-11T05:22:10.532372+0000","last_active":"2024-09-11T05:22:16.609917+0000","last_peered":"2024-09-11T05:22:16.609917+0000","last_clean":"2024-09-11T05:22:16.609917+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:22:16.609917+0000","last_undegraded":"2024-09-11T05:22:16.609917+0000","last_fullsized":"2024-09-11T05:22:16.609917+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:28.574760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088924100000000003,"stat_sum":{"num_bytes":9990676,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":5066,"num_read_kb":12381,"num_write":353,"num_write_kb":5429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"51'163","reported_seq":558,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.565831+0000","last_change":"2024-09-11T05:21:44.407846+0000","last_active":"2024-09-11T05:22:16.565831+0000","last_peered":"2024-09-11T05:22:16.565831+0000","last_clean":"2024-09-11T05:22:16.565831+0000","last_became_active":"2024-09-11T05:21:42.409235+0000","last_became_peered":"2024-09-11T05:21:42.409235+0000","last_unstale":"2024-09-11T05:22:16.565831+0000","last_undegraded":"2024-09-11T05:22:16.565831+0000","last_fullsized":"2024-09-11T05:22:16.565831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:58:29.785765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092628299999999997,"stat_sum":{"num_bytes":5243693,"num_objects":49,"num_object_clones":6,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":33,"num_read":666,"num_read_kb":6889,"num_write":128,"num_write_kb":2699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"52'150","reported_seq":813,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.587795+0000","last_change":"2024-09-11T05:21:44.407664+0000","last_active":"2024-09-11T05:22:16.587795+0000","last_peered":"2024-09-11T05:22:16.587795+0000","last_clean":"2024-09-11T05:22:16.587795+0000","last_became_active":"2024-09-11T05:21:42.409898+0000","last_became_peered":"2024-09-11T05:21:42.409898+0000","last_unstale":"2024-09-11T05:22:16.587795+0000","last_undegraded":"2024-09-11T05:22:16.587795+0000","last_fullsized":"2024-09-11T05:22:16.587795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.023660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079224700000000005,"stat_sum":{"num_bytes":9778477,"num_objects":52,"num_object_clones":10,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":30,"num_read":672,"num_read_kb":7422,"num_write":118,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"51'395","reported_seq":646,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566590+0000","last_change":"2024-09-11T05:21:44.413749+0000","last_active":"2024-09-11T05:22:16.566590+0000","last_peered":"2024-09-11T05:22:16.566590+0000","last_clean":"2024-09-11T05:22:16.566590+0000","last_became_active":"2024-09-11T05:21:42.405999+0000","last_became_peered":"2024-09-11T05:21:42.405999+0000","last_unstale":"2024-09-11T05:22:16.566590+0000","last_undegraded":"2024-09-11T05:22:16.566590+0000","last_fullsized":"2024-09-11T05:22:16.566590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:22.844667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043492599999999998,"stat_sum":{"num_bytes":6337972,"num_objects":51,"num_object_clones":7,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":35,"num_read":1454,"num_read_kb":3693,"num_write":527,"num_write_kb":7231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"51'107","reported_seq":1541,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.612480+0000","last_change":"2024-09-11T05:21:44.401184+0000","last_active":"2024-09-11T05:22:16.612480+0000","last_peered":"2024-09-11T05:22:16.612480+0000","last_clean":"2024-09-11T05:22:16.612480+0000","last_became_active":"2024-09-11T05:21:42.401396+0000","last_became_peered":"2024-09-11T05:21:42.401396+0000","last_unstale":"2024-09-11T05:22:16.612480+0000","last_undegraded":"2024-09-11T05:22:16.612480+0000","last_fullsized":"2024-09-11T05:22:16.612480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:39.334053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040292300000000002,"stat_sum":{"num_bytes":7558699,"num_objects":36,"num_object_clones":2,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":23,"num_read":1385,"num_read_kb":13776,"num_write":95,"num_write_kb":7105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"51'132","reported_seq":420,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.573480+0000","last_change":"2024-09-11T05:21:44.408025+0000","last_active":"2024-09-11T05:22:16.573480+0000","last_peered":"2024-09-11T05:22:16.573480+0000","last_clean":"2024-09-11T05:22:16.573480+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:22:16.573480+0000","last_undegraded":"2024-09-11T05:22:16.573480+0000","last_fullsized":"2024-09-11T05:22:16.573480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:53:00.418804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044428399999999998,"stat_sum":{"num_bytes":8629454,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":30,"num_read":250,"num_read_kb":2791,"num_write":105,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"51'541","reported_seq":10256,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566006+0000","last_change":"2024-09-11T05:21:44.401412+0000","last_active":"2024-09-11T05:22:16.566006+0000","last_peered":"2024-09-11T05:22:16.566006+0000","last_clean":"2024-09-11T05:22:16.566006+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:22:16.566006+0000","last_undegraded":"2024-09-11T05:22:16.566006+0000","last_fullsized":"2024-09-11T05:22:16.566006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:24.073617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057561999999999999,"stat_sum":{"num_bytes":29233726,"num_objects":55,"num_object_clones":6,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":34,"num_read":12272,"num_read_kb":29748,"num_write":791,"num_write_kb":13421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"51'157","reported_seq":724,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566798+0000","last_change":"2024-09-11T05:21:44.414343+0000","last_active":"2024-09-11T05:22:16.566798+0000","last_peered":"2024-09-11T05:22:16.566798+0000","last_clean":"2024-09-11T05:22:16.566798+0000","last_became_active":"2024-09-11T05:21:42.406417+0000","last_became_peered":"2024-09-11T05:21:42.406417+0000","last_unstale":"2024-09-11T05:22:16.566798+0000","last_undegraded":"2024-09-11T05:22:16.566798+0000","last_fullsized":"2024-09-11T05:22:16.566798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:45.170104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086609600000000001,"stat_sum":{"num_bytes":6982692,"num_objects":59,"num_object_clones":8,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":42,"num_read":548,"num_read_kb":10491,"num_write":111,"num_write_kb":3224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"51'283","reported_seq":9457,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.565870+0000","last_change":"2024-09-11T05:21:44.407892+0000","last_active":"2024-09-11T05:22:16.565870+0000","last_peered":"2024-09-11T05:22:16.565870+0000","last_clean":"2024-09-11T05:22:16.565870+0000","last_became_active":"2024-09-11T05:21:42.409390+0000","last_became_peered":"2024-09-11T05:21:42.409390+0000","last_unstale":"2024-09-11T05:22:16.565870+0000","last_undegraded":"2024-09-11T05:22:16.565870+0000","last_fullsized":"2024-09-11T05:22:16.565870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:34:45.583374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091703900000000003,"stat_sum":{"num_bytes":14722752,"num_objects":52,"num_object_clones":5,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":32,"num_read":9889,"num_read_kb":19899,"num_write":402,"num_write_kb":12465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'243","reported_seq":2073,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571564+0000","last_change":"2024-09-11T05:21:44.421929+0000","last_active":"2024-09-11T05:22:16.571564+0000","last_peered":"2024-09-11T05:22:16.571564+0000","last_clean":"2024-09-11T05:22:16.571564+0000","last_became_active":"2024-09-11T05:21:42.407646+0000","last_became_peered":"2024-09-11T05:21:42.407646+0000","last_unstale":"2024-09-11T05:22:16.571564+0000","last_undegraded":"2024-09-11T05:22:16.571564+0000","last_fullsized":"2024-09-11T05:22:16.571564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:24.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000573162,"stat_sum":{"num_bytes":12398908,"num_objects":47,"num_object_clones":3,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":34,"num_read":2922,"num_read_kb":17838,"num_write":213,"num_write_kb":4781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"51'285","reported_seq":3050,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.568563+0000","last_change":"2024-09-11T05:21:44.401201+0000","last_active":"2024-09-11T05:22:16.568563+0000","last_peered":"2024-09-11T05:22:16.568563+0000","last_clean":"2024-09-11T05:22:16.568563+0000","last_became_active":"2024-09-11T05:21:42.403581+0000","last_became_peered":"2024-09-11T05:21:42.403581+0000","last_unstale":"2024-09-11T05:22:16.568563+0000","last_undegraded":"2024-09-11T05:22:16.568563+0000","last_fullsized":"2024-09-11T05:22:16.568563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:57.881872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038850000000000001,"stat_sum":{"num_bytes":9371443,"num_objects":56,"num_object_clones":5,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":36,"num_read":3476,"num_read_kb":12784,"num_write":361,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.598648+0000","last_change":"2024-09-11T05:22:07.486593+0000","last_active":"2024-09-11T05:22:16.598648+0000","last_peered":"2024-09-11T05:22:16.598648+0000","last_clean":"2024-09-11T05:22:16.598648+0000","last_became_active":"2024-09-11T05:22:07.486289+0000","last_became_peered":"2024-09-11T05:22:07.486289+0000","last_unstale":"2024-09-11T05:22:16.598648+0000","last_undegraded":"2024-09-11T05:22:16.598648+0000","last_fullsized":"2024-09-11T05:22:16.598648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:21.262736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"51'230","reported_seq":5023,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566588+0000","last_change":"2024-09-11T05:21:44.414120+0000","last_active":"2024-09-11T05:22:16.566588+0000","last_peered":"2024-09-11T05:22:16.566588+0000","last_clean":"2024-09-11T05:22:16.566588+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:22:16.566588+0000","last_undegraded":"2024-09-11T05:22:16.566588+0000","last_fullsized":"2024-09-11T05:22:16.566588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:24.165782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072398000000000004,"stat_sum":{"num_bytes":8279276,"num_objects":53,"num_object_clones":4,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":36,"num_read":6098,"num_read_kb":8416,"num_write":187,"num_write_kb":3385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.573562+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:22:16.573562+0000","last_peered":"2024-09-11T05:22:16.573562+0000","last_clean":"2024-09-11T05:22:16.573562+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:22:16.573562+0000","last_undegraded":"2024-09-11T05:22:16.573562+0000","last_fullsized":"2024-09-11T05:22:16.573562+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"51'141","reported_seq":970,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566167+0000","last_change":"2024-09-11T05:21:44.402105+0000","last_active":"2024-09-11T05:22:16.566167+0000","last_peered":"2024-09-11T05:22:16.566167+0000","last_clean":"2024-09-11T05:22:16.566167+0000","last_became_active":"2024-09-11T05:21:42.402501+0000","last_became_peered":"2024-09-11T05:21:42.402501+0000","last_unstale":"2024-09-11T05:22:16.566167+0000","last_undegraded":"2024-09-11T05:22:16.566167+0000","last_fullsized":"2024-09-11T05:22:16.566167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:10:20.103834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096440299999999996,"stat_sum":{"num_bytes":7200883,"num_objects":47,"num_object_clones":6,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":34,"num_read":797,"num_read_kb":9340,"num_write":119,"num_write_kb":6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571700+0000","last_change":"2024-09-11T05:21:34.788134+0000","last_active":"2024-09-11T05:22:16.571700+0000","last_peered":"2024-09-11T05:22:16.571700+0000","last_clean":"2024-09-11T05:22:16.571700+0000","last_became_active":"2024-09-11T05:21:32.795062+0000","last_became_peered":"2024-09-11T05:21:32.795062+0000","last_unstale":"2024-09-11T05:22:16.571700+0000","last_undegraded":"2024-09-11T05:22:16.571700+0000","last_fullsized":"2024-09-11T05:22:16.571700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:34.218237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040346199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"51'166","reported_seq":555,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.573491+0000","last_change":"2024-09-11T05:21:44.408292+0000","last_active":"2024-09-11T05:22:16.573491+0000","last_peered":"2024-09-11T05:22:16.573491+0000","last_clean":"2024-09-11T05:22:16.573491+0000","last_became_active":"2024-09-11T05:21:42.400709+0000","last_became_peered":"2024-09-11T05:21:42.400709+0000","last_unstale":"2024-09-11T05:22:16.573491+0000","last_undegraded":"2024-09-11T05:22:16.573491+0000","last_fullsized":"2024-09-11T05:22:16.573491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:56.330204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063614100000000001,"stat_sum":{"num_bytes":12511801,"num_objects":58,"num_object_clones":5,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":38,"num_read":358,"num_read_kb":8271,"num_write":126,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.573436+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:22:16.573436+0000","last_peered":"2024-09-11T05:22:16.573436+0000","last_clean":"2024-09-11T05:22:16.573436+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:22:16.573436+0000","last_undegraded":"2024-09-11T05:22:16.573436+0000","last_fullsized":"2024-09-11T05:22:16.573436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"51'125","reported_seq":356,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.565861+0000","last_change":"2024-09-11T05:21:44.408084+0000","last_active":"2024-09-11T05:22:16.565861+0000","last_peered":"2024-09-11T05:22:16.565861+0000","last_clean":"2024-09-11T05:22:16.565861+0000","last_became_active":"2024-09-11T05:21:42.409551+0000","last_became_peered":"2024-09-11T05:21:42.409551+0000","last_unstale":"2024-09-11T05:22:16.565861+0000","last_undegraded":"2024-09-11T05:22:16.565861+0000","last_fullsized":"2024-09-11T05:22:16.565861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:14:18.650596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010121850000000001,"stat_sum":{"num_bytes":2570254,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":24,"num_read":201,"num_read_kb":1847,"num_write":102,"num_write_kb":1089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"51'181","reported_seq":9749,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.568598+0000","last_change":"2024-09-11T05:21:44.401419+0000","last_active":"2024-09-11T05:22:16.568598+0000","last_peered":"2024-09-11T05:22:16.568598+0000","last_clean":"2024-09-11T05:22:16.568598+0000","last_became_active":"2024-09-11T05:21:42.406357+0000","last_became_peered":"2024-09-11T05:21:42.406357+0000","last_unstale":"2024-09-11T05:22:16.568598+0000","last_undegraded":"2024-09-11T05:22:16.568598+0000","last_fullsized":"2024-09-11T05:22:16.568598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:59:16.122991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052854099999999999,"stat_sum":{"num_bytes":16414239,"num_objects":47,"num_object_clones":6,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":28,"num_read":10076,"num_read_kb":26926,"num_write":165,"num_write_kb":18206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":83,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.565656+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:22:16.565656+0000","last_peered":"2024-09-11T05:22:16.565656+0000","last_clean":"2024-09-11T05:22:16.565656+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:22:16.565656+0000","last_undegraded":"2024-09-11T05:22:16.565656+0000","last_fullsized":"2024-09-11T05:22:16.565656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"52'138","reported_seq":1336,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.592572+0000","last_change":"2024-09-11T05:21:44.408045+0000","last_active":"2024-09-11T05:22:16.592572+0000","last_peered":"2024-09-11T05:22:16.592572+0000","last_clean":"2024-09-11T05:22:16.592572+0000","last_became_active":"2024-09-11T05:21:42.401712+0000","last_became_peered":"2024-09-11T05:21:42.401712+0000","last_unstale":"2024-09-11T05:22:16.592572+0000","last_undegraded":"2024-09-11T05:22:16.592572+0000","last_fullsized":"2024-09-11T05:22:16.592572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:03.427363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048753400000000003,"stat_sum":{"num_bytes":5521499,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":28,"num_read":1678,"num_read_kb":15722,"num_write":108,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.570258+0000","last_change":"2024-09-11T05:21:34.806216+0000","last_active":"2024-09-11T05:22:16.570258+0000","last_peered":"2024-09-11T05:22:16.570258+0000","last_clean":"2024-09-11T05:22:16.570258+0000","last_became_active":"2024-09-11T05:21:32.771398+0000","last_became_peered":"2024-09-11T05:21:32.771398+0000","last_unstale":"2024-09-11T05:22:16.570258+0000","last_undegraded":"2024-09-11T05:22:16.570258+0000","last_fullsized":"2024-09-11T05:22:16.570258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:02.081911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048853500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"51'165","reported_seq":5262,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566457+0000","last_change":"2024-09-11T05:21:44.413732+0000","last_active":"2024-09-11T05:22:16.566457+0000","last_peered":"2024-09-11T05:22:16.566457+0000","last_clean":"2024-09-11T05:22:16.566457+0000","last_became_active":"2024-09-11T05:21:42.404070+0000","last_became_peered":"2024-09-11T05:21:42.404070+0000","last_unstale":"2024-09-11T05:22:16.566457+0000","last_undegraded":"2024-09-11T05:22:16.566457+0000","last_fullsized":"2024-09-11T05:22:16.566457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:07.234185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046737900000000003,"stat_sum":{"num_bytes":18062568,"num_objects":49,"num_object_clones":6,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":29,"num_read":5070,"num_read_kb":16423,"num_write":164,"num_write_kb":3764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571422+0000","last_change":"2024-09-11T05:21:34.788135+0000","last_active":"2024-09-11T05:22:16.571422+0000","last_peered":"2024-09-11T05:22:16.571422+0000","last_clean":"2024-09-11T05:22:16.571422+0000","last_became_active":"2024-09-11T05:21:32.777217+0000","last_became_peered":"2024-09-11T05:21:32.777217+0000","last_unstale":"2024-09-11T05:22:16.571422+0000","last_undegraded":"2024-09-11T05:22:16.571422+0000","last_fullsized":"2024-09-11T05:22:16.571422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:35.634621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041021100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"50'464","reported_seq":1376,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.565943+0000","last_change":"2024-09-11T05:21:44.401106+0000","last_active":"2024-09-11T05:22:16.565943+0000","last_peered":"2024-09-11T05:22:16.565943+0000","last_clean":"2024-09-11T05:22:16.565943+0000","last_became_active":"2024-09-11T05:21:42.405781+0000","last_became_peered":"2024-09-11T05:21:42.405781+0000","last_unstale":"2024-09-11T05:22:16.565943+0000","last_undegraded":"2024-09-11T05:22:16.565943+0000","last_fullsized":"2024-09-11T05:22:16.565943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:39.521151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045945300000000002,"stat_sum":{"num_bytes":14503396,"num_objects":63,"num_object_clones":7,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":39,"num_read":3011,"num_read_kb":8458,"num_write":649,"num_write_kb":2414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":82,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.565674+0000","last_change":"2024-09-11T05:21:34.793369+0000","last_active":"2024-09-11T05:22:16.565674+0000","last_peered":"2024-09-11T05:22:16.565674+0000","last_clean":"2024-09-11T05:22:16.565674+0000","last_became_active":"2024-09-11T05:21:32.774180+0000","last_became_peered":"2024-09-11T05:21:32.774180+0000","last_unstale":"2024-09-11T05:22:16.565674+0000","last_undegraded":"2024-09-11T05:22:16.565674+0000","last_fullsized":"2024-09-11T05:22:16.565674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:58.794390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":232,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571427+0000","last_change":"2024-09-11T05:21:28.808943+0000","last_active":"2024-09-11T05:22:16.571427+0000","last_peered":"2024-09-11T05:22:16.571427+0000","last_clean":"2024-09-11T05:22:16.571427+0000","last_became_active":"2024-09-11T05:21:28.807969+0000","last_became_peered":"2024-09-11T05:21:28.807969+0000","last_unstale":"2024-09-11T05:22:16.571427+0000","last_undegraded":"2024-09-11T05:22:16.571427+0000","last_fullsized":"2024-09-11T05:22:16.571427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:25.945103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"52'142","reported_seq":961,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.603139+0000","last_change":"2024-09-11T05:21:44.401787+0000","last_active":"2024-09-11T05:22:16.603139+0000","last_peered":"2024-09-11T05:22:16.603139+0000","last_clean":"2024-09-11T05:22:16.603139+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:22:16.603139+0000","last_undegraded":"2024-09-11T05:22:16.603139+0000","last_fullsized":"2024-09-11T05:22:16.603139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:45.341663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090839399999999998,"stat_sum":{"num_bytes":18754389,"num_objects":53,"num_object_clones":6,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":32,"num_read":821,"num_read_kb":8025,"num_write":115,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'181","reported_seq":520,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.617230+0000","last_change":"2024-09-11T05:21:44.401447+0000","last_active":"2024-09-11T05:22:16.617230+0000","last_peered":"2024-09-11T05:22:16.617230+0000","last_clean":"2024-09-11T05:22:16.617230+0000","last_became_active":"2024-09-11T05:21:42.398937+0000","last_became_peered":"2024-09-11T05:21:42.398937+0000","last_unstale":"2024-09-11T05:22:16.617230+0000","last_undegraded":"2024-09-11T05:22:16.617230+0000","last_fullsized":"2024-09-11T05:22:16.617230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:42.578861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066803499999999998,"stat_sum":{"num_bytes":12665737,"num_objects":48,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":34,"num_read":616,"num_read_kb":919,"num_write":162,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"52'201","reported_seq":738,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.598745+0000","last_change":"2024-09-11T05:22:10.532638+0000","last_active":"2024-09-11T05:22:16.598745+0000","last_peered":"2024-09-11T05:22:16.598745+0000","last_clean":"2024-09-11T05:22:16.598745+0000","last_became_active":"2024-09-11T05:22:10.531976+0000","last_became_peered":"2024-09-11T05:22:10.531976+0000","last_unstale":"2024-09-11T05:22:16.598745+0000","last_undegraded":"2024-09-11T05:22:16.598745+0000","last_fullsized":"2024-09-11T05:22:16.598745+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:55:04.328676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040601800000000001,"stat_sum":{"num_bytes":5241449,"num_objects":48,"num_object_clones":3,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":32,"num_read":758,"num_read_kb":2549,"num_write":173,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":1921005,"num_keys_recovered":13,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"51'281","reported_seq":1119,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566229+0000","last_change":"2024-09-11T05:21:44.401382+0000","last_active":"2024-09-11T05:22:16.566229+0000","last_peered":"2024-09-11T05:22:16.566229+0000","last_clean":"2024-09-11T05:22:16.566229+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:22:16.566229+0000","last_undegraded":"2024-09-11T05:22:16.566229+0000","last_fullsized":"2024-09-11T05:22:16.566229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:50.623696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056543499999999998,"stat_sum":{"num_bytes":19113498,"num_objects":68,"num_object_clones":11,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":46,"num_read":1696,"num_read_kb":6407,"num_write":291,"num_write_kb":2156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"51'133","reported_seq":284,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.565870+0000","last_change":"2024-09-11T05:21:44.407640+0000","last_active":"2024-09-11T05:22:16.565870+0000","last_peered":"2024-09-11T05:22:16.565870+0000","last_clean":"2024-09-11T05:22:16.565870+0000","last_became_active":"2024-09-11T05:21:42.410098+0000","last_became_peered":"2024-09-11T05:21:42.410098+0000","last_unstale":"2024-09-11T05:22:16.565870+0000","last_undegraded":"2024-09-11T05:22:16.565870+0000","last_fullsized":"2024-09-11T05:22:16.565870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:40:06.297434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076052300000000004,"stat_sum":{"num_bytes":1374208,"num_objects":28,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":21,"num_read":104,"num_read_kb":1343,"num_write":110,"num_write_kb":1995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"51'238","reported_seq":2245,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571621+0000","last_change":"2024-09-11T05:21:44.421806+0000","last_active":"2024-09-11T05:22:16.571621+0000","last_peered":"2024-09-11T05:22:16.571621+0000","last_clean":"2024-09-11T05:22:16.571621+0000","last_became_active":"2024-09-11T05:21:42.406644+0000","last_became_peered":"2024-09-11T05:21:42.406644+0000","last_unstale":"2024-09-11T05:22:16.571621+0000","last_undegraded":"2024-09-11T05:22:16.571621+0000","last_fullsized":"2024-09-11T05:22:16.571621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:40.265451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046441899999999999,"stat_sum":{"num_bytes":18051660,"num_objects":48,"num_object_clones":4,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":31,"num_read":3207,"num_read_kb":30101,"num_write":239,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"52'242","reported_seq":537,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571862+0000","last_change":"2024-09-11T05:21:44.422290+0000","last_active":"2024-09-11T05:22:16.571862+0000","last_peered":"2024-09-11T05:22:16.571862+0000","last_clean":"2024-09-11T05:22:16.571862+0000","last_became_active":"2024-09-11T05:21:42.406332+0000","last_became_peered":"2024-09-11T05:21:42.406332+0000","last_unstale":"2024-09-11T05:22:16.571862+0000","last_undegraded":"2024-09-11T05:22:16.571862+0000","last_fullsized":"2024-09-11T05:22:16.571862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:01.169337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090744000000000003,"stat_sum":{"num_bytes":5624249,"num_objects":39,"num_object_clones":7,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":23,"num_read":806,"num_read_kb":4365,"num_write":295,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"51'393","reported_seq":565,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571605+0000","last_change":"2024-09-11T05:21:44.422354+0000","last_active":"2024-09-11T05:22:16.571605+0000","last_peered":"2024-09-11T05:22:16.571605+0000","last_clean":"2024-09-11T05:22:16.571605+0000","last_became_active":"2024-09-11T05:21:42.406249+0000","last_became_peered":"2024-09-11T05:21:42.406249+0000","last_unstale":"2024-09-11T05:22:16.571605+0000","last_undegraded":"2024-09-11T05:22:16.571605+0000","last_fullsized":"2024-09-11T05:22:16.571605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:20.044702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093409400000000001,"stat_sum":{"num_bytes":5814575,"num_objects":47,"num_object_clones":4,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":32,"num_read":1485,"num_read_kb":3243,"num_write":568,"num_write_kb":1981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"48'144","reported_seq":507,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.598663+0000","last_change":"2024-09-11T05:22:10.534718+0000","last_active":"2024-09-11T05:22:16.598663+0000","last_peered":"2024-09-11T05:22:16.598663+0000","last_clean":"2024-09-11T05:22:16.598663+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:22:16.598663+0000","last_undegraded":"2024-09-11T05:22:16.598663+0000","last_fullsized":"2024-09-11T05:22:16.598663+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:23.982466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040001499999999998,"stat_sum":{"num_bytes":3485310,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":37,"num_read":255,"num_read_kb":3046,"num_write":105,"num_write_kb":1239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"51'131","reported_seq":295,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571516+0000","last_change":"2024-09-11T05:21:44.421583+0000","last_active":"2024-09-11T05:22:16.571516+0000","last_peered":"2024-09-11T05:22:16.571516+0000","last_clean":"2024-09-11T05:22:16.571516+0000","last_became_active":"2024-09-11T05:21:42.408802+0000","last_became_peered":"2024-09-11T05:21:42.408802+0000","last_unstale":"2024-09-11T05:22:16.571516+0000","last_undegraded":"2024-09-11T05:22:16.571516+0000","last_fullsized":"2024-09-11T05:22:16.571516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:56:49.086138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034348499999999998,"stat_sum":{"num_bytes":16862411,"num_objects":39,"num_object_clones":6,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":28,"num_read":121,"num_read_kb":1762,"num_write":106,"num_write_kb":1818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"51'244","reported_seq":3735,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.566255+0000","last_change":"2024-09-11T05:21:44.414108+0000","last_active":"2024-09-11T05:22:16.566255+0000","last_peered":"2024-09-11T05:22:16.566255+0000","last_clean":"2024-09-11T05:22:16.566255+0000","last_became_active":"2024-09-11T05:21:42.402840+0000","last_became_peered":"2024-09-11T05:21:42.402840+0000","last_unstale":"2024-09-11T05:22:16.566255+0000","last_undegraded":"2024-09-11T05:22:16.566255+0000","last_fullsized":"2024-09-11T05:22:16.566255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:06.125190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066949499999999999,"stat_sum":{"num_bytes":19410719,"num_objects":57,"num_object_clones":14,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":35,"num_read":3910,"num_read_kb":17332,"num_write":274,"num_write_kb":7502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"51'207","reported_seq":599,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-11T05:22:16.571685+0000","last_change":"2024-09-11T05:21:44.421671+0000","last_active":"2024-09-11T05:22:16.571685+0000","last_peered":"2024-09-11T05:22:16.571685+0000","last_clean":"2024-09-11T05:22:16.571685+0000","last_became_active":"2024-09-11T05:21:42.406510+0000","last_became_peered":"2024-09-11T05:21:42.406510+0000","last_unstale":"2024-09-11T05:22:16.571685+0000","last_undegraded":"2024-09-11T05:22:16.571685+0000","last_fullsized":"2024-09-11T05:22:16.571685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:46:05.126994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038513700000000002,"stat_sum":{"num_bytes":13491047,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":39,"num_read":643,"num_read_kb":6004,"num_write":291,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":355014298,"num_objects":1580,"num_object_clones":191,"num_object_copies":3160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1580,"num_whiteouts":1035,"num_read":81600,"num_read_kb":324190,"num_write":7829,"num_write_kb":144748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":6209323,"num_keys_recovered":25,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147742720,"data_stored":172258084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7158,"ondisk_log_size":7158,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61544,"kb_used_data":26196,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94310296,"statfs":{"total":96636764160,"available":96573743104,"internally_reserved":0,"allocated":26824704,"data_stored":28927263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35208,"kb_used_data":4012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336632,"statfs":{"total":96636764160,"available":96600711168,"internally_reserved":0,"allocated":4108288,"data_stored":5282215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57576,"kb_used_data":22228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314264,"statfs":{"total":96636764160,"available":96577806336,"internally_reserved":0,"allocated":22761472,"data_stored":28637758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64800,"kb_used_data":29452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307040,"statfs":{"total":96636764160,"available":96570408960,"internally_reserved":0,"allocated":30158848,"data_stored":33348488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54932,"kb_used_data":19576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94316908,"statfs":{"total":96636764160,"available":96580513792,"internally_reserved":0,"allocated":20045824,"data_stored":22135880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":5816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":5955584,"data_stored":6924459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43064,"kb_used_data":11876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328776,"statfs":{"total":96636764160,"available":96592666624,"internally_reserved":0,"allocated":12161024,"data_stored":13789392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70884,"kb_used_data":30576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94300956,"statfs":{"total":96636764160,"available":96564178944,"internally_reserved":0,"allocated":31309824,"data_stored":36186951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30199808,"data_stored":35405419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11636736,"data_stored":13586115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5402624,"data_stored":6688454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19505152,"data_stored":21917740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29646848,"data_stored":33156039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22196224,"data_stored":28403406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3522560,"data_stored":5026187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25632768,"data_stored":28074724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:22:18.354 INFO:tasks.thrashosds.thrasher:Setting 2.5 to [3, 6] 2024-09-11T05:22:18.354 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.5', '3', '6'] 2024-09-11T05:22:18.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.5 3 6 2024-09-11T05:22:18.354 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:18.347+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:18.449 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:18.449+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:18.449 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:18.493 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:18.493 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:18.502 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:18.549 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:18.549+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:18.582 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:18.603 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:18.603 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:18.609 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:18.609 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:18.609 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:18.609 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:18.609 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:18.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:18.622 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:18.641 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:18.641 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:18.660 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:18.660 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:18.662 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:18.662+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:18.676 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-11T05:22:18.678 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:18.678 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:18.695 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:18.696 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:18.713 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:18.713 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:18.727 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:18.728 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:18.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:18.777 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:18.777+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:18.853 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:18.853+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:18.881 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:18.881 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:18.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:18.905 INFO:teuthology.orchestra.run.smithi012.stdout:2349 write 0xb7c5c2b thru 0xb7cd5bd (0x7993 bytes) 2024-09-11T05:22:18.908 INFO:teuthology.orchestra.run.smithi012.stdout:2350 read 0xaf1cf9b thru 0xaf20d21 (0x3d87 bytes) 2024-09-11T05:22:18.908 INFO:teuthology.orchestra.run.smithi012.stdout:2351 write 0x288787 thru 0x28cd3a (0x45b4 bytes) 2024-09-11T05:22:18.922 INFO:teuthology.orchestra.run.smithi012.stdout:2353 write 0xd7d9812 thru 0xd7ddda8 (0x4597 bytes) 2024-09-11T05:22:18.924 INFO:teuthology.orchestra.run.smithi012.stdout:2354 write 0x8d2a1f8 thru 0x8d2f3cc (0x51d5 bytes) 2024-09-11T05:22:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:2355 punch from 0x827a4f2 to 0x8288ccb, (0xe7d9 bytes) 2024-09-11T05:22:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:2356 read 0xc8c4481 thru 0xc8d247c (0xdffc bytes) 2024-09-11T05:22:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:18.930 INFO:teuthology.orchestra.run.smithi012.stdout:2358 trunc from 0xd7ddda9 to 0xb428d39 2024-09-11T05:22:18.940 INFO:teuthology.orchestra.run.smithi012.stdout:2359 write 0x34a5f6 thru 0x35837e (0xdd89 bytes) 2024-09-11T05:22:18.944 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:18.944 INFO:teuthology.orchestra.run.smithi012.stdout:2363 write 0x64c4834 thru 0x64c8a19 (0x41e6 bytes) 2024-09-11T05:22:18.949 INFO:teuthology.orchestra.run.smithi012.stdout:2365 read 0x26321be thru 0x263720d (0x5050 bytes) 2024-09-11T05:22:18.949 INFO:teuthology.orchestra.run.smithi012.stdout:2366 read 0x776f73e thru 0x777067f (0xf42 bytes) 2024-09-11T05:22:18.949 INFO:teuthology.orchestra.run.smithi012.stdout:2367 write 0x4d114a6 thru 0x4d1829f (0x6dfa bytes) 2024-09-11T05:22:18.952 INFO:teuthology.orchestra.run.smithi012.stdout:2368 read 0x54ea656 thru 0x54ee89e (0x4249 bytes) 2024-09-11T05:22:18.952 INFO:teuthology.orchestra.run.smithi012.stdout:2369 writesame 0x6d88c39 thru 0x6d95c0f data_size 0xb(0xcfd7 bytes) 2024-09-11T05:22:18.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:18.953+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:18.957 INFO:teuthology.orchestra.run.smithi012.stdout:2370 flatten 2024-09-11T05:22:18.969 INFO:teuthology.orchestra.run.smithi012.stdout:2371 read 0xb4628d thru 0xb5298f (0xc703 bytes) 2024-09-11T05:22:18.969 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:18.969 INFO:teuthology.orchestra.run.smithi012.stdout:2373 write 0x7cbb314 thru 0x7cc7c18 (0xc905 bytes) 2024-09-11T05:22:18.973 INFO:teuthology.orchestra.run.smithi012.stdout:2374 writesame 0x2165816 thru 0x2167c57 data_size 0x5b(0x2442 bytes) 2024-09-11T05:22:18.976 INFO:teuthology.orchestra.run.smithi012.stdout:2375 read 0xf81e0d thru 0xf85de7 (0x3fdb bytes) 2024-09-11T05:22:18.976 INFO:teuthology.orchestra.run.smithi012.stdout:2376 write 0x57d981 thru 0x58229a (0x491a bytes) 2024-09-11T05:22:18.979 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:18.980 INFO:teuthology.orchestra.run.smithi012.stdout:2379 write 0x58dc927 thru 0x58ea85d (0xdf37 bytes) 2024-09-11T05:22:18.984 INFO:teuthology.orchestra.run.smithi012.stdout:2380 trunc from 0xb428d39 to 0x9f7ffbb 2024-09-11T05:22:18.990 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:18.990 INFO:teuthology.orchestra.run.smithi012.stdout:2384 read 0x3802b6b thru 0x38113e4 (0xe87a bytes) 2024-09-11T05:22:18.990 INFO:teuthology.orchestra.run.smithi012.stdout:2386 write 0x50f78c8 thru 0x50fa82a (0x2f63 bytes) 2024-09-11T05:22:18.994 INFO:teuthology.orchestra.run.smithi012.stdout:2387 read 0x332c136 thru 0x3335faa (0x9e75 bytes) 2024-09-11T05:22:18.994 INFO:teuthology.orchestra.run.smithi012.stdout:2389 read 0x3fe80e0 thru 0x3fe9f47 (0x1e68 bytes) 2024-09-11T05:22:18.994 INFO:teuthology.orchestra.run.smithi012.stdout:2390 read 0x10bf040 thru 0x10ccdde (0xdd9f bytes) 2024-09-11T05:22:18.994 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:19.000 INFO:teuthology.orchestra.run.smithi012.stdout:2392 write 0xac376b1 thru 0xac3c1dd (0x4b2d bytes) 2024-09-11T05:22:19.013 INFO:teuthology.orchestra.run.smithi012.stdout:2393 write 0xd5e6632 thru 0xd5e9db8 (0x3787 bytes) 2024-09-11T05:22:19.015 INFO:teuthology.orchestra.run.smithi012.stdout:2397 read 0x856b581 thru 0x857a0b2 (0xeb32 bytes) 2024-09-11T05:22:19.015 INFO:teuthology.orchestra.run.smithi012.stdout:2398 write 0x6b86062 thru 0x6b88c1a (0x2bb9 bytes) 2024-09-11T05:22:19.025 INFO:teuthology.orchestra.run.smithi012.stdout:2400 trunc from 0xd5e9db9 to 0x7600173 2024-09-11T05:22:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:2401 read 0x3f0c06d thru 0x3f1a83d (0xe7d1 bytes) 2024-09-11T05:22:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:2403 read 0x32df432 thru 0x32e7f04 (0x8ad3 bytes) 2024-09-11T05:22:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:2406 read 0xc57611 thru 0xc60e7b (0x986b bytes) 2024-09-11T05:22:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:2407 punch from 0x6fe7756 to 0x6ff5ec4, (0xe76e bytes) 2024-09-11T05:22:19.037 INFO:teuthology.orchestra.run.smithi012.stdout:2408 trunc from 0x7600173 to 0x6140a06 2024-09-11T05:22:19.047 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:19.047 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:19.048 INFO:teuthology.orchestra.run.smithi012.stdout:2410 punch from 0x67ed4d to 0x680eb7, (0x216a bytes) 2024-09-11T05:22:19.049 INFO:teuthology.orchestra.run.smithi012.stdout:2411 trunc from 0x6140a06 to 0x760e8c8 2024-09-11T05:22:19.054 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:19.054+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:19.055 INFO:teuthology.orchestra.run.smithi012.stdout:2413 clone 20 order 23 su 262144 sc 12 2024-09-11T05:22:19.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:19.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:19.155+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:19.199 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:19.200 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:19.208 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:19.256 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:19.256+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:19.317 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:19.317 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:19.326 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:19.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:19.370+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:19.433 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:19.433 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:19.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:19.483 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:19.483+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:19.559 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:19.559+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:19.587 INFO:teuthology.orchestra.run.smithi012.stderr:set 2.5 pg_upmap mapping to [3,6] 2024-09-11T05:22:19.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:22:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:19.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:19.661 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:19.660+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:19.733 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-11T05:22:19.759 INFO:teuthology.orchestra.run.smithi012.stdout:2414 clone 21 order 20 su 262144 sc 14 2024-09-11T05:22:19.761 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:19.761+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:19.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:19.863 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:19.863+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:19.921 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:19.921 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:19.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:19.964 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:19.963+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:20.037 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:20.037 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:20.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:20.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:20.089+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:20.153 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:20.153 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:20.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:20.204 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:20.204+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:20.266 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:20.266+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:20.310 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:20.310 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:20.319 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:20.366 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:20.366+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:20.426 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:20.426 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:20.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:20.478 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:20.478+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:20.542 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:20.542 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:20.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:22:20.592 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:20.591+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:20.658 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone20 from 0x760e8c8 (overlap 0x760e8c8) to 0x236ac3c 2024-09-11T05:22:20.669 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:20.669+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:20.727 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:20.728 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:20.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:20.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:20.765 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-11T05:22:20.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:20.810+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:20.870 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:20.870 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:20.870 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:20.870+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:20.888 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:20.894 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:2415 trunc from 0x760e8c8 to 0xc2b7743 2024-09-11T05:22:20.905 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:20.905 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:2417 punch from 0x8489be8 to 0x849368e, (0x9aa6 bytes) 2024-09-11T05:22:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:2418 read 0xa2471e5 thru 0xa2506fe (0x951a bytes) 2024-09-11T05:22:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:2419 clone 22 order 23 su 65536 sc 12 2024-09-11T05:22:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:20.956 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:20.973 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:20.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:20.973+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:20.989 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:20.990 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:21.003 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:21.003 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:21.003 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:21.004 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:21.012 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:21.073 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:21.073+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:21.115 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:21.116 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:21.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:21.178 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:21.178+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:21.269 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:21.269 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:21.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:21.269 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:21.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.269 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36838 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.269 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.635153367000001, 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059077179, 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36838 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632956+0000", 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632957+0000", 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4999999999999998e-07 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632959+0000", 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1390000000000002e-06 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632966+0000", 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8990000000000004e-06 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632977+0000", 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1574e-05 2024-09-11T05:22:21.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689825+0000", 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.056847555000000001 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.689904+0000", 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9449000000000005e-05 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692033+0000", 2024-09-11T05:22:21.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021291130000000002 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.635122637999999, 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:21.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:21.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:21.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:21.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36845 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1921024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.633001346, 2024-09-11T05:22:21.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059196066999999998, 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36845 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635108+0000", 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635109+0000", 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635111+0000", 2024-09-11T05:22:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4380000000000002e-06 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635117+0000", 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.161e-06 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635122+0000", 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.831e-06 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694031+0000", 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058908380000000003 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694099+0000", 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8046000000000005e-05 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694304+0000", 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000205749 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.632981117, 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.632959552999999, 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.632945542000002, 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36851 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1994752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.631130851999998, 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059218845999999999, 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36851 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636979+0000", 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636980+0000", 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9600000000000008e-07 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636984+0000", 2024-09-11T05:22:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000004e-06 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636986+0000", 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6029999999999999e-06 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695889+0000", 2024-09-11T05:22:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058902788999999997 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695961+0000", 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1365999999999994e-05 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696198+0000", 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023703299999999999 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.631120241000001, 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.631105638000001, 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.631088333000001, 2024-09-11T05:22:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.631064223999999, 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.631036148, 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.631009156000001, 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.630968596999999, 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.63094521, 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:21.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37893 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3084288~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.534983383, 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058980038999999998, 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37893 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733126+0000", 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733127+0000", 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1699999999999998e-07 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733129+0000", 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4449999999999999e-06 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733138+0000", 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3850000000000002e-06 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733143+0000", 2024-09-11T05:22:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3310000000000003e-06 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791800+0000", 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058656610999999997 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.791877+0000", 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7525000000000001e-05 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792106+0000", 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000229125 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.534960103, 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.534940543000001, 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.534921327999999, 2024-09-11T05:22:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.534900528000001, 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.364 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:21.365 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:21.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:21.365+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:21.466 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:21.465+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:21.468 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:21.469 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:21.477 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:21.567 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:21.566+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:21.624 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:21.624 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:21.624 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:21.624 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:21.625 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:21.633 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:21.674 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:21.674+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:21.676 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone21 from 0xc2b7743 (overlap 0x760e8c8) to 0x236ac3c 2024-09-11T05:22:21.769 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:21.769+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:21.804 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:21.804 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:21.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:21.804 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:21.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.804 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.206392740999998, 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:21.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:21.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.206165245000001, 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.809 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:21.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.813 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.205910431, 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.814 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:21.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:21.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:21.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.205541535999998, 2024-09-11T05:22:21.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:21.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:21.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:21.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:21.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:21.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:21.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.205379990000001, 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.825 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:21.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:21.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:21.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:21.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.830 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.204937255000001, 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.831 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:21.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.202790362000002, 2024-09-11T05:22:21.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:21.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.200759810000001, 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:21.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:21.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.200739424999998, 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:21.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:21.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:21.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.983555620000001, 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.849 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:21.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:21.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:21.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.983534595999998, 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.854 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:21.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.983510340999999, 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.859 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:21.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:21.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:21.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:21.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:21.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:21.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:21.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.865 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.866 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.866 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:21.866 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981831257, 2024-09-11T05:22:21.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:21.866 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.866 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.867 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:21.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:21.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:21.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:21.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:21.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:21.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:21.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:21.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:21.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:21.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:21.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:21.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:21.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:21.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:21.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.876 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.877 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.877 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:21.877 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981811911000001, 2024-09-11T05:22:21.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:21.877 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.877 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.878 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.878 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.878 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.878 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.878 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:21.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.879 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:21.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:21.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:21.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:21.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:21.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:21.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:21.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:21.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:21.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:21.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:21.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:21.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:21.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:21.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:21.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:21.887 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.887 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.887 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.888 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.888 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:21.888 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981791138999998, 2024-09-11T05:22:21.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:21.888 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.889 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.889 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.889 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:21.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:21.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981771728999998, 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:21.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:21.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981751259999999, 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:21.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:21.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.98173237, 2024-09-11T05:22:21.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:21.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:21.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.909 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.972394576999999, 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:21.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:21.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:21.916 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.972383750999999, 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:21.918 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:21.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.919 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:21.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:21.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:21.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:21.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:21.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:21.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:21.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:21.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:21.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:21.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:21.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:21.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.924 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:21.924 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:21.924 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:21.926 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-11T05:22:21.926 INFO:teuthology.orchestra.run.smithi012.stdout:2420 read 0x3ad4cb9 thru 0x3ad4cce (0x16 bytes) 2024-09-11T05:22:21.926 INFO:teuthology.orchestra.run.smithi012.stdout:2421 punch from 0x40ee9da to 0x40f5792, (0x6db8 bytes) 2024-09-11T05:22:21.926 INFO:teuthology.orchestra.run.smithi012.stdout:2422 write 0x20851f6 thru 0x2091e5a (0xcc65 bytes) 2024-09-11T05:22:21.926 INFO:teuthology.orchestra.run.smithi012.stdout:2423 trunc from 0xc2b7743 to 0xbce4d7b 2024-09-11T05:22:21.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:21.927 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:21.925+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:21.941 INFO:teuthology.orchestra.run.smithi012.stdout:2424 writesame 0x3f844a5 thru 0x3f91d53 data_size 0x11(0xd8af bytes) 2024-09-11T05:22:21.989 INFO:teuthology.orchestra.run.smithi012.stdout:2426 punch from 0x4b6ceee to 0x4b72b53, (0x5c65 bytes) 2024-09-11T05:22:22.000 INFO:teuthology.orchestra.run.smithi012.stdout:2428 trunc from 0xbce4d7b to 0x282aec2 2024-09-11T05:22:22.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:22.026+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:22.089 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:22.089 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:22.089 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:22.089 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:22.097 INFO:teuthology.orchestra.run.smithi012.stdout:2429 write 0x724a714 thru 0x724e731 (0x401e bytes) 2024-09-11T05:22:22.098 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:22.108 INFO:teuthology.orchestra.run.smithi012.stdout:2430 trunc from 0x724e732 to 0xe6297bc 2024-09-11T05:22:22.113 INFO:teuthology.orchestra.run.smithi012.stdout:2431 read 0x80dfdfd thru 0x80e6027 (0x622b bytes) 2024-09-11T05:22:22.113 INFO:teuthology.orchestra.run.smithi012.stdout:2432 writesame 0xa7e0133 thru 0xa7edf9f data_size 0x1(0xde6d bytes) 2024-09-11T05:22:22.127 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:22.127+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:22.142 INFO:teuthology.orchestra.run.smithi012.stdout:2433 writesame 0x85cf37a thru 0x85d90d4 data_size 0x1(0x9d5b bytes) 2024-09-11T05:22:22.163 INFO:teuthology.orchestra.run.smithi012.stdout:2434 writesame 0x6075427 thru 0x608211b data_size 0x1(0xccf5 bytes) 2024-09-11T05:22:22.193 INFO:teuthology.orchestra.run.smithi012.stdout:2435 trunc from 0xe6297bc to 0x8fc96b4 2024-09-11T05:22:22.200 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:22.203 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:22.203 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:22.203 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:22.205 INFO:teuthology.orchestra.run.smithi012.stdout:2438 trunc from 0x8fc96b4 to 0x480ba6f 2024-09-11T05:22:22.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:22.218 INFO:teuthology.orchestra.run.smithi012.stdout:2439 read 0x339517b thru 0x33a1f9d (0xce23 bytes) 2024-09-11T05:22:22.218 INFO:teuthology.orchestra.run.smithi012.stdout:2440 write 0x27802e7 thru 0x27837b4 (0x34ce bytes) 2024-09-11T05:22:22.220 INFO:teuthology.orchestra.run.smithi012.stdout:2441 read 0x3d0a725 thru 0x3d19e53 (0xf72f bytes) 2024-09-11T05:22:22.220 INFO:teuthology.orchestra.run.smithi012.stdout:2442 read 0x3141e98 thru 0x3146bd5 (0x4d3e bytes) 2024-09-11T05:22:22.228 INFO:teuthology.orchestra.run.smithi012.stdout:2443 writesame 0x63be210 thru 0x63c1eb8 data_size 0x1(0x3ca9 bytes) 2024-09-11T05:22:22.228 INFO:teuthology.orchestra.run.smithi012.stdout:2444 read 0x36b7b93 thru 0x36c2da5 (0xb213 bytes) 2024-09-11T05:22:22.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:22.228+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:22.229 INFO:teuthology.orchestra.run.smithi012.stdout:2445 trunc from 0x63c1eb9 to 0x625f14e 2024-09-11T05:22:22.240 INFO:teuthology.orchestra.run.smithi012.stdout:2447 write 0x927846d thru 0x927ac0d (0x27a1 bytes) 2024-09-11T05:22:22.253 INFO:teuthology.orchestra.run.smithi012.stdout:2448 writesame 0xd368100 thru 0xd368739 data_size 0x1(0x63a bytes) 2024-09-11T05:22:22.253 INFO:teuthology.orchestra.run.smithi012.stdout:2449 read 0x3549910 thru 0x3554cf2 (0xb3e3 bytes) 2024-09-11T05:22:22.253 INFO:teuthology.orchestra.run.smithi012.stdout:2450 punch from 0xcc1cca8 to 0xcc2b676, (0xe9ce bytes) 2024-09-11T05:22:22.253 INFO:teuthology.orchestra.run.smithi012.stdout:2452 punch from 0x205164a to 0x205c7ff, (0xb1b5 bytes) 2024-09-11T05:22:22.255 INFO:teuthology.orchestra.run.smithi012.stdout:2455 trunc from 0xd36873a to 0xb1ce263 2024-09-11T05:22:22.263 INFO:teuthology.orchestra.run.smithi012.stdout:2456 trunc from 0xb1ce263 to 0xc1e3979 2024-09-11T05:22:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:2458 punch from 0x765e459 to 0x766a5bf, (0xc166 bytes) 2024-09-11T05:22:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:2461 punch from 0x8fa2ac6 to 0x8fa6121, (0x365b bytes) 2024-09-11T05:22:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:2462 writesame 0xb2f497e thru 0xb303c44 data_size 0x1(0xf2c7 bytes) 2024-09-11T05:22:22.295 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.308 INFO:teuthology.orchestra.run.smithi012.stdout:2466 trunc from 0xc1e3979 to 0x313975f 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:3306 3.10 3:0d9d5413:::rbd_data.1179262aa3d7.0000000000000030:5 [read 901120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.601509559999997, 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039343149999999999, 2024-09-11T05:22:22.322 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3306 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719066+0000", 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719068+0000", 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8989999999999999e-06 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719072+0000", 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7689999999999998e-06 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.719076+0000", 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:22:22.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722913+0000", 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038379439999999998 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.722959+0000", 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5414000000000003e-05 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:49.723000+0000", 2024-09-11T05:22:22.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1337000000000001e-05 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10509 3.10 3:0e4b85b7:::rbd_data.117977dc529b.0000000000000006:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.788447790999999, 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081221729999999999, 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10509 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532129+0000", 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.052e-06 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532146+0000", 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6931000000000001e-05 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532158+0000", 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2207e-05 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532164+0000", 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2210000000000002e-06 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532223+0000", 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9338e-05 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532325+0000", 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101656 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.540250+0000", 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079247680000000004 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10994 3.10 3:0b01f203:::rbd_data.117977dc529b.0000000000000017:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.759574363999999, 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052453930000000001, 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.332 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10994 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561003+0000", 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.323e-06 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561010+0000", 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6420000000000001e-06 2024-09-11T05:22:22.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561029+0000", 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8564999999999999e-05 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561039+0000", 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0046e-05 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561107+0000", 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7922999999999993e-05 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561253+0000", 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014678200000000001 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.566247+0000", 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049931120000000001 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15377 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.346027449000001, 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039582419999999998, 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15377 2024-09-11T05:22:22.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974549+0000", 2024-09-11T05:22:22.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3200000000000005e-07 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974551+0000", 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.706e-06 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974559+0000", 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4390000000000003e-06 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974564+0000", 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5249999999999996e-06 2024-09-11T05:22:22.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977991+0000", 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003426742 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978091+0000", 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9469000000000006e-05 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978506+0000", 2024-09-11T05:22:22.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00041572899999999999 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15378 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.346002933000001, 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00436718, 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15378 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974575+0000", 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3250000000000002e-06 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974582+0000", 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.951e-06 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974589+0000", 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0269999999999998e-06 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978537+0000", 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039479529999999997 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978616+0000", 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8851999999999997e-05 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978940+0000", 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000323572 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15379 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.345 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.345978659, 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045646519999999998, 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15379 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974599+0000", 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2139999999999999e-06 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974615+0000", 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5330999999999999e-05 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974621+0000", 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8069999999999996e-06 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978989+0000", 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043679410000000002 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979086+0000", 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7297e-05 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979161+0000", 2024-09-11T05:22:22.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5617000000000005e-05 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15380 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.345946464000001, 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00473859, 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15380 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4900000000000001e-07 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974636+0000", 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974644+0000", 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4719999999999998e-06 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974649+0000", 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4210000000000003e-06 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979201+0000", 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045517919999999998 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979287+0000", 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5981000000000002e-05 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979368+0000", 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0873999999999999e-05 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.354 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16758 3.10 3:0ff05fec:::rbd_data.1179c3639760.000000000000000a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.962657642, 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0180985, 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16758 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.355 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357923+0000", 2024-09-11T05:22:22.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3120000000000001e-06 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357935+0000", 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2104e-05 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357951+0000", 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5818999999999999e-05 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357961+0000", 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5980000000000003e-06 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358021+0000", 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0650999999999999e-05 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358125+0000", 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103479 2024-09-11T05:22:22.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.361575+0000", 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034500619999999998 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375931+0000", 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014355698 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375944+0000", 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3328e-05 2024-09-11T05:22:22.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375980+0000", 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5760999999999999e-05 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.376016+0000", 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6687999999999998e-05 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16758 3.10 e32/22 ondisk, result = 0)", 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.952152871999999, 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075142530000000003, 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.361 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368424+0000", 2024-09-11T05:22:22.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3120000000000001e-06 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368431+0000", 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8129999999999998e-06 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368448+0000", 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6980999999999999e-05 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368458+0000", 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375910+0000", 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074519 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375918+0000", 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9589999999999995e-06 2024-09-11T05:22:22.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375937+0000", 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8527999999999999e-05 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16860 3.a 3:55f78c79:::rbd_data.1179c3639760.000000000000000e:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.788767393000001, 2024-09-11T05:22:22.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014769262999999999, 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16860 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531809+0000", 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:22:22.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531813+0000", 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3730000000000003e-06 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531824+0000", 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0494e-05 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531829+0000", 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1669999999999998e-06 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531878+0000", 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9027999999999999e-05 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531974+0000", 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5874999999999999e-05 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.534209+0000", 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022353020000000002 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546470+0000", 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012260630999999999 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546499+0000", 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9436000000000001e-05 2024-09-11T05:22:22.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546545+0000", 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5445999999999998e-05 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546577+0000", 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2536999999999997e-05 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.371 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16860 3.a e32/22 ondisk, result = 0)", 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.778451545999999, 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044590660000000002, 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542125+0000", 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.096e-06 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542128+0000", 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0639999999999998e-06 2024-09-11T05:22:22.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542139+0000", 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0915e-05 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542148+0000", 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6060000000000003e-06 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546490+0000", 2024-09-11T05:22:22.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043424780000000003 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546496+0000", 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0000000000000002e-06 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546583+0000", 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6907e-05 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39459 3.a 3:54bd4aae:::rbd_data.1179ab1e2350.0000000000000015:head [write 0~0] snapc a=[a] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.482028911, 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041154470000000004, 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39459 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.376 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2099999999999997e-07 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838550+0000", 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4540000000000001e-06 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838555+0000", 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838558+0000", 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4709999999999999e-06 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839659+0000", 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011004089999999999 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839734+0000", 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4967000000000002e-05 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839916+0000", 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018229300000000001 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842435+0000", 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002519257 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842572+0000", 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013645199999999999 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842619+0000", 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7586000000000001e-05 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842662+0000", 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2879000000000001e-05 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:62325 3.1e e44/43 3:7ca35b74:::rbd_data.1179377e61aa.0000000000000002:head v 44'132, mlcod=0'0)", 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.83598737, 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050778849999999999, 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5300000000000001e-07 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484592+0000", 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8e-06 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484602+0000", 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5459999999999997e-06 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484607+0000", 2024-09-11T05:22:22.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3800000000000002e-06 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484638+0000", 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1235000000000002e-05 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484653+0000", 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4713e-05 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.489632+0000", 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049786029999999998 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.489666+0000", 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4455000000000001e-05 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.386 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63746 3.10 3:0d130168:::rbd_data.117960679f52.0000000000000042:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,truncate 917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.336633834000001, 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042747189999999997, 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63746 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3099999999999996e-07 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983947+0000", 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.464e-06 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983957+0000", 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0086e-05 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983963+0000", 2024-09-11T05:22:22.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1179999999999997e-06 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984031+0000", 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8106000000000001e-05 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984128+0000", 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6523999999999999e-05 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:22.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984261+0000", 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013350699999999999 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.985139+0000", 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00087741999999999996 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988160+0000", 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030213229999999998 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988195+0000", 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5413999999999997e-05 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988216+0000", 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0925999999999999e-05 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64134 3.a 3:5751da01:::rbd_header.117960679f52:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:22.392 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.7764649249999991, 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087579719999999993, 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64134 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544112+0000", 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-11T05:22:22.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544118+0000", 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9839999999999998e-06 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544131+0000", 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.343e-05 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544140+0000", 2024-09-11T05:22:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8729999999999996e-06 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544199+0000", 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8375999999999998e-05 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544204+0000", 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0799999999999996e-06 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.551581+0000", 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073776379999999997 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.551674+0000", 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552026+0000", 2024-09-11T05:22:22.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00035214799999999999 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552628+0000", 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060198599999999999 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552809+0000", 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109199999999999 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552840+0000", 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1229000000000002e-05 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552869+0000", 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8090999999999999e-05 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.399 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64494 3.a 3:57baaaa4:::rbd_data.1179fd54a524.000000000000006c:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.505405348, 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013982322, 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64494 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815171+0000", 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3149999999999999e-06 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815178+0000", 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9319999999999999e-06 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815189+0000", 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815195+0000", 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815239+0000", 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4459999999999998e-05 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815331+0000", 2024-09-11T05:22:22.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2139999999999995e-05 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.817519+0000", 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021876619999999999 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829065+0000", 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011545778 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829077+0000", 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2266000000000001e-05 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829114+0000", 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7214e-05 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829152+0000", 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8133999999999998e-05 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64528 3.a 3:57baaaa4:::rbd_data.1179fd54a524.000000000000006c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.4512084640000005, 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049568420000000004, 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64528 2024-09-11T05:22:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869369+0000", 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5689999999999999e-06 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869375+0000", 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2389999999999999e-06 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869389+0000", 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4303e-05 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869397+0000", 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9270000000000005e-06 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870007+0000", 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00061024400000000002 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870060+0000", 2024-09-11T05:22:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2630000000000003e-05 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870128+0000", 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7992999999999998e-05 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.871474+0000", 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001346222 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874232+0000", 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027579499999999999 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874286+0000", 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4103e-05 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874324+0000", 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7662e-05 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.411 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:70793 3.10 3:096c4687:::rbd_data.1179db619f31.0000000000000011:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 8126464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.39101246499999998, 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039886560000000001, 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.412 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 70793 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929565+0000", 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929573+0000", 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7260000000000002e-06 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929588+0000", 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5007999999999999e-05 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929597+0000", 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6320000000000003e-06 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929648+0000", 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1175999999999999e-05 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929740+0000", 2024-09-11T05:22:22.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1545999999999994e-05 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929849+0000", 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922899999999999 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.930411+0000", 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00056223299999999998 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933483+0000", 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030712040000000001 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933516+0000", 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3751000000000003e-05 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933552+0000", 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5261e-05 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.417 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71634 3.10 3:096c4687:::rbd_data.1179db619f31.0000000000000011:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.17595197800000001, 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018691636000000001, 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.418 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71634 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144626+0000", 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2019999999999998e-06 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144635+0000", 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.662e-06 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144654+0000", 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9086999999999999e-05 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144664+0000", 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0003000000000001e-05 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144729+0000", 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4789000000000006e-05 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144797+0000", 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7335999999999994e-05 2024-09-11T05:22:22.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.147776+0000", 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002978938 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163184+0000", 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015408597 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163202+0000", 2024-09-11T05:22:22.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7907e-05 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163263+0000", 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1122000000000002e-05 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163315+0000", 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1993000000000002e-05 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:71634 3.10 e57/45 ondisk, result = 0)", 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.16418324100000001, 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068001270000000004, 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156393+0000", 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1480000000000001e-06 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156400+0000", 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7329999999999997e-06 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156415+0000", 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4554e-05 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156424+0000", 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4239999999999999e-06 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163165+0000", 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067404370000000002 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163176+0000", 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1603000000000001e-05 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163192+0000", 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6228000000000001e-05 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.428 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:22.430 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2467 write 0x6dfa000 thru 0x6e043f8 (0xa3f9 bytes) 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2468 writesame 0x18b5a83 thru 0x18b6cb8 data_size 0x15(0x1236 bytes) 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2469 read 0x39ea626 thru 0x39ed021 (0x29fc bytes) 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2470 punch from 0x2171045 to 0x2177dfb, (0x6db6 bytes) 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2475 punch from 0x54539ec to 0x545b49c, (0x7ab0 bytes) 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2477 write 0x6ac4167 thru 0x6acf065 (0xaeff bytes) 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2478 write 0xa4d0c61 thru 0xa4dd999 (0xcd39 bytes) 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2479 trunc from 0xa4dd99a to 0xafd64 2024-09-11T05:22:22.431 INFO:teuthology.orchestra.run.smithi012.stdout:2480 trunc from 0xafd64 to 0x8cde46b 2024-09-11T05:22:22.432 INFO:teuthology.orchestra.run.smithi012.stdout:2481 write 0x1ffc23e thru 0x2005595 (0x9358 bytes) 2024-09-11T05:22:22.432 INFO:teuthology.orchestra.run.smithi012.stdout:2482 write 0x5654d1c thru 0x565e78b (0x9a70 bytes) 2024-09-11T05:22:22.432 INFO:teuthology.orchestra.run.smithi012.stdout:2483 read 0x74ccde9 thru 0x74db7bb (0xe9d3 bytes) 2024-09-11T05:22:22.432 INFO:teuthology.orchestra.run.smithi012.stdout:2484 trunc from 0x8cde46b to 0x267213f 2024-09-11T05:22:22.432 INFO:teuthology.orchestra.run.smithi012.stdout:2485 write 0x5d4a1a4 thru 0x5d4b62e (0x148b bytes) 2024-09-11T05:22:22.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:22.429+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:22.432 INFO:teuthology.orchestra.run.smithi012.stdout:2486 trunc from 0x5d4b62f to 0x8d1cfc 2024-09-11T05:22:22.444 INFO:teuthology.orchestra.run.smithi012.stdout:2487 write 0x9ca66e thru 0x9cb58a (0xf1d bytes) 2024-09-11T05:22:22.445 INFO:teuthology.orchestra.run.smithi012.stdout:2489 read 0x79ee03 thru 0x7ad8da (0xead8 bytes) 2024-09-11T05:22:22.457 INFO:teuthology.orchestra.run.smithi012.stdout:2490 trunc from 0x9cb58b to 0xabe40e6 2024-09-11T05:22:22.462 INFO:teuthology.orchestra.run.smithi012.stdout:2491 write 0x16675 thru 0x1d424 (0x6db0 bytes) 2024-09-11T05:22:22.472 INFO:teuthology.orchestra.run.smithi012.stdout:2492 write 0xcc73280 thru 0xcc787a8 (0x5529 bytes) 2024-09-11T05:22:22.474 INFO:teuthology.orchestra.run.smithi012.stdout:2493 writesame 0x773872f thru 0x7743e51 data_size 0x1(0xb723 bytes) 2024-09-11T05:22:22.495 INFO:teuthology.orchestra.run.smithi012.stdout:2494 punch from 0x2eaa2ef to 0x2ead57e, (0x328f bytes) 2024-09-11T05:22:22.495 INFO:teuthology.orchestra.run.smithi012.stdout:2496 write 0x6ead0e9 thru 0x6eb9cd4 (0xcbec bytes) 2024-09-11T05:22:22.498 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.499 INFO:teuthology.orchestra.run.smithi012.stdout:2500 writesame 0x3a62f01 thru 0x3a709fe data_size 0x1(0xdafe bytes) 2024-09-11T05:22:22.526 INFO:teuthology.orchestra.run.smithi012.stdout:2501 write 0x39ef78c thru 0x39fd803 (0xe078 bytes) 2024-09-11T05:22:22.528 INFO:teuthology.orchestra.run.smithi012.stdout:2502 read 0x66331e5 thru 0x66337a4 (0x5c0 bytes) 2024-09-11T05:22:22.528 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.528 INFO:teuthology.orchestra.run.smithi012.stdout:2505 punch from 0x5c3de47 to 0x5c400b9, (0x2272 bytes) 2024-09-11T05:22:22.529 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:22.529+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:22.536 INFO:teuthology.orchestra.run.smithi012.stdout:2507 trunc from 0xcc787a9 to 0x5b98d2d 2024-09-11T05:22:22.540 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:22.540 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:22.540 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:22.540 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:22.550 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:22.559 INFO:teuthology.orchestra.run.smithi012.stdout:2510 write 0x9aeb617 thru 0x9af018d (0x4b77 bytes) 2024-09-11T05:22:22.571 INFO:teuthology.orchestra.run.smithi012.stdout:2511 write 0xc7dd79f thru 0xc7e725c (0x9abe bytes) 2024-09-11T05:22:22.575 INFO:teuthology.orchestra.run.smithi012.stdout:2512 writesame 0x68083f1 thru 0x6814627 data_size 0x1(0xc237 bytes) 2024-09-11T05:22:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:2513 trunc from 0xc7e725d to 0x6275500 2024-09-11T05:22:22.610 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:22:22.613 INFO:teuthology.orchestra.run.smithi012.stdout:2514 read 0x4299b95 thru 0x429d8f1 (0x3d5d bytes) 2024-09-11T05:22:22.614 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:22.621 INFO:teuthology.orchestra.run.smithi012.stdout:2516 write 0x79c7538 thru 0x79c95c1 (0x208a bytes) 2024-09-11T05:22:22.630 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:22.630+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:22.633 INFO:teuthology.orchestra.run.smithi012.stdout:2517 write 0xadf9d95 thru 0xae03768 (0x99d4 bytes) 2024-09-11T05:22:22.637 INFO:teuthology.orchestra.run.smithi012.stdout:2518 writesame 0x2d2e9b9 thru 0x2d36086 data_size 0x1(0x76ce bytes) 2024-09-11T05:22:22.649 INFO:teuthology.orchestra.run.smithi012.stdout:2522 write 0x1b6b537 thru 0x1b75b5f (0xa629 bytes) 2024-09-11T05:22:22.650 INFO:teuthology.orchestra.run.smithi012.stdout:2523 clone 23 order 20 su 16384 sc 3 2024-09-11T05:22:22.658 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:22.658 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:22.658 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:22.659 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:22.659 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:22.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:22.731 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:22.731+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:22.812 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.060500343000001, 2024-09-11T05:22:22.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:22.813 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.813 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.816 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.816 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.816 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:22.816 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:22.816 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:22.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:22.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.057421780999999, 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.823 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:22.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:22.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.057404480999999, 2024-09-11T05:22:22.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:22.829 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.829 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.829 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:22.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:22.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.057378446000001, 2024-09-11T05:22:22.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:22.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:22.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:22.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:22.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:22.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:22.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.057362220000002, 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.841 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:22.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:22.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.057339764000002, 2024-09-11T05:22:22.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:22.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:22.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.057305684999999, 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:22.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:22.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.057268063999999, 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:22.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.056703224, 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:22.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.056654126000002, 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.865 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:22.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.771999048000001, 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.870 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:22.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.771979430000002, 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.879 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.769389375999999, 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:22.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:22.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.768959234, 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:22.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:22.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:22.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:22.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.768924814000002, 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:22.891 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:22.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:22.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:22.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:22.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:22.896 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.717834499999999, 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:22.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:22.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:22.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.647382882999999, 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.902 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:22.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:22.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63898 3.11 3:89620d31:::rbd_data.117960679f52.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.690312951999999, 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709826999999999, 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63898 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:22.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120804+0000", 2024-09-11T05:22:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:22:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120808+0000", 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120817+0000", 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120821+0000", 2024-09-11T05:22:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120858+0000", 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6863999999999998e-05 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120951+0000", 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2541999999999996e-05 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:22.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.124305+0000", 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00335389 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140413+0000", 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016108245 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140444+0000", 2024-09-11T05:22:22.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1578000000000002e-05 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140482+0000", 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140513+0000", 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1477999999999999e-05 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:70954 3.14 e57/22 3:2fcfd35d:::rbd_data.1179db619f31.0000000000000009:head v 57'288, mlcod=56'286)", 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.84554773100000002, 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023605603999999999, 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:22.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965570+0000", 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7630000000000001e-06 2024-09-11T05:22:22.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971434+0000", 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058634300000000002 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971457+0000", 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3436999999999999e-05 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971471+0000", 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3776e-05 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971538+0000", 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7074000000000002e-05 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971565+0000", 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6914e-05 2024-09-11T05:22:22.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989115+0000", 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017549754000000001 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989174+0000", 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9456000000000001e-05 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.918 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71938 3.f 3:f110c0b8:::rbd_data.1179db619f31.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.311369279, 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027012653000000001, 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71938 2024-09-11T05:22:22.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499748+0000", 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499752+0000", 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:22.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499762+0000", 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7610000000000002e-06 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499767+0000", 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.118e-06 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499813+0000", 2024-09-11T05:22:22.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6168999999999998e-05 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499871+0000", 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8394999999999999e-05 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.503877+0000", 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040059290000000001 2024-09-11T05:22:22.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526608+0000", 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022730899999999998 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526628+0000", 2024-09-11T05:22:22.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9556e-05 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526686+0000", 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7839e-05 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:22.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526760+0000", 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4146000000000005e-05 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:22.926 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:22.928 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:22.927+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:22.928 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:23.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:23.028 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:23.028+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:23.036 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:23.037 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:23.046 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:23.127 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:23.128 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:23.129 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:23.129+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:23.145 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:23.164 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:23.164 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:23.181 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:23.181 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:23.198 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:23.198 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:23.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:23.216 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:23.217 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:23.233 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:23.234 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:23.234+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:23.253 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:23.254 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:23.326 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:23.326 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:23.331 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:23.331+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:23.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:23.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:23.431+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:23.443 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:23.443 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:23.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:23.533 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:23.533+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:23.600 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:23.600 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:23.604 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:22:23.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:23.634 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:23.633+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:23.684 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone22 from 0xae03769 (overlap 0xafd64) to 0x232ad 2024-09-11T05:22:23.734 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:23.733+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:23.737 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:23.737 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:23.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-11T05:22:23.837 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:23.837+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:23.841 INFO:teuthology.orchestra.run.smithi012.stdout:2524 read 0x4d43a01 thru 0x4d4de4f (0xa44f bytes) 2024-09-11T05:22:23.842 INFO:teuthology.orchestra.run.smithi012.stdout:2525 write 0x72b5f39 thru 0x72b98c0 (0x3988 bytes) 2024-09-11T05:22:23.853 INFO:teuthology.orchestra.run.smithi012.stdout:2526 write 0x6b6dcd2 thru 0x6b7ca4e (0xed7d bytes) 2024-09-11T05:22:23.871 INFO:teuthology.orchestra.run.smithi012.stdout:2528 write 0xc778b2b thru 0xc7818cb (0x8da1 bytes) 2024-09-11T05:22:23.886 INFO:teuthology.orchestra.run.smithi012.stdout:2529 trunc from 0xc7818cc to 0x323997b 2024-09-11T05:22:23.907 INFO:teuthology.orchestra.run.smithi012.stdout:2530 writesame 0xbca45d thru 0xbcd1e2 data_size 0x1(0x2d86 bytes) 2024-09-11T05:22:23.923 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:23.923 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:23.935 INFO:teuthology.orchestra.run.smithi012.stdout:2532 writesame 0xe19ed11 thru 0xe1a5e7b data_size 0x1(0x716b bytes) 2024-09-11T05:22:23.935 INFO:teuthology.orchestra.run.smithi012.stdout:2533 write 0xa754617 thru 0xa761e9c (0xd886 bytes) 2024-09-11T05:22:23.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:23.938 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:23.937+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:23.940 INFO:teuthology.orchestra.run.smithi012.stdout:2534 write 0x33e59f8 thru 0x33f048b (0xaa94 bytes) 2024-09-11T05:22:23.944 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:23.944 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:23.945 INFO:teuthology.orchestra.run.smithi012.stdout:2537 punch from 0x46d981e to 0x46e15fc, (0x7dde bytes) 2024-09-11T05:22:23.945 INFO:teuthology.orchestra.run.smithi012.stdout:2539 write 0x303b9b0 thru 0x303c2fb (0x94c bytes) 2024-09-11T05:22:23.950 INFO:teuthology.orchestra.run.smithi012.stdout:2540 trunc from 0xe1a5e7c to 0xa6cbd7c 2024-09-11T05:22:23.957 INFO:teuthology.orchestra.run.smithi012.stdout:2542 write 0x52076fe thru 0x520bcb5 (0x45b8 bytes) 2024-09-11T05:22:23.961 INFO:teuthology.orchestra.run.smithi012.stdout:2543 read 0x48a3e81 thru 0x48ad83b (0x99bb bytes) 2024-09-11T05:22:23.971 INFO:teuthology.orchestra.run.smithi012.stdout:2544 write 0xecdd0e0 thru 0xece8ac7 (0xb9e8 bytes) 2024-09-11T05:22:23.979 INFO:teuthology.orchestra.run.smithi012.stdout:2545 read 0x5f6bf thru 0x61aea (0x242c bytes) 2024-09-11T05:22:23.995 INFO:teuthology.orchestra.run.smithi012.stdout:2547 trunc from 0xece8ac8 to 0x131ad6e 2024-09-11T05:22:24.034 INFO:teuthology.orchestra.run.smithi012.stdout:2548 writesame 0x88c8b26 thru 0x88cf6e5 data_size 0x20(0x6bc0 bytes) 2024-09-11T05:22:24.034 INFO:teuthology.orchestra.run.smithi012.stdout:2549 read 0x780a91b thru 0x780d9fc (0x30e2 bytes) 2024-09-11T05:22:24.034 INFO:teuthology.orchestra.run.smithi012.stdout:2550 read 0x1ad18e thru 0x1ad55e (0x3d1 bytes) 2024-09-11T05:22:24.035 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.041 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:24.041+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:24.046 INFO:teuthology.orchestra.run.smithi012.stdout:2553 write 0xd0b88ac thru 0xd0c67e8 (0xdf3d bytes) 2024-09-11T05:22:24.054 INFO:teuthology.orchestra.run.smithi012.stdout:2554 read 0x2c6c38a thru 0x2c786d4 (0xc34b bytes) 2024-09-11T05:22:24.054 INFO:teuthology.orchestra.run.smithi012.stdout:2555 write 0x48f8bde thru 0x48fa12a (0x154d bytes) 2024-09-11T05:22:24.059 INFO:teuthology.orchestra.run.smithi012.stdout:2556 punch from 0x2d25691 to 0x2d346f4, (0xf063 bytes) 2024-09-11T05:22:24.059 INFO:teuthology.orchestra.run.smithi012.stdout:2557 read 0xaff1124 thru 0xaff61db (0x50b8 bytes) 2024-09-11T05:22:24.060 INFO:teuthology.orchestra.run.smithi012.stdout:2558 write 0x5c26748 thru 0x5c35528 (0xede1 bytes) 2024-09-11T05:22:24.067 INFO:teuthology.orchestra.run.smithi012.stdout:2559 write 0x157d3a thru 0x15e21f (0x64e6 bytes) 2024-09-11T05:22:24.068 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:24.069 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:24.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:24.088 INFO:teuthology.orchestra.run.smithi012.stdout:2560 write 0xe43b8ec thru 0xe4405c8 (0x4cdd bytes) 2024-09-11T05:22:24.092 INFO:teuthology.orchestra.run.smithi012.stdout:2561 read 0xb953f71 thru 0xb9636a0 (0xf730 bytes) 2024-09-11T05:22:24.092 INFO:teuthology.orchestra.run.smithi012.stdout:2562 writesame 0x8eb8596 thru 0x8ec2725 data_size 0x5e(0xa190 bytes) 2024-09-11T05:22:24.097 INFO:teuthology.orchestra.run.smithi012.stdout:2563 read 0xddc1e0a thru 0xddc4462 (0x2659 bytes) 2024-09-11T05:22:24.097 INFO:teuthology.orchestra.run.smithi012.stdout:2564 punch from 0x477639d to 0x477db73, (0x77d6 bytes) 2024-09-11T05:22:24.097 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.097 INFO:teuthology.orchestra.run.smithi012.stdout:2572 read 0x899fa82 thru 0x89a8cf8 (0x9277 bytes) 2024-09-11T05:22:24.097 INFO:teuthology.orchestra.run.smithi012.stdout:2573 write 0x1132c0c thru 0x1137678 (0x4a6d bytes) 2024-09-11T05:22:24.105 INFO:teuthology.orchestra.run.smithi012.stdout:2575 write 0x2ab60d4 thru 0x2ab6724 (0x651 bytes) 2024-09-11T05:22:24.108 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.117 INFO:teuthology.orchestra.run.smithi012.stdout:2578 trunc from 0xe4405c9 to 0x60a1bec 2024-09-11T05:22:24.129 INFO:teuthology.orchestra.run.smithi012.stdout:2579 read 0x2d65029 thru 0x2d6d164 (0x813c bytes) 2024-09-11T05:22:24.129 INFO:teuthology.orchestra.run.smithi012.stdout:2581 punch from 0x48aad4b to 0x48b3147, (0x83fc bytes) 2024-09-11T05:22:24.137 INFO:teuthology.orchestra.run.smithi012.stdout:2583 trunc from 0x60a1bec to 0xd48ae6a 2024-09-11T05:22:24.142 INFO:teuthology.orchestra.run.smithi012.stdout:2584 read 0x5e8141b thru 0x5e8ed71 (0xd957 bytes) 2024-09-11T05:22:24.142 INFO:teuthology.orchestra.run.smithi012.stdout:2585 writesame 0x599f5b3 thru 0x59a0fd6 data_size 0xe(0x1a24 bytes) 2024-09-11T05:22:24.142 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:24.141+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:24.146 INFO:teuthology.orchestra.run.smithi012.stdout:2586 read 0x1b28274 thru 0x1b30b28 (0x88b5 bytes) 2024-09-11T05:22:24.146 INFO:teuthology.orchestra.run.smithi012.stdout:2588 read 0x9175d36 thru 0x9183f29 (0xe1f4 bytes) 2024-09-11T05:22:24.146 INFO:teuthology.orchestra.run.smithi012.stdout:2589 write 0x6149e7e thru 0x614c430 (0x25b3 bytes) 2024-09-11T05:22:24.149 INFO:teuthology.orchestra.run.smithi012.stdout:2590 read 0x8319b8e thru 0x831cf1f (0x3392 bytes) 2024-09-11T05:22:24.150 INFO:teuthology.orchestra.run.smithi012.stdout:2592 read 0xd0cb6aa thru 0xd0d2d69 (0x76c0 bytes) 2024-09-11T05:22:24.150 INFO:teuthology.orchestra.run.smithi012.stdout:2593 writesame 0xb2ac9c9 thru 0xb2b749b data_size 0x2b(0xaad3 bytes) 2024-09-11T05:22:24.154 INFO:teuthology.orchestra.run.smithi012.stdout:2594 read 0xc1a6b01 thru 0xc1a8453 (0x1953 bytes) 2024-09-11T05:22:24.154 INFO:teuthology.orchestra.run.smithi012.stdout:2595 read 0x664fa7c thru 0x6652ec5 (0x344a bytes) 2024-09-11T05:22:24.154 INFO:teuthology.orchestra.run.smithi012.stdout:2597 writesame 0xb11862 thru 0xb17fee data_size 0x7(0x678d bytes) 2024-09-11T05:22:24.160 INFO:teuthology.orchestra.run.smithi012.stdout:2598 read 0x8cb5814 thru 0x8cb80cf (0x28bc bytes) 2024-09-11T05:22:24.160 INFO:teuthology.orchestra.run.smithi012.stdout:2599 write 0x5cee7d6 thru 0x5cf1a35 (0x3260 bytes) 2024-09-11T05:22:24.161 INFO:teuthology.orchestra.run.smithi012.stdout:2603 read 0xcd0d962 thru 0xcd19286 (0xb925 bytes) 2024-09-11T05:22:24.162 INFO:teuthology.orchestra.run.smithi012.stdout:2604 writesame 0x3ee5c18 thru 0x3eeebac data_size 0x1(0x8f95 bytes) 2024-09-11T05:22:24.175 INFO:teuthology.orchestra.run.smithi012.stdout:2605 read 0xc6a6254 thru 0xc6b1ef1 (0xbc9e bytes) 2024-09-11T05:22:24.175 INFO:teuthology.orchestra.run.smithi012.stdout:2606 read 0x4b2667f thru 0x4b30db9 (0xa73b bytes) 2024-09-11T05:22:24.175 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.176 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.176 INFO:teuthology.orchestra.run.smithi012.stdout:2611 punch from 0x62c0467 to 0x62c6aea, (0x6683 bytes) 2024-09-11T05:22:24.176 INFO:teuthology.orchestra.run.smithi012.stdout:2613 punch from 0x5a4f7f5 to 0x5a5ccec, (0xd4f7 bytes) 2024-09-11T05:22:24.182 INFO:teuthology.orchestra.run.smithi012.stdout:2614 trunc from 0xd48ae6a to 0x6d7ebe5 2024-09-11T05:22:24.192 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.207 INFO:teuthology.orchestra.run.smithi012.stdout:2617 write 0xe64bad5 thru 0xe64ee4a (0x3376 bytes) 2024-09-11T05:22:24.210 INFO:teuthology.orchestra.run.smithi012.stdout:2619 write 0xc935e86 thru 0xc943f03 (0xe07e bytes) 2024-09-11T05:22:24.215 INFO:teuthology.orchestra.run.smithi012.stdout:2620 punch from 0x64bffbf to 0x64c2740, (0x2781 bytes) 2024-09-11T05:22:24.215 INFO:teuthology.orchestra.run.smithi012.stdout:2621 write 0x97093e3 thru 0x971268c (0x92aa bytes) 2024-09-11T05:22:24.220 INFO:teuthology.orchestra.run.smithi012.stdout:2622 read 0x6b08a36 thru 0x6b12a86 (0xa051 bytes) 2024-09-11T05:22:24.221 INFO:teuthology.orchestra.run.smithi012.stdout:2623 read 0xce8cbed thru 0xce8e344 (0x1758 bytes) 2024-09-11T05:22:24.221 INFO:teuthology.orchestra.run.smithi012.stdout:2625 read 0x570f164 thru 0x5715305 (0x61a2 bytes) 2024-09-11T05:22:24.221 INFO:teuthology.orchestra.run.smithi012.stdout:2626 punch from 0x5747b7f to 0x574a2d8, (0x2759 bytes) 2024-09-11T05:22:24.221 INFO:teuthology.orchestra.run.smithi012.stdout:2628 read 0x299a9a9 thru 0x29aa4a3 (0xfafb bytes) 2024-09-11T05:22:24.222 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:24.222 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:24.222 INFO:teuthology.orchestra.run.smithi012.stdout:2629 write 0x8243e83 thru 0x824bfb4 (0x8132 bytes) 2024-09-11T05:22:24.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:24.232 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.232 INFO:teuthology.orchestra.run.smithi012.stdout:2634 writesame 0x258f183 thru 0x25978cb data_size 0x1(0x8749 bytes) 2024-09-11T05:22:24.246 INFO:teuthology.orchestra.run.smithi012.stdout:2635 trunc from 0xe64ee4b to 0xe35ab40 2024-09-11T05:22:24.247 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:24.246+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:24.256 INFO:teuthology.orchestra.run.smithi012.stdout:2636 writesame 0x91299a1 thru 0x912c23f data_size 0x1(0x289f bytes) 2024-09-11T05:22:24.273 INFO:teuthology.orchestra.run.smithi012.stdout:2637 trunc from 0xe35ab40 to 0x7bc6708 2024-09-11T05:22:24.284 INFO:teuthology.orchestra.run.smithi012.stdout:2638 write 0x340f350 thru 0x34128e3 (0x3594 bytes) 2024-09-11T05:22:24.294 INFO:teuthology.orchestra.run.smithi012.stdout:2639 trunc from 0x7bc6708 to 0xa71a22d 2024-09-11T05:22:24.301 INFO:teuthology.orchestra.run.smithi012.stdout:2641 punch from 0x163fe46 to 0x16416e5, (0x189f bytes) 2024-09-11T05:22:24.301 INFO:teuthology.orchestra.run.smithi012.stdout:2642 read 0x6e85b4 thru 0x6f2dc1 (0xa80e bytes) 2024-09-11T05:22:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:2643 write 0x12c85f8 thru 0x12d2ff8 (0xaa01 bytes) 2024-09-11T05:22:24.304 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.304 INFO:teuthology.orchestra.run.smithi012.stdout:2646 read 0x74ad5cb thru 0x74bcfce (0xfa04 bytes) 2024-09-11T05:22:24.304 INFO:teuthology.orchestra.run.smithi012.stdout:2647 read 0x93934d2 thru 0x939acc8 (0x77f7 bytes) 2024-09-11T05:22:24.304 INFO:teuthology.orchestra.run.smithi012.stdout:2648 write 0xdeee30 thru 0xdf939a (0xa56b bytes) 2024-09-11T05:22:24.320 INFO:teuthology.orchestra.run.smithi012.stdout:2649 write 0x40c2511 thru 0x40cc78d (0xa27d bytes) 2024-09-11T05:22:24.327 INFO:teuthology.orchestra.run.smithi012.stdout:2650 read 0x4ef4a20 thru 0x4ef9b71 (0x5152 bytes) 2024-09-11T05:22:24.327 INFO:teuthology.orchestra.run.smithi012.stdout:2651 read 0x890aaeb thru 0x890f5fd (0x4b13 bytes) 2024-09-11T05:22:24.327 INFO:teuthology.orchestra.run.smithi012.stdout:2652 punch from 0x68117ed to 0x681c092, (0xa8a5 bytes) 2024-09-11T05:22:24.327 INFO:teuthology.orchestra.run.smithi012.stdout:2654 read 0x794eff thru 0x79c5fd (0x76ff bytes) 2024-09-11T05:22:24.328 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.328 INFO:teuthology.orchestra.run.smithi012.stdout:2657 punch from 0x477a66e to 0x47834e6, (0x8e78 bytes) 2024-09-11T05:22:24.328 INFO:teuthology.orchestra.run.smithi012.stdout:2659 write 0xeb01ad thru 0xebfab6 (0xf90a bytes) 2024-09-11T05:22:24.335 INFO:teuthology.orchestra.run.smithi012.stdout:2661 trunc from 0xa71a22d to 0x4d0a952 2024-09-11T05:22:24.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:24.343+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:24.347 INFO:teuthology.orchestra.run.smithi012.stdout:2662 clone 24 order 25 su 1048576 sc 15 2024-09-11T05:22:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:24.378 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:24.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:24.461+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:24.525 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:24.525 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:24.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:24.545 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:24.545+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:24.605 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:22:24.605 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:22:24.605 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-11T05:22:24.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-09-11T05:22:24.646 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:24.645+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:24.693 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:24.694 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:24.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:24.705 INFO:teuthology.orchestra.run.smithi012.stdout:leaving image image_client.0-clone23 intact 2024-09-11T05:22:24.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:24.745+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:24.811 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:24.811 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:24.820 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:24.824 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-11T05:22:24.850 INFO:teuthology.orchestra.run.smithi012.stdout:2663 writesame 0xd7332cc thru 0xd742e60 data_size 0xb(0xfb95 bytes) 2024-09-11T05:22:24.864 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:24.864+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:24.869 INFO:teuthology.orchestra.run.smithi012.stdout:2664 trunc from 0xd742e61 to 0x25b2174 2024-09-11T05:22:24.909 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:24.910 INFO:teuthology.orchestra.run.smithi012.stdout:2667 punch from 0x2419b3b to 0x2423aa7, (0x9f6c bytes) 2024-09-11T05:22:24.910 INFO:teuthology.orchestra.run.smithi012.stdout:2668 read 0x19bfdec thru 0x19cea7f (0xec94 bytes) 2024-09-11T05:22:24.926 INFO:teuthology.orchestra.run.smithi012.stdout:2669 writesame 0xc11a3fb thru 0xc129db2 data_size 0x83(0xf9b8 bytes) 2024-09-11T05:22:24.927 INFO:teuthology.orchestra.run.smithi012.stdout:2670 write 0x4b99c52 thru 0x4ba3f84 (0xa333 bytes) 2024-09-11T05:22:24.929 INFO:teuthology.orchestra.run.smithi012.stdout:2671 read 0xa3cade2 thru 0xa3ccc0e (0x1e2d bytes) 2024-09-11T05:22:24.936 INFO:teuthology.orchestra.run.smithi012.stdout:2672 write 0xcc783ef thru 0xcc85071 (0xcc83 bytes) 2024-09-11T05:22:24.938 INFO:teuthology.orchestra.run.smithi012.stdout:2673 read 0xc0ad4bd thru 0xc0b59e4 (0x8528 bytes) 2024-09-11T05:22:24.938 INFO:teuthology.orchestra.run.smithi012.stdout:2674 read 0x76ed8fe thru 0x76f66da (0x8ddd bytes) 2024-09-11T05:22:24.939 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:24.939 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:24.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:24.949 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:24.947+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:24.949 INFO:teuthology.orchestra.run.smithi012.stdout:2675 trunc from 0xcc85072 to 0x31871fb 2024-09-11T05:22:24.955 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:22:24.954+0000 7f4182606640 -1 mon.a@0(leader).osd e59 definitely_dead 0 2024-09-11T05:22:24.967 INFO:teuthology.orchestra.run.smithi012.stdout:2676 writesame 0x4cf0925 thru 0x4cfe3c8 data_size 0xe(0xdaa4 bytes) 2024-09-11T05:22:24.968 INFO:teuthology.orchestra.run.smithi012.stdout:2677 read 0x3bf1cc4 thru 0x3c004e2 (0xe81f bytes) 2024-09-11T05:22:24.986 INFO:teuthology.orchestra.run.smithi012.stdout:2680 writesame 0xecf791b thru 0xed01248 data_size 0x7(0x992e bytes) 2024-09-11T05:22:24.987 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.002 INFO:teuthology.orchestra.run.smithi012.stdout:2682 trunc from 0xed01249 to 0x108fcef 2024-09-11T05:22:25.013 INFO:teuthology.orchestra.run.smithi012.stdout:2684 read 0x7eafa2 thru 0x7f1a40 (0x6a9f bytes) 2024-09-11T05:22:25.034 INFO:teuthology.orchestra.run.smithi012.stdout:2685 write 0xe37eefb thru 0xe37f60c (0x712 bytes) 2024-09-11T05:22:25.035 INFO:teuthology.orchestra.run.smithi012.stdout:2686 read 0xd4a0a17 thru 0xd4a6920 (0x5f0a bytes) 2024-09-11T05:22:25.036 INFO:teuthology.orchestra.run.smithi012.stdout:2688 write 0x5774744 thru 0x577ab27 (0x63e4 bytes) 2024-09-11T05:22:25.040 INFO:teuthology.orchestra.run.smithi012.stdout:2691 trunc from 0xe37f60d to 0xb7ba491 2024-09-11T05:22:25.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:25.048+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:25.056 INFO:teuthology.orchestra.run.smithi012.stdout:2692 write 0xd0a72bf thru 0xd0a7d0a (0xa4c bytes) 2024-09-11T05:22:25.057 INFO:teuthology.orchestra.run.smithi012.stdout:2693 read 0x20520ee thru 0x2061a0d (0xf920 bytes) 2024-09-11T05:22:25.058 INFO:teuthology.orchestra.run.smithi012.stdout:2694 punch from 0xad9933c to 0xada723b, (0xdeff bytes) 2024-09-11T05:22:25.058 INFO:teuthology.orchestra.run.smithi012.stdout:2695 read 0x5b535b2 thru 0x5b5bfcb (0x8a1a bytes) 2024-09-11T05:22:25.058 INFO:teuthology.orchestra.run.smithi012.stdout:2696 writesame 0xc452e20 thru 0xc45f5e0 data_size 0x1(0xc7c1 bytes) 2024-09-11T05:22:25.081 INFO:teuthology.orchestra.run.smithi012.stdout:2697 punch from 0x3c89ca1 to 0x3c8bbdb, (0x1f3a bytes) 2024-09-11T05:22:25.085 INFO:teuthology.orchestra.run.smithi012.stdout:2698 trunc from 0xd0a7d0b to 0x96274c4 2024-09-11T05:22:25.093 INFO:teuthology.orchestra.run.smithi012.stdout:2699 read 0x59a616a thru 0x59b2df9 (0xcc90 bytes) 2024-09-11T05:22:25.094 INFO:teuthology.orchestra.run.smithi012.stdout:2700 write 0x64b05a thru 0x659cab (0xec52 bytes) 2024-09-11T05:22:25.096 INFO:teuthology.orchestra.run.smithi012.stdout:2701 punch from 0x4437346 to 0x4439c34, (0x28ee bytes) 2024-09-11T05:22:25.099 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:25.099 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:25.100 INFO:teuthology.orchestra.run.smithi012.stdout:2703 trunc from 0x96274c4 to 0x520ee3a 2024-09-11T05:22:25.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:25.110 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.125 INFO:teuthology.orchestra.run.smithi012.stdout:2707 writesame 0xd7ce0d0 thru 0xd7d6280 data_size 0x5d(0x81b1 bytes) 2024-09-11T05:22:25.126 INFO:teuthology.orchestra.run.smithi012.stdout:2708 read 0xc111a4f thru 0xc1142fc (0x28ae bytes) 2024-09-11T05:22:25.127 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.127 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.127 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.127 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.127 INFO:teuthology.orchestra.run.smithi012.stdout:2715 read 0xd739daa thru 0xd73a828 (0xa7f bytes) 2024-09-11T05:22:25.127 INFO:teuthology.orchestra.run.smithi012.stdout:2716 read 0x7a6c50d thru 0x7a6cfaa (0xa9e bytes) 2024-09-11T05:22:25.128 INFO:teuthology.orchestra.run.smithi012.stdout:2717 read 0x5515b63 thru 0x551e2e4 (0x8782 bytes) 2024-09-11T05:22:25.128 INFO:teuthology.orchestra.run.smithi012.stdout:2718 writesame 0x39e0e2e thru 0x39e6af4 data_size 0x3f(0x5cc7 bytes) 2024-09-11T05:22:25.129 INFO:teuthology.orchestra.run.smithi012.stdout:2720 punch from 0x62b5a11 to 0x62c0c1e, (0xb20d bytes) 2024-09-11T05:22:25.129 INFO:teuthology.orchestra.run.smithi012.stdout:2721 writesame 0x86561ae thru 0x8664422 data_size 0x1(0xe275 bytes) 2024-09-11T05:22:25.153 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:25.153+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:25.157 INFO:teuthology.orchestra.run.smithi012.stdout:2722 punch from 0x6d235e8 to 0x6d28f3c, (0x5954 bytes) 2024-09-11T05:22:25.157 INFO:teuthology.orchestra.run.smithi012.stdout:2723 writesame 0xec18b3 thru 0xecae61 data_size 0x35(0x95af bytes) 2024-09-11T05:22:25.159 INFO:teuthology.orchestra.run.smithi012.stdout:2724 read 0xabc75a6 thru 0xabd6e3a (0xf895 bytes) 2024-09-11T05:22:25.159 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.159 INFO:teuthology.orchestra.run.smithi012.stdout:2726 read 0x5973b8d thru 0x5977a3c (0x3eb0 bytes) 2024-09-11T05:22:25.159 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.159 INFO:teuthology.orchestra.run.smithi012.stdout:2728 writesame 0x69c018c thru 0x69c3cc8 data_size 0xf(0x3b3d bytes) 2024-09-11T05:22:25.161 INFO:teuthology.orchestra.run.smithi012.stdout:2729 write 0x8f2be94 thru 0x8f34213 (0x8380 bytes) 2024-09-11T05:22:25.162 INFO:teuthology.orchestra.run.smithi012.stdout:2730 write 0x4077095 thru 0x407ad17 (0x3c83 bytes) 2024-09-11T05:22:25.164 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:25.164 INFO:teuthology.orchestra.run.smithi012.stdout:2734 punch from 0x1d7f537 to 0x1d8118e, (0x1c57 bytes) 2024-09-11T05:22:25.165 INFO:teuthology.orchestra.run.smithi012.stdout:2735 flatten 2024-09-11T05:22:25.171 INFO:teuthology.orchestra.run.smithi012.stdout:2736 write 0x62e01d6 thru 0x62e9dd3 (0x9bfe bytes) 2024-09-11T05:22:25.173 INFO:teuthology.orchestra.run.smithi012.stdout:2737 punch from 0x3284a1 to 0x32f61a, (0x7179 bytes) 2024-09-11T05:22:25.173 INFO:teuthology.orchestra.run.smithi012.stdout:2740 read 0x35c5748 thru 0x35c7e20 (0x26d9 bytes) 2024-09-11T05:22:25.173 INFO:teuthology.orchestra.run.smithi012.stdout:2741 read 0x236a211 thru 0x2370177 (0x5f67 bytes) 2024-09-11T05:22:25.174 INFO:teuthology.orchestra.run.smithi012.stdout:2742 write 0x73d3bb3 thru 0x73d4f94 (0x13e2 bytes) 2024-09-11T05:22:25.175 INFO:teuthology.orchestra.run.smithi012.stdout:2743 clone 25 order 21 su 524288 sc 9 2024-09-11T05:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:25.216 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:25.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:25.250 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:25.249+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:25.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:25.351 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:25.350+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:25.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:25.389 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:25.389 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:25.406 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:25.423 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:25.439 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:25.439 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:25.452 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:25.451+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:25.456 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:25.456 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:25.474 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:25.486 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.888531277999999, 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:25.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:25.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:25.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.888303782000001, 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:25.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:25.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.888048968, 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.887680072999999, 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:25.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.887518527000001, 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:25.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:25.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.887075792000001, 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:25.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.884928898999998, 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:25.514 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:25.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.882898347000001, 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:25.519 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.520 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:25.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.882877961999998, 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:25.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.665694157000001, 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:25.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.665673132999999, 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.534 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:25.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.665648877999999, 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.663969794, 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.544 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:25.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:25.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:25.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.663950448000001, 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.548 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:25.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:25.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.663929675999999, 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.552 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:25.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.663910265999998, 2024-09-11T05:22:25.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:25.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.663889797, 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.663870907, 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:25.565 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:25.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:25.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.654533113999999, 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:25.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.654522287999999, 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.574 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:25.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:25.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.578 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.579 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.579 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:25.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:25.580 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:25.581 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:25.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:25.582 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:25.580+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:25.582 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:25.619 INFO:teuthology.orchestra.run.smithi012.stderr:marked out osd.7. 2024-09-11T05:22:25.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:22:25.680 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:25.679+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:25.726 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:25.726 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:25.726 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:25.726 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:25.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:25.782 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:25.781+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:25.838 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:25.838 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:25.838 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:25.839 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:25.839 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:25.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:25.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:25.881+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:25.983 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:25.983+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:25.992 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10509 3.10 3:0e4b85b7:::rbd_data.117977dc529b.0000000000000006:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.459476180999999, 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081221729999999999, 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10509 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:25.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532129+0000", 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.052e-06 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532146+0000", 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6931000000000001e-05 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532158+0000", 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2207e-05 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532164+0000", 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2210000000000002e-06 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532223+0000", 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9338e-05 2024-09-11T05:22:25.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532325+0000", 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101656 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.540250+0000", 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079247680000000004 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:25.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10994 3.10 3:0b01f203:::rbd_data.117977dc529b.0000000000000017:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.430602753999999, 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052453930000000001, 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:25.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10994 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:25.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561003+0000", 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.323e-06 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561010+0000", 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6420000000000001e-06 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561029+0000", 2024-09-11T05:22:26.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8564999999999999e-05 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561039+0000", 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0046e-05 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561107+0000", 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7922999999999993e-05 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561253+0000", 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014678200000000001 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.566247+0000", 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049931120000000001 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15377 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.017055839000001, 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039582419999999998, 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15377 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974549+0000", 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3200000000000005e-07 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974551+0000", 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.706e-06 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974559+0000", 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4390000000000003e-06 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974564+0000", 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5249999999999996e-06 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977991+0000", 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003426742 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978091+0000", 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9469000000000006e-05 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978506+0000", 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00041572899999999999 2024-09-11T05:22:26.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15378 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.017031322999998, 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00436718, 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15378 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974575+0000", 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3250000000000002e-06 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974582+0000", 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.951e-06 2024-09-11T05:22:26.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974589+0000", 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0269999999999998e-06 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978537+0000", 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039479529999999997 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978616+0000", 2024-09-11T05:22:26.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8851999999999997e-05 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978940+0000", 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000323572 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15379 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.017007049, 2024-09-11T05:22:26.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045646519999999998, 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15379 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974599+0000", 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2139999999999999e-06 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974615+0000", 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5330999999999999e-05 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974621+0000", 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8069999999999996e-06 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978989+0000", 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043679410000000002 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979086+0000", 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7297e-05 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979161+0000", 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5617000000000005e-05 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15380 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.016974853999997, 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00473859, 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15380 2024-09-11T05:22:26.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4900000000000001e-07 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974636+0000", 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974644+0000", 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4719999999999998e-06 2024-09-11T05:22:26.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974649+0000", 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4210000000000003e-06 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979201+0000", 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045517919999999998 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979287+0000", 2024-09-11T05:22:26.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5981000000000002e-05 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979368+0000", 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0873999999999999e-05 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16758 3.10 3:0ff05fec:::rbd_data.1179c3639760.000000000000000a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:26.020 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.633686032, 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0180985, 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16758 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357923+0000", 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3120000000000001e-06 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357935+0000", 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2104e-05 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357951+0000", 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5818999999999999e-05 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357961+0000", 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5980000000000003e-06 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358021+0000", 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0650999999999999e-05 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358125+0000", 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103479 2024-09-11T05:22:26.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.361575+0000", 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034500619999999998 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375931+0000", 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014355698 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375944+0000", 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3328e-05 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375980+0000", 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5760999999999999e-05 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.376016+0000", 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6687999999999998e-05 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16758 3.10 e32/22 ondisk, result = 0)", 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.623181261999999, 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075142530000000003, 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368424+0000", 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3120000000000001e-06 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368431+0000", 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8129999999999998e-06 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368448+0000", 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6980999999999999e-05 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368458+0000", 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375910+0000", 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074519 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375918+0000", 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9589999999999995e-06 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375937+0000", 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8527999999999999e-05 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16860 3.a 3:55f78c79:::rbd_data.1179c3639760.000000000000000e:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.459795783000001, 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014769262999999999, 2024-09-11T05:22:26.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16860 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531809+0000", 2024-09-11T05:22:26.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531813+0000", 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3730000000000003e-06 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531824+0000", 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0494e-05 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531829+0000", 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1669999999999998e-06 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531878+0000", 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9027999999999999e-05 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531974+0000", 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5874999999999999e-05 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.534209+0000", 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022353020000000002 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546470+0000", 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012260630999999999 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546499+0000", 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9436000000000001e-05 2024-09-11T05:22:26.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546545+0000", 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5445999999999998e-05 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546577+0000", 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2536999999999997e-05 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.037 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16860 3.a e32/22 ondisk, result = 0)", 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.449479935999999, 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044590660000000002, 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:26.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542125+0000", 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.096e-06 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542128+0000", 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0639999999999998e-06 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542139+0000", 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0915e-05 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542148+0000", 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6060000000000003e-06 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546490+0000", 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043424780000000003 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546496+0000", 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0000000000000002e-06 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546583+0000", 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6907e-05 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39459 3.a 3:54bd4aae:::rbd_data.1179ab1e2350.0000000000000015:head [write 0~0] snapc a=[a] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.153057301, 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041154470000000004, 2024-09-11T05:22:26.042 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39459 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2099999999999997e-07 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838550+0000", 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4540000000000001e-06 2024-09-11T05:22:26.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838555+0000", 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838558+0000", 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4709999999999999e-06 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839659+0000", 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011004089999999999 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839734+0000", 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4967000000000002e-05 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839916+0000", 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018229300000000001 2024-09-11T05:22:26.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842435+0000", 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002519257 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842572+0000", 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013645199999999999 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842619+0000", 2024-09-11T05:22:26.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7586000000000001e-05 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842662+0000", 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2879000000000001e-05 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:62325 3.1e e44/43 3:7ca35b74:::rbd_data.1179377e61aa.0000000000000002:head v 44'132, mlcod=0'0)", 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:26.048 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.507015760000002, 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050778849999999999, 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5300000000000001e-07 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484592+0000", 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8e-06 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484602+0000", 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5459999999999997e-06 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484607+0000", 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3800000000000002e-06 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484638+0000", 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1235000000000002e-05 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484653+0000", 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4713e-05 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.489632+0000", 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049786029999999998 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.489666+0000", 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4455000000000001e-05 2024-09-11T05:22:26.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63746 3.10 3:0d130168:::rbd_data.117960679f52.0000000000000042:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,truncate 917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.007662224000001, 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042747189999999997, 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.053 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63746 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3099999999999996e-07 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983947+0000", 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.464e-06 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983957+0000", 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0086e-05 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983963+0000", 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1179999999999997e-06 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984031+0000", 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8106000000000001e-05 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984128+0000", 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6523999999999999e-05 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984261+0000", 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013350699999999999 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.985139+0000", 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00087741999999999996 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988160+0000", 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030213229999999998 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988195+0000", 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5413999999999997e-05 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988216+0000", 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0925999999999999e-05 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64134 3.a 3:5751da01:::rbd_header.117960679f52:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.447493314999999, 2024-09-11T05:22:26.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087579719999999993, 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64134 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544112+0000", 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544118+0000", 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9839999999999998e-06 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544131+0000", 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.343e-05 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544140+0000", 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8729999999999996e-06 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544199+0000", 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8375999999999998e-05 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544204+0000", 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0799999999999996e-06 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.551581+0000", 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073776379999999997 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.551674+0000", 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552026+0000", 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00035214799999999999 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552628+0000", 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060198599999999999 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552809+0000", 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109199999999999 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552840+0000", 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1229000000000002e-05 2024-09-11T05:22:26.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552869+0000", 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8090999999999999e-05 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64494 3.a 3:57baaaa4:::rbd_data.1179fd54a524.000000000000006c:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.176433738, 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013982322, 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64494 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815171+0000", 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3149999999999999e-06 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815178+0000", 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9319999999999999e-06 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815189+0000", 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815195+0000", 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815239+0000", 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4459999999999998e-05 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815331+0000", 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2139999999999995e-05 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.817519+0000", 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021876619999999999 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829065+0000", 2024-09-11T05:22:26.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011545778 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829077+0000", 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2266000000000001e-05 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829114+0000", 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7214e-05 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829152+0000", 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8133999999999998e-05 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64528 3.a 3:57baaaa4:::rbd_data.1179fd54a524.000000000000006c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.122236854000001, 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049568420000000004, 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.070 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64528 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869369+0000", 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5689999999999999e-06 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869375+0000", 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2389999999999999e-06 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869389+0000", 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4303e-05 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869397+0000", 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9270000000000005e-06 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870007+0000", 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00061024400000000002 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870060+0000", 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2630000000000003e-05 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870128+0000", 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7992999999999998e-05 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.871474+0000", 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001346222 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874232+0000", 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027579499999999999 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874286+0000", 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4103e-05 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874324+0000", 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7662e-05 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:70793 3.10 3:096c4687:::rbd_data.1179db619f31.0000000000000011:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 8126464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0620408550000002, 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039886560000000001, 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 70793 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929565+0000", 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929573+0000", 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7260000000000002e-06 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929588+0000", 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5007999999999999e-05 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929597+0000", 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6320000000000003e-06 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929648+0000", 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1175999999999999e-05 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929740+0000", 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1545999999999994e-05 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929849+0000", 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922899999999999 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.930411+0000", 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00056223299999999998 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933483+0000", 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030712040000000001 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933516+0000", 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3751000000000003e-05 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933552+0000", 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5261e-05 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71634 3.10 3:096c4687:::rbd_data.1179db619f31.0000000000000011:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:26.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.8469803680000001, 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018691636000000001, 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71634 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144626+0000", 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2019999999999998e-06 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144635+0000", 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.662e-06 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144654+0000", 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9086999999999999e-05 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144664+0000", 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0003000000000001e-05 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144729+0000", 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4789000000000006e-05 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144797+0000", 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7335999999999994e-05 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.147776+0000", 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002978938 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163184+0000", 2024-09-11T05:22:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015408597 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163202+0000", 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7907e-05 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163263+0000", 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1122000000000002e-05 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163315+0000", 2024-09-11T05:22:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1993000000000002e-05 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:71634 3.10 e57/45 ondisk, result = 0)", 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.835211631, 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068001270000000004, 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156393+0000", 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1480000000000001e-06 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156400+0000", 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7329999999999997e-06 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156415+0000", 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4554e-05 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156424+0000", 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4239999999999999e-06 2024-09-11T05:22:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163165+0000", 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067404370000000002 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163176+0000", 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1603000000000001e-05 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163192+0000", 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6228000000000001e-05 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71952 3.a 3:50a56b0b:::rbd_data.1179db619f31.0000000000000002:head [stat,truncate 7995392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.542047+0000", 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.449556775, 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042337670000000003, 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71952 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542047+0000", 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542047+0000", 2024-09-11T05:22:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542049+0000", 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.827e-06 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542054+0000", 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1229999999999999e-06 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542068+0000", 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4319e-05 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542077+0000", 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5900000000000008e-06 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542730+0000", 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000652825 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542826+0000", 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6382e-05 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.543447+0000", 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062088499999999995 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.545975+0000", 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025279320000000001 2024-09-11T05:22:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.546167+0000", 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019202499999999999 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.546228+0000", 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0809e-05 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.546281+0000", 2024-09-11T05:22:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3050000000000002e-05 2024-09-11T05:22:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.100 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:26.101 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:26.102 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:26.101+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:26.202 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:26.202+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:26.246 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:26.246 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:26.246 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:26.246 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:26.255 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:26.303 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:26.302+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:26.398 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:26.398 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:26.399 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:26.399 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:26.399 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:26.404 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:26.404+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:26.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:26.505 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:26.505+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:26.553 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.802030520999999, 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:26.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:26.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:26.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798951959, 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.561 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:26.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:26.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798934658999997, 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.566 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798908623999999, 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.571 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798892398, 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.576 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:26.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798869942000003, 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:26.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.584 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798835863000001, 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.585 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:26.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798798241999997, 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:26.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.594 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798233402000001, 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:26.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.798184304000003, 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.599 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.603 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.513529226000003, 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:26.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.513509608, 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.608 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:26.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.510919553999997, 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.613 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.510489411999998, 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.618 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:26.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.510454992, 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.623 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:26.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:26.627 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.459364678, 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.388913061, 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.632 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63898 3.11 3:89620d31:::rbd_data.117960679f52.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.431843130000001, 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709826999999999, 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63898 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120804+0000", 2024-09-11T05:22:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120808+0000", 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120817+0000", 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120821+0000", 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120858+0000", 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6863999999999998e-05 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120951+0000", 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2541999999999996e-05 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.124305+0000", 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00335389 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140413+0000", 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016108245 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140444+0000", 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1578000000000002e-05 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140482+0000", 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140513+0000", 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1477999999999999e-05 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:70954 3.14 e57/22 3:2fcfd35d:::rbd_data.1179db619f31.0000000000000009:head v 57'288, mlcod=56'286)", 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.5870779089999996, 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023605603999999999, 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965570+0000", 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7630000000000001e-06 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971434+0000", 2024-09-11T05:22:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058634300000000002 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971457+0000", 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3436999999999999e-05 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971471+0000", 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3776e-05 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971538+0000", 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7074000000000002e-05 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971565+0000", 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6914e-05 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989115+0000", 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017549754000000001 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989174+0000", 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9456000000000001e-05 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71938 3.f 3:f110c0b8:::rbd_data.1179db619f31.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.0528994569999997, 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027012653000000001, 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71938 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499748+0000", 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499752+0000", 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499762+0000", 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7610000000000002e-06 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499767+0000", 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.118e-06 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499813+0000", 2024-09-11T05:22:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6168999999999998e-05 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499871+0000", 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8394999999999999e-05 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.503877+0000", 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040059290000000001 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526608+0000", 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022730899999999998 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526628+0000", 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9556e-05 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526686+0000", 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7839e-05 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526760+0000", 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4146000000000005e-05 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:26.653 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:22:26.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:26.653+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:26.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:26.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:26.754+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:26.811 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:26.811 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:26.811 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:26.811 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:26.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:26.856 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:26.856+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:26.957 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:26.957+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:26.969 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:26.969 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:26.969 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:26.969 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:26.969 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:26.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:27.058 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:27.057+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:27.086 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:27.086 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:27.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13638 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.305981199000001, 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025061597000000001, 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13638 2024-09-11T05:22:27.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779410+0000", 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779416+0000", 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9909999999999999e-06 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779421+0000", 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0209999999999999e-06 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804340+0000", 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024918549000000002 2024-09-11T05:22:27.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804406+0000", 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6568000000000004e-05 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804469+0000", 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2989000000000003e-05 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13643 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.305942657000003, 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025233829999999999, 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13643 2024-09-11T05:22:27.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779447+0000", 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.75e-07 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779449+0000", 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779455+0000", 2024-09-11T05:22:27.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1500000000000004e-06 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779461+0000", 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1260000000000003e-06 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804514+0000", 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025052479999999999 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804583+0000", 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9029000000000006e-05 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804680+0000", 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7545000000000002e-05 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13652 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 294912~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:27.096 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.305846428999999, 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025318401000000001, 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13652 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779545+0000", 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.891e-06 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779551+0000", 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9549999999999997e-06 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779556+0000", 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7110000000000003e-06 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804709+0000", 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025153117999999999 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804776+0000", 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6981000000000001e-05 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804861+0000", 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5323999999999998e-05 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.100 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13921 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1589248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297962466000001, 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025139273, 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13921 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:27.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787429+0000", 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0760000000000001e-06 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787437+0000", 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9440000000000005e-06 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787442+0000", 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4269999999999999e-06 2024-09-11T05:22:27.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812415+0000", 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024972437 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812485+0000", 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0278999999999996e-05 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812566+0000", 2024-09-11T05:22:27.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0607999999999998e-05 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13925 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1687552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297915908999997, 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025253827999999999, 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13925 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787474+0000", 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787483+0000", 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4499999999999993e-06 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787492+0000", 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1360000000000003e-06 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787498+0000", 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5709999999999997e-06 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812594+0000", 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025096207999999998 2024-09-11T05:22:27.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812660+0000", 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6450000000000002e-05 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812727+0000", 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6470999999999994e-05 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13928 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1867776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297826198000003, 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025330478, 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13928 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787565+0000", 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787573+0000", 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7239999999999992e-06 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787578+0000", 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3399999999999997e-06 2024-09-11T05:22:27.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812757+0000", 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025178493999999999 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812820+0000", 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2948999999999996e-05 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812893+0000", 2024-09-11T05:22:27.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3484000000000003e-05 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13937 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297775078999997, 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025471521, 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13937 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:27.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1200000000000003e-07 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787617+0000", 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3999999999999999e-06 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787624+0000", 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4869999999999996e-06 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787630+0000", 2024-09-11T05:22:27.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812924+0000", 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025294265999999999 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812992+0000", 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7691e-05 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813085+0000", 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3604999999999996e-05 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13942 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 131072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297717980999998, 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025635227, 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13942 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7300000000000001e-07 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787673+0000", 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787680+0000", 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1600000000000001e-06 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787686+0000", 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.434e-06 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813152+0000", 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025466329999999999 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813216+0000", 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4162e-05 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813306+0000", 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9821000000000006e-05 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13956 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297584127, 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025691571, 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13956 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787806+0000", 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4799999999999998e-07 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787816+0000", 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0158e-05 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787825+0000", 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5140000000000007e-06 2024-09-11T05:22:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787832+0000", 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4779999999999996e-06 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813341+0000", 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025509245 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813410+0000", 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-05 2024-09-11T05:22:27.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813496+0000", 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428000000000007e-05 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13967 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297547442000003, 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02584034, 2024-09-11T05:22:27.126 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13967 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787845+0000", 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787852+0000", 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4479999999999997e-06 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787858+0000", 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6930000000000004e-06 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813529+0000", 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025671619999999999 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813601+0000", 2024-09-11T05:22:27.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1988000000000003e-05 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813682+0000", 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0479e-05 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13970 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:27.130 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297523921, 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025988694, 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13970 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787866+0000", 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7399999999999998e-07 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787868+0000", 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0880000000000002e-06 2024-09-11T05:22:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787874+0000", 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3670000000000002e-06 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787879+0000", 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1850000000000003e-06 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813706+0000", 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025827096000000001 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813777+0000", 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0894000000000003e-05 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813854+0000", 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6589999999999997e-05 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13977 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 589824~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297456334000003, 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026082164000000001, 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13977 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.135 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3499999999999996e-07 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787935+0000", 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.221e-06 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787942+0000", 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787947+0000", 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813878+0000", 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025930385 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813939+0000", 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0980000000000002e-05 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814015+0000", 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6143000000000006e-05 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.138 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13980 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.297434647999999, 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026221787999999999, 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13980 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787955+0000", 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787957+0000", 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0339999999999999e-06 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787964+0000", 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7830000000000001e-06 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787969+0000", 2024-09-11T05:22:27.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2660000000000001e-06 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814039+0000", 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026070336 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814099+0000", 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0109000000000003e-05 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814176+0000", 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6903999999999994e-05 2024-09-11T05:22:27.142 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15857 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.044123876, 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025310777999999999, 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15857 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041266+0000", 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041268+0000", 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-06 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041274+0000", 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041278+0000", 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6240000000000001e-06 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066166+0000", 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024887713999999998 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066250+0000", 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3984000000000001e-05 2024-09-11T05:22:27.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066576+0000", 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000325927 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15858 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.044105023, 2024-09-11T05:22:27.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025727013, 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15858 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:27.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9799999999999999e-07 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041286+0000", 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9240000000000001e-06 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041292+0000", 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6289999999999998e-06 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041296+0000", 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5410000000000002e-06 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066624+0000", 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025327692999999998 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066719+0000", 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5425000000000002e-05 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.067011+0000", 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00029150299999999998 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.151 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59621 3.18 e40/22 3:1e993c26:::rbd_data.117971c15f82.0000000000000000:head v 40'416, mlcod=40'414)", 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.923232115000001, 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029790078000000001, 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162160+0000", 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9809999999999999e-06 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165939+0000", 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003779634 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165978+0000", 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8043000000000002e-05 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165988+0000", 2024-09-11T05:22:27.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0624e-05 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166085+0000", 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6847000000000003e-05 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166115+0000", 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9808e-05 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191879+0000", 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025764502000000002 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191947+0000", 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7638999999999994e-05 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:70775 3.6 3:65762739:::rbd_data.1179db619f31.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write 2818048~7771] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.882622+0000", 2024-09-11T05:22:27.156 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.2027666330000004, 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.035692379000000003, 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 70775 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.882622+0000", 2024-09-11T05:22:27.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.882622+0000", 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.882625+0000", 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1519999999999999e-06 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887220+0000", 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045957560000000003 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887248+0000", 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.745e-05 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887258+0000", 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0370000000000001e-05 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887326+0000", 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8295999999999998e-05 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887470+0000", 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014390099999999999 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 1", 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887874+0000", 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040378700000000002 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.917693+0000", 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029818824000000001 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918201+0000", 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00050767499999999997 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918261+0000", 2024-09-11T05:22:27.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0281000000000001e-05 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918315+0000", 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3887000000000001e-05 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70773 3.3 e57/22 3:c60eec4f:::rbd_data.1179db619f31.0000000000000004:head v 57'217, mlcod=57'215)", 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.887299+0000", 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.1980896110000003, 2024-09-11T05:22:27.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.030944784999999999, 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887299+0000", 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887299+0000", 2024-09-11T05:22:27.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887301+0000", 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7239999999999999e-06 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896759+0000", 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0094576279999999992 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896782+0000", 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3281999999999998e-05 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896796+0000", 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4312e-05 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896876+0000", 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9691000000000007e-05 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896905+0000", 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8768999999999998e-05 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918202+0000", 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.021297439000000001 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918244+0000", 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1940000000000002e-05 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.166 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:71631 3.17 3:ea4c733a:::rbd_data.1179db619f31.0000000000000016:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:22.115472+0000", 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9699172149999997, 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.027146791, 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 71631 2024-09-11T05:22:27.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115472+0000", 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115472+0000", 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115474+0000", 2024-09-11T05:22:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.013e-06 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115488+0000", 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4527e-05 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115505+0000", 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6634e-05 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115512+0000", 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2409999999999998e-06 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115572+0000", 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9478999999999998e-05 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115625+0000", 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3134999999999999e-05 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:22:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.119712+0000", 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0040874819999999999 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142512+0000", 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.022799699999999999 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142546+0000", 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4085000000000003e-05 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142582+0000", 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5914999999999997e-05 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142619+0000", 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6579999999999999e-05 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:71750 3.6 3:63df049b:::rbd_data.1179db619f31.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:22.270726+0000", 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.8146631410000005, 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02550142, 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 71750 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.173 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270726+0000", 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270726+0000", 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270728+0000", 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2819999999999999e-06 2024-09-11T05:22:27.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270738+0000", 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9990000000000003e-06 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270755+0000", 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6946999999999999e-05 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270765+0000", 2024-09-11T05:22:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5740000000000002e-06 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270829+0000", 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4330000000000002e-05 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270903+0000", 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4196000000000006e-05 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 1", 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.276275+0000", 2024-09-11T05:22:27.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0053713579999999997 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296102+0000", 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.019827318 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296155+0000", 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3567999999999999e-05 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296194+0000", 2024-09-11T05:22:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8433999999999998e-05 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296227+0000", 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3414000000000002e-05 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.178 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:27.180 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:27.180 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:27.179+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:27.281 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:27.280+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:27.328 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:27.328 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:27.328 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:27.328 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:27.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:27.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:27.419+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:27.483 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:27.482+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:27.483 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:27.483 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:27.483 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:27.483 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:27.483 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:27.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:27.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:27.582+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:27.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13285 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1032192~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893181347000002, 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011665867, 2024-09-11T05:22:27.651 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13285 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755756+0000", 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.225e-06 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755763+0000", 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4509999999999997e-06 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755768+0000", 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9389999999999996e-06 2024-09-11T05:22:27.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767311+0000", 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011543589999999999 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767359+0000", 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7320000000000001e-05 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767418+0000", 2024-09-11T05:22:27.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9902999999999999e-05 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13288 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1490944~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893158663999998, 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011792074, 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13288 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755776+0000", 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2199999999999999e-07 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755778+0000", 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:22:27.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755785+0000", 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7000000000000008e-06 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755790+0000", 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0769999999999998e-06 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767439+0000", 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011648067 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767496+0000", 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7098000000000001e-05 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767567+0000", 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.660 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13298 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1949696~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893136736999999, 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011903945000000001, 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.661 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13298 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755798+0000", 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2e-07 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755800+0000", 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.934e-06 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755806+0000", 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2899999999999999e-06 2024-09-11T05:22:27.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755811+0000", 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8210000000000001e-06 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767588+0000", 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011776963999999999 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767636+0000", 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8304999999999999e-05 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767701+0000", 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5210999999999996e-05 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13305 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 2048000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.665 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893117253, 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996071000000001, 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13305 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:22:27.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755819+0000", 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.888e-06 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755825+0000", 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9190000000000004e-06 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755830+0000", 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5740000000000003e-06 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767722+0000", 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011891273000000001 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767769+0000", 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7144000000000001e-05 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767813+0000", 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3863000000000003e-05 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13308 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1769472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893095586999998, 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012084722000000001, 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13308 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755839+0000", 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755841+0000", 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755847+0000", 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1859999999999997e-06 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755852+0000", 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767833+0000", 2024-09-11T05:22:27.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011981331 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767880+0000", 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6350000000000002e-05 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767923+0000", 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3568e-05 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13314 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1769472~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893076035, 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012198718000000001, 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13314 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.675 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755860+0000", 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7719999999999999e-06 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755867+0000", 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9260000000000003e-06 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755872+0000", 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767948+0000", 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012076643 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767995+0000", 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6461999999999997e-05 2024-09-11T05:22:27.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768057+0000", 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1846000000000004e-05 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13322 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893047903999999, 2024-09-11T05:22:27.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012296951, 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13322 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:27.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755889+0000", 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755896+0000", 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8560000000000001e-06 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755901+0000", 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1019999999999996e-06 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768078+0000", 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012177248999999999 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768126+0000", 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929000000000001e-05 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768183+0000", 2024-09-11T05:22:27.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7005000000000001e-05 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13325 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.893025975999997, 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01241014, 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13325 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:27.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755924+0000", 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5636000000000001e-05 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755931+0000", 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9500000000000004e-06 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755936+0000", 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1120000000000004e-06 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768203+0000", 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012267072 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768254+0000", 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0766000000000001e-05 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768318+0000", 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4233000000000007e-05 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.688 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13333 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 573440~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.892278955000002, 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011798149000000001, 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13333 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756656+0000", 2024-09-11T05:22:27.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4099999999999998e-07 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756659+0000", 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6219999999999998e-06 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756668+0000", 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5210000000000002e-06 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756674+0000", 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8130000000000001e-06 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768339+0000", 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011665310999999999 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768391+0000", 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2179000000000003e-05 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768453+0000", 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2062000000000003e-05 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13341 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891536025999997, 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011660811, 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13341 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757398+0000", 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8299999999999997e-07 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757402+0000", 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3100000000000001e-06 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757411+0000", 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6460000000000005e-06 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757417+0000", 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6579999999999999e-06 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768876+0000", 2024-09-11T05:22:27.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011459186999999999 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768958+0000", 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1736999999999993e-05 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769059+0000", 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010079 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13343 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891509095000004, 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011833961, 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13343 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757428+0000", 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757437+0000", 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:22:27.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757443+0000", 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769090+0000", 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011647014000000001 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769166+0000", 2024-09-11T05:22:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5998e-05 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769259+0000", 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2699000000000001e-05 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13344 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1818624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891483780999998, 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996009, 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13344 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:27.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757451+0000", 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6699999999999999e-07 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757453+0000", 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757462+0000", 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1649999999999995e-06 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757467+0000", 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4890000000000003e-06 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769291+0000", 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011823422 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769370+0000", 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8658999999999993e-05 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769446+0000", 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6604e-05 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.706 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13348 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891446500000001, 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.016500531999999998, 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.707 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13348 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757488+0000", 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.82e-07 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757491+0000", 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8080000000000001e-06 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757502+0000", 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1245e-05 2024-09-11T05:22:27.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757510+0000", 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0669999999999992e-06 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769949+0000", 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012439131000000001 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770026+0000", 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6464000000000005e-05 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.773988+0000", 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039622349999999997 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13351 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:27.711 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891415008999999, 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012814249, 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13351 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.75e-07 2024-09-11T05:22:27.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757522+0000", 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1739999999999999e-06 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757531+0000", 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8519999999999999e-06 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757539+0000", 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.763e-06 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770160+0000", 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012621267 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770234+0000", 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3619000000000001e-05 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770333+0000", 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9098999999999994e-05 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13353 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891385126000003, 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012966811999999999, 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13353 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757552+0000", 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3209999999999999e-06 2024-09-11T05:22:27.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757559+0000", 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2779999999999996e-06 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757564+0000", 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770358+0000", 2024-09-11T05:22:27.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012793617 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770426+0000", 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8201000000000007e-05 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770516+0000", 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9889000000000006e-05 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13409 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 49152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891350406999997, 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013098782999999999, 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13409 2024-09-11T05:22:27.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757588+0000", 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1609999999999996e-06 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757598+0000", 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5189999999999998e-06 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757604+0000", 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770540+0000", 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012935854 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770605+0000", 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5505000000000004e-05 2024-09-11T05:22:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770682+0000", 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7296e-05 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13413 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891321001000001, 2024-09-11T05:22:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013233299, 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13413 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:27.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757616+0000", 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1270000000000001e-06 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757624+0000", 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4470000000000006e-06 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757629+0000", 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2220000000000001e-06 2024-09-11T05:22:27.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770705+0000", 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013075646 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770770+0000", 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4678000000000007e-05 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770846+0000", 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6723000000000004e-05 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13419 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.891297496999996, 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013374044, 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.730 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13419 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757637+0000", 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757639+0000", 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9e-06 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757649+0000", 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7909999999999999e-06 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757654+0000", 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.378e-06 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770870+0000", 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013215873 2024-09-11T05:22:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770935+0000", 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4887000000000004e-05 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.771010+0000", 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5778999999999994e-05 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:59624 3.19 3:9b48071f:::rbd_data.117971c15f82.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 23.486249790999999, 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.032257185000000001, 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:27.735 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 59624 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162689+0000", 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165796+0000", 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031078490000000002 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165845+0000", 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8242000000000003e-05 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165867+0000", 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2005e-05 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165990+0000", 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012330199999999999 2024-09-11T05:22:27.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166150+0000", 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016035999999999999 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166799+0000", 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064827299999999999 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:27.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191931+0000", 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025131982000000001 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194856+0000", 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002925825 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194897+0000", 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0252e-05 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194941+0000", 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4746000000000002e-05 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70775 3.6 e57/22 3:65762739:::rbd_data.1179db619f31.0000000000000005:head v 57'258, mlcod=57'256)", 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.7606065419999997, 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029681609000000001, 2024-09-11T05:22:27.741 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888329+0000", 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.75e-06 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893284+0000", 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049547510000000003 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893317+0000", 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2780000000000001e-05 2024-09-11T05:22:27.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893327+0000", 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.893e-06 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893386+0000", 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9367999999999998e-05 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:27.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893414+0000", 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8028999999999999e-05 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.917939+0000", 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024524607 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918009+0000", 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0431000000000004e-05 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.745 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.746 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:27.746 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:27.746 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:27.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:27.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:27.746+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:27.773 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:27.801 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:27.801 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:27.827 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:27.827 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:27.848 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:27.847+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:27.849 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:27.849 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:27.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:27.871 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:27.894 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:27.894 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:27.928 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:27.928 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:27.932 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:27.933 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:27.936 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-11T05:22:27.946 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:27.948 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:27.948+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:28.048 INFO:teuthology.orchestra.run.smithi012.stdout:2745 write 0x856bbe2 thru 0x857072c (0x4b4b bytes) 2024-09-11T05:22:28.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:28.048+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:28.056 INFO:teuthology.orchestra.run.smithi012.stdout:2746 write 0x89a8569 thru 0x89b006d (0x7b05 bytes) 2024-09-11T05:22:28.061 INFO:teuthology.orchestra.run.smithi012.stdout:2748 trunc from 0xd7d6281 to 0xab35a30 2024-09-11T05:22:28.082 INFO:teuthology.orchestra.run.smithi012.stdout:2749 read 0x5c3dfb2 thru 0x5c42460 (0x44af bytes) 2024-09-11T05:22:28.090 INFO:teuthology.orchestra.run.smithi012.stdout:2750 writesame 0xbfeb1a6 thru 0xbff96e4 data_size 0x1(0xe53f bytes) 2024-09-11T05:22:28.093 INFO:teuthology.orchestra.run.smithi012.stdout:2752 trunc from 0xbff96e5 to 0xe7fe43c 2024-09-11T05:22:28.104 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:28.104 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:28.113 INFO:teuthology.orchestra.run.smithi012.stdout:2753 trunc from 0xe7fe43c to 0x2131861 2024-09-11T05:22:28.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:28.140 INFO:teuthology.orchestra.run.smithi012.stdout:2755 punch from 0xf2f678 to 0xf2f7a0, (0x128 bytes) 2024-09-11T05:22:28.140 INFO:teuthology.orchestra.run.smithi012.stdout:2758 punch from 0xb5258b to 0xb5f24d, (0xccc2 bytes) 2024-09-11T05:22:28.140 INFO:teuthology.orchestra.run.smithi012.stdout:2759 punch from 0x667da1 to 0x66f4bb, (0x771a bytes) 2024-09-11T05:22:28.142 INFO:teuthology.orchestra.run.smithi012.stdout:2761 trunc from 0x2131861 to 0x164899 2024-09-11T05:22:28.162 INFO:teuthology.orchestra.run.smithi012.stdout:2762 punch from 0xe1a4f to 0xf067c, (0xec2d bytes) 2024-09-11T05:22:28.162 INFO:teuthology.orchestra.run.smithi012.stdout:2763 read 0xd15af thru 0xd7e58 (0x68aa bytes) 2024-09-11T05:22:28.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:28.161+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:28.163 INFO:teuthology.orchestra.run.smithi012.stdout:2764 punch from 0x158656 to 0x164899, (0xc243 bytes) 2024-09-11T05:22:28.163 INFO:teuthology.orchestra.run.smithi012.stdout:2765 punch from 0x15f03c to 0x164899, (0x585d bytes) 2024-09-11T05:22:28.174 INFO:teuthology.orchestra.run.smithi012.stdout:2766 writesame 0x53e05ec thru 0x53ec210 data_size 0xa9(0xbc25 bytes) 2024-09-11T05:22:28.174 INFO:teuthology.orchestra.run.smithi012.stdout:2768 read 0x1b8a9b7 thru 0x1b99bb4 (0xf1fe bytes) 2024-09-11T05:22:28.175 INFO:teuthology.orchestra.run.smithi012.stdout:2769 write 0x29fd2b0 thru 0x2a01568 (0x42b9 bytes) 2024-09-11T05:22:28.178 INFO:teuthology.orchestra.run.smithi012.stdout:2770 write 0x1f1484a thru 0x1f1cd6a (0x8521 bytes) 2024-09-11T05:22:28.181 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.181 INFO:teuthology.orchestra.run.smithi012.stdout:2773 write 0x467c9f0 thru 0x4685cd6 (0x92e7 bytes) 2024-09-11T05:22:28.185 INFO:teuthology.orchestra.run.smithi012.stdout:2774 read 0x1159dd4 thru 0x115dd22 (0x3f4f bytes) 2024-09-11T05:22:28.185 INFO:teuthology.orchestra.run.smithi012.stdout:2775 punch from 0x4018e67 to 0x401e2e2, (0x547b bytes) 2024-09-11T05:22:28.185 INFO:teuthology.orchestra.run.smithi012.stdout:2776 read 0x174cc5 thru 0x180556 (0xb892 bytes) 2024-09-11T05:22:28.197 INFO:teuthology.orchestra.run.smithi012.stdout:2777 write 0xa4ea23f thru 0xa4f2692 (0x8454 bytes) 2024-09-11T05:22:28.200 INFO:teuthology.orchestra.run.smithi012.stdout:2778 writesame 0x4b7686f thru 0x4b8625f data_size 0x43(0xf9f1 bytes) 2024-09-11T05:22:28.205 INFO:teuthology.orchestra.run.smithi012.stdout:2779 punch from 0x75eed5 to 0x769059, (0xa184 bytes) 2024-09-11T05:22:28.205 INFO:teuthology.orchestra.run.smithi012.stdout:2780 punch from 0x6df6e6e to 0x6e04c93, (0xde25 bytes) 2024-09-11T05:22:28.205 INFO:teuthology.orchestra.run.smithi012.stdout:2781 read 0x3c7965f thru 0x3c84953 (0xb2f5 bytes) 2024-09-11T05:22:28.205 INFO:teuthology.orchestra.run.smithi012.stdout:2782 read 0x2cdefc0 thru 0x2cebe09 (0xce4a bytes) 2024-09-11T05:22:28.205 INFO:teuthology.orchestra.run.smithi012.stdout:2784 read 0x61fc20a thru 0x61fc5c4 (0x3bb bytes) 2024-09-11T05:22:28.205 INFO:teuthology.orchestra.run.smithi012.stdout:2785 write 0x18abb2f thru 0x18b9443 (0xd915 bytes) 2024-09-11T05:22:28.208 INFO:teuthology.orchestra.run.smithi012.stdout:2787 read 0x580489c thru 0x5811b50 (0xd2b5 bytes) 2024-09-11T05:22:28.208 INFO:teuthology.orchestra.run.smithi012.stdout:2789 write 0x96ac775 thru 0x96b5c54 (0x94e0 bytes) 2024-09-11T05:22:28.220 INFO:teuthology.orchestra.run.smithi012.stdout:2790 write 0xdb28c34 thru 0xdb335b3 (0xa980 bytes) 2024-09-11T05:22:28.224 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.224 INFO:teuthology.orchestra.run.smithi012.stdout:2792 punch from 0x39a8b6b to 0x39ad37d, (0x4812 bytes) 2024-09-11T05:22:28.224 INFO:teuthology.orchestra.run.smithi012.stdout:2793 punch from 0x1d41c12 to 0x1d4def0, (0xc2de bytes) 2024-09-11T05:22:28.224 INFO:teuthology.orchestra.run.smithi012.stdout:2794 writesame 0xa9bedcf thru 0xa9cd0df data_size 0x1(0xe311 bytes) 2024-09-11T05:22:28.251 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:28.250+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:28.254 INFO:teuthology.orchestra.run.smithi012.stdout:2795 writesame 0x40a4b99 thru 0x40a778f data_size 0x1(0x2bf7 bytes) 2024-09-11T05:22:28.263 INFO:teuthology.orchestra.run.smithi012.stdout:2796 writesame 0x564ab70 thru 0x564dc71 data_size 0x12(0x3102 bytes) 2024-09-11T05:22:28.265 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:28.265 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:28.267 INFO:teuthology.orchestra.run.smithi012.stdout:2797 writesame 0x29466a0 thru 0x2947ce6 data_size 0x1(0x1647 bytes) 2024-09-11T05:22:28.271 INFO:teuthology.orchestra.run.smithi012.stdout:2798 writesame 0x25e2aef thru 0x25e41a0 data_size 0x23(0x16b2 bytes) 2024-09-11T05:22:28.273 INFO:teuthology.orchestra.run.smithi012.stdout:2799 flatten 2024-09-11T05:22:28.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:28.278 INFO:teuthology.orchestra.run.smithi012.stdout:2801 writesame 0xbae09b thru 0xbb936c data_size 0x2f(0xb2d2 bytes) 2024-09-11T05:22:28.282 INFO:teuthology.orchestra.run.smithi012.stdout:2802 write 0x889e1f5 thru 0x889e371 (0x17d bytes) 2024-09-11T05:22:28.285 INFO:teuthology.orchestra.run.smithi012.stdout:2804 write 0x68cee58 thru 0x68d4d30 (0x5ed9 bytes) 2024-09-11T05:22:28.289 INFO:teuthology.orchestra.run.smithi012.stdout:2805 punch from 0x5edac7a to 0x5ee2d75, (0x80fb bytes) 2024-09-11T05:22:28.289 INFO:teuthology.orchestra.run.smithi012.stdout:2807 punch from 0x13f727f to 0x13fc74e, (0x54cf bytes) 2024-09-11T05:22:28.289 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.289 INFO:teuthology.orchestra.run.smithi012.stdout:2810 writesame 0x4b02759 thru 0x4b0d716 data_size 0x1(0xafbe bytes) 2024-09-11T05:22:28.314 INFO:teuthology.orchestra.run.smithi012.stdout:2816 read 0x44cdeae thru 0x44d72d4 (0x9427 bytes) 2024-09-11T05:22:28.314 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.314 INFO:teuthology.orchestra.run.smithi012.stdout:2820 read 0x2973fb0 thru 0x297eaa8 (0xaaf9 bytes) 2024-09-11T05:22:28.314 INFO:teuthology.orchestra.run.smithi012.stdout:2821 punch from 0x46540ae to 0x4663612, (0xf564 bytes) 2024-09-11T05:22:28.314 INFO:teuthology.orchestra.run.smithi012.stdout:2822 writesame 0x488e65b thru 0x48923b2 data_size 0x34(0x3d58 bytes) 2024-09-11T05:22:28.329 INFO:teuthology.orchestra.run.smithi012.stdout:2823 trunc from 0xdb335b4 to 0x26a5ec2 2024-09-11T05:22:28.353 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:28.353+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:28.355 INFO:teuthology.orchestra.run.smithi012.stdout:2824 writesame 0x8a814b5 thru 0x8a898ac data_size 0x52(0x83f8 bytes) 2024-09-11T05:22:28.362 INFO:teuthology.orchestra.run.smithi012.stdout:2825 trunc from 0x8a898ad to 0x22114a7 2024-09-11T05:22:28.381 INFO:teuthology.orchestra.run.smithi012.stdout:2826 write 0x311fcaa thru 0x3128a2d (0x8d84 bytes) 2024-09-11T05:22:28.386 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.386 INFO:teuthology.orchestra.run.smithi012.stdout:2828 write 0xd75a64 thru 0xd82e38 (0xd3d5 bytes) 2024-09-11T05:22:28.404 INFO:teuthology.orchestra.run.smithi012.stdout:2829 write 0x8e9b513 thru 0x8e9ed00 (0x37ee bytes) 2024-09-11T05:22:28.407 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:28.407 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:28.408 INFO:teuthology.orchestra.run.smithi012.stdout:2831 writesame 0x8af3b91 thru 0x8af6922 data_size 0x2(0x2d92 bytes) 2024-09-11T05:22:28.417 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:28.428 INFO:teuthology.orchestra.run.smithi012.stdout:2832 write 0xed3ded5 thru 0xed4c85b (0xe987 bytes) 2024-09-11T05:22:28.431 INFO:teuthology.orchestra.run.smithi012.stdout:2833 punch from 0x883834a to 0x883b7e3, (0x3499 bytes) 2024-09-11T05:22:28.431 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.431 INFO:teuthology.orchestra.run.smithi012.stdout:2835 writesame 0x37b3be4 thru 0x37be1d4 data_size 0x1(0xa5f1 bytes) 2024-09-11T05:22:28.454 INFO:teuthology.orchestra.run.smithi012.stdout:2836 writesame 0x29b3aec thru 0x29bd0aa data_size 0x55(0x95bf bytes) 2024-09-11T05:22:28.454 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:28.454+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:28.457 INFO:teuthology.orchestra.run.smithi012.stdout:2838 writesame 0x1d08c0f thru 0x1d18b20 data_size 0x3(0xff12 bytes) 2024-09-11T05:22:28.467 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.467 INFO:teuthology.orchestra.run.smithi012.stdout:2840 punch from 0xaa64d6b to 0xaa724cf, (0xd764 bytes) 2024-09-11T05:22:28.478 INFO:teuthology.orchestra.run.smithi012.stdout:2841 trunc from 0xed4c85c to 0x55c6869 2024-09-11T05:22:28.500 INFO:teuthology.orchestra.run.smithi012.stdout:2842 writesame 0x82b38b5 thru 0x82c3398 data_size 0x2(0xfae4 bytes) 2024-09-11T05:22:28.500 INFO:teuthology.orchestra.run.smithi012.stdout:2843 punch from 0x5f8f38a to 0x5f923da, (0x3050 bytes) 2024-09-11T05:22:28.500 INFO:teuthology.orchestra.run.smithi012.stdout:2844 punch from 0x7ad071d to 0x7ada9f9, (0xa2dc bytes) 2024-09-11T05:22:28.500 INFO:teuthology.orchestra.run.smithi012.stdout:2845 read 0x178e98d thru 0x1798d5f (0xa3d3 bytes) 2024-09-11T05:22:28.500 INFO:teuthology.orchestra.run.smithi012.stdout:2846 write 0x3770a69 thru 0x377afd2 (0xa56a bytes) 2024-09-11T05:22:28.503 INFO:teuthology.orchestra.run.smithi012.stdout:2847 read 0x4ad661e thru 0x4ae2b3a (0xc51d bytes) 2024-09-11T05:22:28.503 INFO:teuthology.orchestra.run.smithi012.stdout:2849 punch from 0x8024811 to 0x80318ca, (0xd0b9 bytes) 2024-09-11T05:22:28.503 INFO:teuthology.orchestra.run.smithi012.stdout:2850 write 0x3fa0bf6 thru 0x3fa92ca (0x86d5 bytes) 2024-09-11T05:22:28.506 INFO:teuthology.orchestra.run.smithi012.stdout:2851 read 0x32c844 thru 0x33af9a (0xe757 bytes) 2024-09-11T05:22:28.506 INFO:teuthology.orchestra.run.smithi012.stdout:2852 write 0x102ec56 thru 0x102efa5 (0x350 bytes) 2024-09-11T05:22:28.514 INFO:teuthology.orchestra.run.smithi012.stdout:2854 write 0x95dcab8 thru 0x95e2bd0 (0x6119 bytes) 2024-09-11T05:22:28.517 INFO:teuthology.orchestra.run.smithi012.stdout:2855 write 0x7c1551b thru 0x7c177b1 (0x2297 bytes) 2024-09-11T05:22:28.528 INFO:teuthology.orchestra.run.smithi012.stdout:2856 write 0xb8cff1f thru 0xb8df536 (0xf618 bytes) 2024-09-11T05:22:28.531 INFO:teuthology.orchestra.run.smithi012.stdout:2857 read 0xb15dacd thru 0xb16681e (0x8d52 bytes) 2024-09-11T05:22:28.541 INFO:teuthology.orchestra.run.smithi012.stdout:2858 trunc from 0xb8df537 to 0x268a8b5 2024-09-11T05:22:28.550 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:28.550 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:28.555 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:28.554+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:28.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:28.573 INFO:teuthology.orchestra.run.smithi012.stdout:2859 writesame 0xa5ee6cc thru 0xa5f8332 data_size 0x1(0x9c67 bytes) 2024-09-11T05:22:28.573 INFO:teuthology.orchestra.run.smithi012.stdout:2860 write 0x59feaf7 thru 0x5a005c4 (0x1ace bytes) 2024-09-11T05:22:28.580 INFO:teuthology.orchestra.run.smithi012.stdout:2862 read 0x453f11b thru 0x4545433 (0x6319 bytes) 2024-09-11T05:22:28.580 INFO:teuthology.orchestra.run.smithi012.stdout:2865 punch from 0x3757ee5 to 0x37630b7, (0xb1d2 bytes) 2024-09-11T05:22:28.580 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:28.580 INFO:teuthology.orchestra.run.smithi012.stdout:2869 punch from 0x84c164 to 0x854e77, (0x8d13 bytes) 2024-09-11T05:22:28.581 INFO:teuthology.orchestra.run.smithi012.stdout:2870 punch from 0x8b54fe8 to 0x8b5e00d, (0x9025 bytes) 2024-09-11T05:22:28.581 INFO:teuthology.orchestra.run.smithi012.stdout:2871 read 0x494e19 thru 0x49af8c (0x6174 bytes) 2024-09-11T05:22:28.581 INFO:teuthology.orchestra.run.smithi012.stdout:2872 punch from 0x883dc18 to 0x883e247, (0x62f bytes) 2024-09-11T05:22:28.581 INFO:teuthology.orchestra.run.smithi012.stdout:2873 read 0x9417ed thru 0x946ba0 (0x53b4 bytes) 2024-09-11T05:22:28.581 INFO:teuthology.orchestra.run.smithi012.stdout:2874 writesame 0x3befb95 thru 0x3bfd309 data_size 0x1(0xd775 bytes) 2024-09-11T05:22:28.615 INFO:teuthology.orchestra.run.smithi012.stdout:2875 trunc from 0xa5f8333 to 0x5ed19d1 2024-09-11T05:22:28.622 INFO:teuthology.orchestra.run.smithi012.stdout:2876 clone 26 order 21 su 262144 sc 4 2024-09-11T05:22:28.656 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:22:28.656 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:28.655+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:28.687 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:28.687 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:28.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:28.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:28.757+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:28.801 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:28.801 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:28.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:28.859 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:28.858+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:28.912 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:28.913 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:28.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:28.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:28.959+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:29.025 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.025 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.033 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:29.061 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:29.060+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:29.138 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.138 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.146 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:29.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:29.160+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:29.248 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.248 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.256 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:29.262 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:29.261+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:29.360 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.360 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:29.364+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:29.368 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:29.466 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:29.466+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:29.473 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.473 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:29.569 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:29.569+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:29.627 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.627 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:29.644 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:22:29.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:29.704+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:29.773 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:29.773+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:29.781 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-11T05:22:29.781 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.781 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.790 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:29.874 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:29.873+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:29.940 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:29.945 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:29.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:29.989 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:29.988+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:30.038 INFO:teuthology.orchestra.run.smithi012.stdout:2878 write 0xc3fba6a thru 0xc40b8ed (0xfe84 bytes) 2024-09-11T05:22:30.042 INFO:teuthology.orchestra.run.smithi012.stdout:2879 read 0x3e8e4c7 thru 0x3e90399 (0x1ed3 bytes) 2024-09-11T05:22:30.049 INFO:teuthology.orchestra.run.smithi012.stdout:2880 write 0xdeefe58 thru 0xdef1eff (0x20a8 bytes) 2024-09-11T05:22:30.052 INFO:teuthology.orchestra.run.smithi012.stdout:2883 write 0x76b335c thru 0x76c2c7c (0xf921 bytes) 2024-09-11T05:22:30.056 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.056 INFO:teuthology.orchestra.run.smithi012.stdout:2886 read 0xda4668e thru 0xda48e17 (0x278a bytes) 2024-09-11T05:22:30.056 INFO:teuthology.orchestra.run.smithi012.stdout:2890 write 0xafeb9d4 thru 0xaff4a3d (0x906a bytes) 2024-09-11T05:22:30.057 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:30.057 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:30.059 INFO:teuthology.orchestra.run.smithi012.stdout:2891 write 0x6a55e65 thru 0x6a57a2b (0x1bc7 bytes) 2024-09-11T05:22:30.062 INFO:teuthology.orchestra.run.smithi012.stdout:2893 write 0xabfad7b thru 0xac07307 (0xc58d bytes) 2024-09-11T05:22:30.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:30.077 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:30.078 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:30.078 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:30.077+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:30.082 INFO:teuthology.orchestra.run.smithi012.stdout:2894 trunc from 0xdef1f00 to 0x5aebfb 2024-09-11T05:22:30.099 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:30.100 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:30.116 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:30.117 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:30.118 INFO:teuthology.orchestra.run.smithi012.stdout:2895 write 0x910cfa2 thru 0x910d5a5 (0x604 bytes) 2024-09-11T05:22:30.121 INFO:teuthology.orchestra.run.smithi012.stdout:2896 write 0x7682dc5 thru 0x768e64d (0xb889 bytes) 2024-09-11T05:22:30.123 INFO:teuthology.orchestra.run.smithi012.stdout:2898 write 0xed4b9f thru 0xeda16c (0x55ce bytes) 2024-09-11T05:22:30.126 INFO:teuthology.orchestra.run.smithi012.stdout:2899 writesame 0x82b5d45 thru 0x82ba2b6 data_size 0x3(0x4572 bytes) 2024-09-11T05:22:30.135 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:30.135 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:30.141 INFO:teuthology.orchestra.run.smithi012.stdout:2902 write 0xcfde21f thru 0xcfdf90f (0x16f1 bytes) 2024-09-11T05:22:30.144 INFO:teuthology.orchestra.run.smithi012.stdout:2903 write 0xc49c4c1 thru 0xc4a376a (0x72aa bytes) 2024-09-11T05:22:30.147 INFO:teuthology.orchestra.run.smithi012.stdout:2904 writesame 0x34a487a thru 0x34ad086 data_size 0x1(0x880d bytes) 2024-09-11T05:22:30.155 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:30.155 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:30.171 INFO:teuthology.orchestra.run.smithi012.stdout:2905 write 0x50ad62f thru 0x50bc7f0 (0xf1c2 bytes) 2024-09-11T05:22:30.175 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.175 INFO:teuthology.orchestra.run.smithi012.stdout:2910 punch from 0x162fe49 to 0x163d52f, (0xd6e6 bytes) 2024-09-11T05:22:30.176 INFO:teuthology.orchestra.run.smithi012.stdout:2913 writesame 0x1c77df5 thru 0x1c7c6c1 data_size 0x1(0x48cd bytes) 2024-09-11T05:22:30.181 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:30.181 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:30.181 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:30.181+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:30.181 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:30.182 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:30.187 INFO:teuthology.orchestra.run.smithi012.stdout:2914 punch from 0x381c712 to 0x381f13e, (0x2a2c bytes) 2024-09-11T05:22:30.188 INFO:teuthology.orchestra.run.smithi012.stdout:2916 write 0x6b3835f thru 0x6b4540e (0xd0b0 bytes) 2024-09-11T05:22:30.191 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:30.197 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:30.197 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:30.202 INFO:teuthology.orchestra.run.smithi012.stdout:2918 trunc from 0xcfdf910 to 0x42ef304 2024-09-11T05:22:30.212 INFO:teuthology.orchestra.run.smithi012.stdout:2919 read 0x1de1a7f thru 0x1df007b (0xe5fd bytes) 2024-09-11T05:22:30.217 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:30.217 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:30.220 INFO:teuthology.orchestra.run.smithi012.stdout:2921 write 0x57a60c8 thru 0x57a89f3 (0x292c bytes) 2024-09-11T05:22:30.222 INFO:teuthology.orchestra.run.smithi012.stdout:2922 read 0x1ff10f1 thru 0x1ffd973 (0xc883 bytes) 2024-09-11T05:22:30.222 INFO:teuthology.orchestra.run.smithi012.stdout:2923 write 0x258c1b7 thru 0x25912ac (0x50f6 bytes) 2024-09-11T05:22:30.241 INFO:teuthology.orchestra.run.smithi012.stdout:2924 write 0xed697a7 thru 0xed7298d (0x91e7 bytes) 2024-09-11T05:22:30.244 INFO:teuthology.orchestra.run.smithi012.stdout:2925 write 0x8721f93 thru 0x8722b0f (0xb7d bytes) 2024-09-11T05:22:30.246 INFO:teuthology.orchestra.run.smithi012.stdout:2926 writesame 0xe891d2d thru 0xe89972b data_size 0x1(0x79ff bytes) 2024-09-11T05:22:30.263 INFO:teuthology.orchestra.run.smithi012.stdout:2928 read 0x9c94f05 thru 0x9ca28ab (0xd9a7 bytes) 2024-09-11T05:22:30.265 INFO:teuthology.orchestra.run.smithi012.stdout:2930 trunc from 0xed7298e to 0xd3facf0 2024-09-11T05:22:30.275 INFO:teuthology.orchestra.run.smithi012.stdout:2931 write 0x6fdc422 thru 0x6fe4795 (0x8374 bytes) 2024-09-11T05:22:30.278 INFO:teuthology.orchestra.run.smithi012.stdout:2935 punch from 0x400feb0 to 0x401974d, (0x989d bytes) 2024-09-11T05:22:30.278 INFO:teuthology.orchestra.run.smithi012.stdout:2938 punch from 0xaf7b529 to 0xaf84041, (0x8b18 bytes) 2024-09-11T05:22:30.278 INFO:teuthology.orchestra.run.smithi012.stdout:2941 write 0xe755be thru 0xe77267 (0x1caa bytes) 2024-09-11T05:22:30.281 INFO:teuthology.orchestra.run.smithi012.stdout:2945 write 0xb5d5236 thru 0xb5d72b7 (0x2082 bytes) 2024-09-11T05:22:30.281 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:30.281+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:30.283 INFO:teuthology.orchestra.run.smithi012.stdout:2946 read 0xb28e79a thru 0xb295faa (0x7811 bytes) 2024-09-11T05:22:30.283 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.284 INFO:teuthology.orchestra.run.smithi012.stdout:2948 writesame 0x699efaa thru 0x69ab153 data_size 0x3(0xc1aa bytes) 2024-09-11T05:22:30.293 INFO:teuthology.orchestra.run.smithi012.stdout:2952 punch from 0x34b86a4 to 0x34c4091, (0xb9ed bytes) 2024-09-11T05:22:30.293 INFO:teuthology.orchestra.run.smithi012.stdout:2953 punch from 0x26f21b0 to 0x26fd782, (0xb5d2 bytes) 2024-09-11T05:22:30.293 INFO:teuthology.orchestra.run.smithi012.stdout:2954 write 0xbae8af8 thru 0xbaf3f06 (0xb40f bytes) 2024-09-11T05:22:30.296 INFO:teuthology.orchestra.run.smithi012.stdout:2956 punch from 0xc02c54b to 0xc02d5dd, (0x1092 bytes) 2024-09-11T05:22:30.302 INFO:teuthology.orchestra.run.smithi012.stdout:2957 writesame 0xdbee62e thru 0xdbef28b data_size 0x1(0xc5e bytes) 2024-09-11T05:22:30.302 INFO:teuthology.orchestra.run.smithi012.stdout:2961 write 0xb3f0a06 thru 0xb3fdae7 (0xd0e2 bytes) 2024-09-11T05:22:30.303 INFO:teuthology.orchestra.run.smithi012.stdout:2962 read 0xd024cd6 thru 0xd0301d8 (0xb503 bytes) 2024-09-11T05:22:30.303 INFO:teuthology.orchestra.run.smithi012.stdout:2963 read 0x97da5c2 thru 0x97dd13d (0x2b7c bytes) 2024-09-11T05:22:30.305 INFO:teuthology.orchestra.run.smithi012.stdout:2964 trunc from 0xdbef28c to 0xc33360d 2024-09-11T05:22:30.310 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:30.310 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:30.310 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:30.310 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:30.311 INFO:teuthology.orchestra.run.smithi012.stdout:2965 read 0x8fad1a thru 0x8fdc22 (0x2f09 bytes) 2024-09-11T05:22:30.311 INFO:teuthology.orchestra.run.smithi012.stdout:2966 punch from 0x3988bf to 0x39d8a3, (0x4fe4 bytes) 2024-09-11T05:22:30.311 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.313 INFO:teuthology.orchestra.run.smithi012.stdout:2969 trunc from 0xc33360d to 0xa025256 2024-09-11T05:22:30.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:30.323 INFO:teuthology.orchestra.run.smithi012.stdout:2970 trunc from 0xa025256 to 0x9b125e9 2024-09-11T05:22:30.328 INFO:teuthology.orchestra.run.smithi012.stdout:2971 write 0x9aba4cc thru 0x9ac6f68 (0xca9d bytes) 2024-09-11T05:22:30.333 INFO:teuthology.orchestra.run.smithi012.stdout:2972 write 0x1781aa5 thru 0x178eeb2 (0xd40e bytes) 2024-09-11T05:22:30.336 INFO:teuthology.orchestra.run.smithi012.stdout:2973 writesame 0x6715afe thru 0x6717003 data_size 0x2(0x1506 bytes) 2024-09-11T05:22:30.350 INFO:teuthology.orchestra.run.smithi012.stdout:2974 write 0xea68989 thru 0xea71b57 (0x91cf bytes) 2024-09-11T05:22:30.353 INFO:teuthology.orchestra.run.smithi012.stdout:2975 read 0x65f6356 thru 0x65f869f (0x234a bytes) 2024-09-11T05:22:30.361 INFO:teuthology.orchestra.run.smithi012.stdout:2976 trunc from 0xea71b58 to 0x7678fcd 2024-09-11T05:22:30.372 INFO:teuthology.orchestra.run.smithi012.stdout:2977 read 0x44a7bee thru 0x44b11c6 (0x95d9 bytes) 2024-09-11T05:22:30.379 INFO:teuthology.orchestra.run.smithi012.stdout:2978 trunc from 0x7678fcd to 0xd274a0c 2024-09-11T05:22:30.383 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:30.382+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:30.385 INFO:teuthology.orchestra.run.smithi012.stdout:2979 read 0x7c6e2d7 thru 0x7c73b61 (0x588b bytes) 2024-09-11T05:22:30.385 INFO:teuthology.orchestra.run.smithi012.stdout:2980 write 0x4feda7c thru 0x4ff186d (0x3df2 bytes) 2024-09-11T05:22:30.388 INFO:teuthology.orchestra.run.smithi012.stdout:2981 write 0x9ad6cf8 thru 0x9ae3868 (0xcb71 bytes) 2024-09-11T05:22:30.390 INFO:teuthology.orchestra.run.smithi012.stdout:2982 write 0xa5c7644 thru 0xa5d09ac (0x9369 bytes) 2024-09-11T05:22:30.393 INFO:teuthology.orchestra.run.smithi012.stdout:2983 punch from 0x5d99710 to 0x5d9f42c, (0x5d1c bytes) 2024-09-11T05:22:30.393 INFO:teuthology.orchestra.run.smithi012.stdout:2984 flatten 2024-09-11T05:22:30.399 INFO:teuthology.orchestra.run.smithi012.stdout:2985 read 0x16a12d2 thru 0x16a1542 (0x271 bytes) 2024-09-11T05:22:30.400 INFO:teuthology.orchestra.run.smithi012.stdout:2986 read 0xb31be22 thru 0xb32a055 (0xe234 bytes) 2024-09-11T05:22:30.400 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.400 INFO:teuthology.orchestra.run.smithi012.stdout:2988 read 0x82da387 thru 0x82e594b (0xb5c5 bytes) 2024-09-11T05:22:30.400 INFO:teuthology.orchestra.run.smithi012.stdout:2989 write 0x35a82a6 thru 0x35a9e9b (0x1bf6 bytes) 2024-09-11T05:22:30.401 INFO:teuthology.orchestra.run.smithi012.stdout:2990 punch from 0xceadce1 to 0xceb23fd, (0x471c bytes) 2024-09-11T05:22:30.401 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.401 INFO:teuthology.orchestra.run.smithi012.stdout:2992 write 0x440f5e thru 0x444c72 (0x3d15 bytes) 2024-09-11T05:22:30.403 INFO:teuthology.orchestra.run.smithi012.stdout:2993 read 0x8fc81f2 thru 0x8fc8ed1 (0xce0 bytes) 2024-09-11T05:22:30.403 INFO:teuthology.orchestra.run.smithi012.stdout:2994 punch from 0x549ce4e to 0x54a3fd2, (0x7184 bytes) 2024-09-11T05:22:30.417 INFO:teuthology.orchestra.run.smithi012.stdout:2995 trunc from 0xd274a0c to 0xfebe22 2024-09-11T05:22:30.429 INFO:teuthology.orchestra.run.smithi012.stdout:2996 read 0x634fa5 thru 0x63f3e3 (0xa43f bytes) 2024-09-11T05:22:30.440 INFO:teuthology.orchestra.run.smithi012.stdout:2998 trunc from 0xfebe22 to 0xa470f7c 2024-09-11T05:22:30.443 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:30.443 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:30.443 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:30.444 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:30.444 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:30.446 INFO:teuthology.orchestra.run.smithi012.stdout:3000 write 0x8c7276b thru 0x8c72ded (0x683 bytes) 2024-09-11T05:22:30.448 INFO:teuthology.orchestra.run.smithi012.stdout:3001 write 0x284a3b thru 0x2912c3 (0xc889 bytes) 2024-09-11T05:22:30.450 INFO:teuthology.orchestra.run.smithi012.stdout:3002 write 0x17bf73e thru 0x17c4b71 (0x5434 bytes) 2024-09-11T05:22:30.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:30.465 INFO:teuthology.orchestra.run.smithi012.stdout:3004 write 0xe0c26a8 thru 0xe0d1a7a (0xf3d3 bytes) 2024-09-11T05:22:30.468 INFO:teuthology.orchestra.run.smithi012.stdout:3006 writesame 0x1c35d49 thru 0x1c3951e data_size 0x7(0x37d6 bytes) 2024-09-11T05:22:30.472 INFO:teuthology.orchestra.run.smithi012.stdout:3007 writesame 0x5677272 thru 0x5680997 data_size 0x3(0x9726 bytes) 2024-09-11T05:22:30.484 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:30.484+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:30.491 INFO:teuthology.orchestra.run.smithi012.stdout:3009 trunc from 0xe0d1a7b to 0x250233b 2024-09-11T05:22:30.502 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.509 INFO:teuthology.orchestra.run.smithi012.stdout:3012 trunc from 0x250233b to 0x91bf012 2024-09-11T05:22:30.515 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.515 INFO:teuthology.orchestra.run.smithi012.stdout:3014 writesame 0x322d216 thru 0x3232fcf data_size 0x12(0x5dba bytes) 2024-09-11T05:22:30.521 INFO:teuthology.orchestra.run.smithi012.stdout:3015 trunc from 0x91bf012 to 0xba7dcfc 2024-09-11T05:22:30.526 INFO:teuthology.orchestra.run.smithi012.stdout:3019 punch from 0x162c3a9 to 0x1632ff6, (0x6c4d bytes) 2024-09-11T05:22:30.533 INFO:teuthology.orchestra.run.smithi012.stdout:3022 write 0xd81752d thru 0xd817c24 (0x6f8 bytes) 2024-09-11T05:22:30.537 INFO:teuthology.orchestra.run.smithi012.stdout:3023 trunc from 0xd817c25 to 0xcfc8ecf 2024-09-11T05:22:30.547 INFO:teuthology.orchestra.run.smithi012.stdout:3024 read 0x65e2721 thru 0x65e9576 (0x6e56 bytes) 2024-09-11T05:22:30.547 INFO:teuthology.orchestra.run.smithi012.stdout:3026 read 0x616d78f thru 0x6179c48 (0xc4ba bytes) 2024-09-11T05:22:30.547 INFO:teuthology.orchestra.run.smithi012.stdout:3027 writesame 0x1aa3389 thru 0x1aa7209 data_size 0x1(0x3e81 bytes) 2024-09-11T05:22:30.556 INFO:teuthology.orchestra.run.smithi012.stdout:3028 read 0x4410ba5 thru 0x441c222 (0xb67e bytes) 2024-09-11T05:22:30.556 INFO:teuthology.orchestra.run.smithi012.stdout:3033 write 0x373dd4a thru 0x3746f05 (0x91bc bytes) 2024-09-11T05:22:30.560 INFO:teuthology.orchestra.run.smithi012.stdout:3034 writesame 0x6004761 thru 0x60099b9 data_size 0x1(0x5259 bytes) 2024-09-11T05:22:30.571 INFO:teuthology.orchestra.run.smithi012.stdout:3036 write 0x5d581af thru 0x5d58a66 (0x8b8 bytes) 2024-09-11T05:22:30.574 INFO:teuthology.orchestra.run.smithi012.stdout:3037 writesame 0xaa426cb thru 0xaa4e121 data_size 0x1(0xba57 bytes) 2024-09-11T05:22:30.584 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:30.584 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:30.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:30.584 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13638 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.803678837, 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025061597000000001, 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13638 2024-09-11T05:22:30.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.586 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779408+0000", 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779410+0000", 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779416+0000", 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9909999999999999e-06 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779421+0000", 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0209999999999999e-06 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804340+0000", 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024918549000000002 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804406+0000", 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6568000000000004e-05 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804469+0000", 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2989000000000003e-05 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13643 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 1949696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.803640295000001, 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025233829999999999, 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13643 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779446+0000", 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779447+0000", 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.75e-07 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779449+0000", 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779455+0000", 2024-09-11T05:22:30.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1500000000000004e-06 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779461+0000", 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1260000000000003e-06 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804514+0000", 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025052479999999999 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804583+0000", 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9029000000000006e-05 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804680+0000", 2024-09-11T05:22:30.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7545000000000002e-05 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13652 3.12 3:4caff9a7:::rbd_data.1179262aa3d7.0000000000000019:5 [read 294912~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.803544066999997, 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025318401000000001, 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13652 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779543+0000", 2024-09-11T05:22:30.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779545+0000", 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.891e-06 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779551+0000", 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9549999999999997e-06 2024-09-11T05:22:30.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.779556+0000", 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7110000000000003e-06 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804709+0000", 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025153117999999999 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804776+0000", 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6981000000000001e-05 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.804861+0000", 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5323999999999998e-05 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.603 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13921 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1589248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795660104, 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025139273, 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13921 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787427+0000", 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787429+0000", 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0760000000000001e-06 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787437+0000", 2024-09-11T05:22:30.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9440000000000005e-06 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787442+0000", 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4269999999999999e-06 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812415+0000", 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024972437 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812485+0000", 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0278999999999996e-05 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812566+0000", 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0607999999999998e-05 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13925 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1687552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.608 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:30.609 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795613547000002, 2024-09-11T05:22:30.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025253827999999999, 2024-09-11T05:22:30.609 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13925 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787473+0000", 2024-09-11T05:22:30.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787474+0000", 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787483+0000", 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4499999999999993e-06 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787492+0000", 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1360000000000003e-06 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787498+0000", 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5709999999999997e-06 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812594+0000", 2024-09-11T05:22:30.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025096207999999998 2024-09-11T05:22:30.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812660+0000", 2024-09-11T05:22:30.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6450000000000002e-05 2024-09-11T05:22:30.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812727+0000", 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6470999999999994e-05 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13928 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 1867776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.614 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795523836000001, 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025330478, 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13928 2024-09-11T05:22:30.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787563+0000", 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787565+0000", 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0679999999999999e-06 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787573+0000", 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7239999999999992e-06 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787578+0000", 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3399999999999997e-06 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812757+0000", 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025178493999999999 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812820+0000", 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2948999999999996e-05 2024-09-11T05:22:30.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812893+0000", 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3484000000000003e-05 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13937 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795472717000003, 2024-09-11T05:22:30.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025471521, 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13937 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787614+0000", 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1200000000000003e-07 2024-09-11T05:22:30.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787617+0000", 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3999999999999999e-06 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787624+0000", 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4869999999999996e-06 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787630+0000", 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812924+0000", 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025294265999999999 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.812992+0000", 2024-09-11T05:22:30.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7691e-05 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813085+0000", 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3604999999999996e-05 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13942 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 131072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795415619000003, 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025635227, 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13942 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787671+0000", 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7300000000000001e-07 2024-09-11T05:22:30.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787673+0000", 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787680+0000", 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1600000000000001e-06 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787686+0000", 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.434e-06 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813152+0000", 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025466329999999999 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813216+0000", 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4162e-05 2024-09-11T05:22:30.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813306+0000", 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9821000000000006e-05 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13956 3.12 3:4a3c67a9:::rbd_data.1179262aa3d7.0000000000000000:5 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795281764999999, 2024-09-11T05:22:30.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025691571, 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13956 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787805+0000", 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787806+0000", 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4799999999999998e-07 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787816+0000", 2024-09-11T05:22:30.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0158e-05 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787825+0000", 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5140000000000007e-06 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787832+0000", 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4779999999999996e-06 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813341+0000", 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025509245 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813410+0000", 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9099999999999999e-05 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813496+0000", 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428000000000007e-05 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13967 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795245080000001, 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02584034, 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.634 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13967 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787842+0000", 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787845+0000", 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787852+0000", 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4479999999999997e-06 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787858+0000", 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6930000000000004e-06 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813529+0000", 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025671619999999999 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813601+0000", 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1988000000000003e-05 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813682+0000", 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0479e-05 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13970 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795221558999998, 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025988694, 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.639 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13970 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787865+0000", 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787866+0000", 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7399999999999998e-07 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787868+0000", 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0880000000000002e-06 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787874+0000", 2024-09-11T05:22:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3670000000000002e-06 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787879+0000", 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1850000000000003e-06 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813706+0000", 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025827096000000001 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813777+0000", 2024-09-11T05:22:30.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0894000000000003e-05 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813854+0000", 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6589999999999997e-05 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13977 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 589824~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:30.643 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795153972000001, 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026082164000000001, 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13977 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:30.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787933+0000", 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3499999999999996e-07 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787935+0000", 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.221e-06 2024-09-11T05:22:30.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787942+0000", 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787947+0000", 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813878+0000", 2024-09-11T05:22:30.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025930385 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.813939+0000", 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0980000000000002e-05 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814015+0000", 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6143000000000006e-05 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13980 3.12 3:49d5c1b8:::rbd_data.1179262aa3d7.000000000000000c:5 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.795132285999998, 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026221787999999999, 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13980 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787954+0000", 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787955+0000", 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787957+0000", 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0339999999999999e-06 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787964+0000", 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7830000000000001e-06 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.787969+0000", 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2660000000000001e-06 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814039+0000", 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.026070336 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814099+0000", 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0109000000000003e-05 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.814176+0000", 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6903999999999994e-05 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15857 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.541821513999999, 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025310777999999999, 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.652 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15857 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041265+0000", 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041266+0000", 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041268+0000", 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-06 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041274+0000", 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:22:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041278+0000", 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6240000000000001e-06 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066166+0000", 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024887713999999998 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066250+0000", 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3984000000000001e-05 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066576+0000", 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000325927 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:15858 3.12 3:4b4ddd2a:::rbd_data.117977dc529b.000000000000001e:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.541802660999998, 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025727013, 2024-09-11T05:22:30.656 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 15858 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041284+0000", 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9799999999999999e-07 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041286+0000", 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9240000000000001e-06 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041292+0000", 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6289999999999998e-06 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.041296+0000", 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5410000000000002e-06 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066624+0000", 2024-09-11T05:22:30.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025327692999999998 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.066719+0000", 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5425000000000002e-05 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:54.067011+0000", 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00029150299999999998 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59621 3.18 e40/22 3:1e993c26:::rbd_data.117971c15f82.0000000000000000:head v 40'416, mlcod=40'414)", 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.420929752999999, 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029790078000000001, 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:30.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162157+0000", 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162160+0000", 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9809999999999999e-06 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165939+0000", 2024-09-11T05:22:30.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003779634 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165978+0000", 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8043000000000002e-05 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165988+0000", 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0624e-05 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166085+0000", 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6847000000000003e-05 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166115+0000", 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9808e-05 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191879+0000", 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025764502000000002 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191947+0000", 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7638999999999994e-05 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:70775 3.6 3:65762739:::rbd_data.1179db619f31.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write 2818048~7771] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.882622+0000", 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.7004642709999995, 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.035692379000000003, 2024-09-11T05:22:30.666 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 70775 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.882622+0000", 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.882622+0000", 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.882625+0000", 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1519999999999999e-06 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887220+0000", 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045957560000000003 2024-09-11T05:22:30.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887248+0000", 2024-09-11T05:22:30.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.745e-05 2024-09-11T05:22:30.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887258+0000", 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0370000000000001e-05 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887326+0000", 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8295999999999998e-05 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887470+0000", 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014390099999999999 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 1", 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887874+0000", 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040378700000000002 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.917693+0000", 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029818824000000001 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918201+0000", 2024-09-11T05:22:30.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00050767499999999997 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918261+0000", 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0281000000000001e-05 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918315+0000", 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3887000000000001e-05 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70773 3.3 e57/22 3:c60eec4f:::rbd_data.1179db619f31.0000000000000004:head v 57'217, mlcod=57'215)", 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.887299+0000", 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.6957872490000003, 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.030944784999999999, 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887299+0000", 2024-09-11T05:22:30.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887299+0000", 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.887301+0000", 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7239999999999999e-06 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896759+0000", 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0094576279999999992 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896782+0000", 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3281999999999998e-05 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896796+0000", 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4312e-05 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896876+0000", 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9691000000000007e-05 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.896905+0000", 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8768999999999998e-05 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918202+0000", 2024-09-11T05:22:30.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.021297439000000001 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918244+0000", 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1940000000000002e-05 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:71631 3.17 3:ea4c733a:::rbd_data.1179db619f31.0000000000000016:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:22.115472+0000", 2024-09-11T05:22:30.677 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.4676148530000006, 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.027146791, 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 71631 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115472+0000", 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115472+0000", 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115474+0000", 2024-09-11T05:22:30.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.013e-06 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115488+0000", 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4527e-05 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115505+0000", 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6634e-05 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115512+0000", 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2409999999999998e-06 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115572+0000", 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9478999999999998e-05 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.115625+0000", 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3134999999999999e-05 2024-09-11T05:22:30.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.119712+0000", 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0040874819999999999 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142512+0000", 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.022799699999999999 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142546+0000", 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4085000000000003e-05 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142582+0000", 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5914999999999997e-05 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.142619+0000", 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6579999999999999e-05 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.683 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:71750 3.6 3:63df049b:::rbd_data.1179db619f31.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:22.270726+0000", 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 8.3123607790000005, 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.02550142, 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:30.684 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 71750 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270726+0000", 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270726+0000", 2024-09-11T05:22:30.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270728+0000", 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2819999999999999e-06 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270738+0000", 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9990000000000003e-06 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:30.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270755+0000", 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6946999999999999e-05 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270765+0000", 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5740000000000002e-06 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270829+0000", 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4330000000000002e-05 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.270903+0000", 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4196000000000006e-05 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 1", 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.276275+0000", 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0053713579999999997 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296102+0000", 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.019827318 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296155+0000", 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3567999999999999e-05 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296194+0000", 2024-09-11T05:22:30.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8433999999999998e-05 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:22.296227+0000", 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3414000000000002e-05 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:30.690 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:30.691 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:22:30.691 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:22:30.691 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 5, 6] 2024-09-11T05:22:30.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-11T05:22:30.692 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:30.691+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:30.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3038 write 0xcef2886 thru 0xcefcef4 (0xa66f bytes) 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3039 writesame 0x4ffdf5 thru 0x50869e data_size 0x77(0x88aa bytes) 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3040 punch from 0x3232e68 to 0x3234503, (0x169b bytes) 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3041 read 0x95370de thru 0x9544ec6 (0xdde9 bytes) 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3043 write 0x188472b thru 0x188bd61 (0x7637 bytes) 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3044 writesame 0x8f5ffba thru 0x8f6c827 data_size 0x23(0xc86e bytes) 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3046 writesame 0x4b580e2 thru 0x4b5baff data_size 0x2b(0x3a1e bytes) 2024-09-11T05:22:30.695 INFO:teuthology.orchestra.run.smithi012.stdout:3047 trunc from 0xcfc8ecf to 0xd8c088 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3048 write 0xe27a59b thru 0xe280d97 (0x67fd bytes) 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3049 write 0x3820fd1 thru 0x382f090 (0xe0c0 bytes) 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3050 write 0x34eead3 thru 0x34ef007 (0x535 bytes) 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3052 read 0xba01070 thru 0xba085ac (0x753d bytes) 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3054 read 0x9833e50 thru 0x9836366 (0x2517 bytes) 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3055 writesame 0x4a39157 thru 0x4a3eae2 data_size 0x16(0x598c bytes) 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3056 writesame 0xe73c573 thru 0xe73ec45 data_size 0x1(0x26d3 bytes) 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3058 trunc from 0xe73ec46 to 0xe540a1a 2024-09-11T05:22:30.696 INFO:teuthology.orchestra.run.smithi012.stdout:3059 writesame 0xddeef4 thru 0xde5304 data_size 0x1(0x6411 bytes) 2024-09-11T05:22:30.697 INFO:teuthology.orchestra.run.smithi012.stdout:3060 write 0x50691e thru 0x50c0dc (0x57bf bytes) 2024-09-11T05:22:30.709 INFO:teuthology.orchestra.run.smithi012.stdout:3061 trunc from 0xe540a1a to 0x4bf3ade 2024-09-11T05:22:30.733 INFO:teuthology.orchestra.run.smithi012.stdout:3063 writesame 0x823d09d thru 0x823dae9 data_size 0x3(0xa4d bytes) 2024-09-11T05:22:30.741 INFO:teuthology.orchestra.run.smithi012.stdout:3064 write 0xa0e7932 thru 0xa0eb674 (0x3d43 bytes) 2024-09-11T05:22:30.743 INFO:teuthology.orchestra.run.smithi012.stdout:3065 read 0x1605cc8 thru 0x1607c82 (0x1fbb bytes) 2024-09-11T05:22:30.743 INFO:teuthology.orchestra.run.smithi012.stdout:3066 write 0x62f09c2 thru 0x62fc4f7 (0xbb36 bytes) 2024-09-11T05:22:30.747 INFO:teuthology.orchestra.run.smithi012.stdout:3067 read 0x520109b thru 0x5203bf0 (0x2b56 bytes) 2024-09-11T05:22:30.747 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.747 INFO:teuthology.orchestra.run.smithi012.stdout:3069 write 0x3af05a3 thru 0x3af1f6d (0x19cb bytes) 2024-09-11T05:22:30.749 INFO:teuthology.orchestra.run.smithi012.stdout:3070 writesame 0x9ebad3f thru 0x9ec8ba4 data_size 0x9(0xde66 bytes) 2024-09-11T05:22:30.755 INFO:teuthology.orchestra.run.smithi012.stdout:3071 punch from 0x48ccdfd to 0x48cf778, (0x297b bytes) 2024-09-11T05:22:30.756 INFO:teuthology.orchestra.run.smithi012.stdout:3072 punch from 0x4cc0590 to 0x4cca42a, (0x9e9a bytes) 2024-09-11T05:22:30.756 INFO:teuthology.orchestra.run.smithi012.stdout:3073 writesame 0x61d2b09 thru 0x61d83ef data_size 0x1(0x58e7 bytes) 2024-09-11T05:22:30.775 INFO:teuthology.orchestra.run.smithi012.stdout:3074 write 0xc3f2e61 thru 0xc3fabab (0x7d4b bytes) 2024-09-11T05:22:30.784 INFO:teuthology.orchestra.run.smithi012.stdout:3075 writesame 0xc8b1818 thru 0xc8b81c8 data_size 0x1d(0x69b1 bytes) 2024-09-11T05:22:30.784 INFO:teuthology.orchestra.run.smithi012.stdout:3076 read 0x521bb34 thru 0x52218c0 (0x5d8d bytes) 2024-09-11T05:22:30.784 INFO:teuthology.orchestra.run.smithi012.stdout:3078 writesame 0xa9db548 thru 0xa9dc4de data_size 0x1(0xf97 bytes) 2024-09-11T05:22:30.788 INFO:teuthology.orchestra.run.smithi012.stdout:3080 trunc from 0xc8b81c9 to 0xc557d0c 2024-09-11T05:22:30.793 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:30.792+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:30.795 INFO:teuthology.orchestra.run.smithi012.stdout:3082 punch from 0x4801e16 to 0x48077d3, (0x59bd bytes) 2024-09-11T05:22:30.795 INFO:teuthology.orchestra.run.smithi012.stdout:3084 write 0x4adb3c6 thru 0x4add558 (0x2193 bytes) 2024-09-11T05:22:30.797 INFO:teuthology.orchestra.run.smithi012.stdout:3085 read 0x6f0f848 thru 0x6f1f170 (0xf929 bytes) 2024-09-11T05:22:30.797 INFO:teuthology.orchestra.run.smithi012.stdout:3087 punch from 0x73bc225 to 0x73c7eae, (0xbc89 bytes) 2024-09-11T05:22:30.804 INFO:teuthology.orchestra.run.smithi012.stdout:3090 write 0xd6a301d thru 0xd6aeeaa (0xbe8e bytes) 2024-09-11T05:22:30.808 INFO:teuthology.orchestra.run.smithi012.stdout:3091 read 0xb3bd10c thru 0xb3be67c (0x1571 bytes) 2024-09-11T05:22:30.808 INFO:teuthology.orchestra.run.smithi012.stdout:3092 punch from 0xb93295d to 0xb93db78, (0xb21b bytes) 2024-09-11T05:22:30.808 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.808 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.808 INFO:teuthology.orchestra.run.smithi012.stdout:3097 read 0x6456b9e thru 0x6456be9 (0x4c bytes) 2024-09-11T05:22:30.808 INFO:teuthology.orchestra.run.smithi012.stdout:3098 read 0x9e4c5c8 thru 0x9e4cf40 (0x979 bytes) 2024-09-11T05:22:30.809 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.809 INFO:teuthology.orchestra.run.smithi012.stdout:3101 read 0xd2a01bb thru 0xd2af743 (0xf589 bytes) 2024-09-11T05:22:30.809 INFO:teuthology.orchestra.run.smithi012.stdout:3102 read 0x1b0df98 thru 0x1b16aac (0x8b15 bytes) 2024-09-11T05:22:30.809 INFO:teuthology.orchestra.run.smithi012.stdout:3103 read 0x8994472 thru 0x899fd80 (0xb90f bytes) 2024-09-11T05:22:30.809 INFO:teuthology.orchestra.run.smithi012.stdout:3105 read 0x2dc5b94 thru 0x2dc865b (0x2ac8 bytes) 2024-09-11T05:22:30.809 INFO:teuthology.orchestra.run.smithi012.stdout:3106 writesame 0xa734896 thru 0xa738cae data_size 0x27(0x4419 bytes) 2024-09-11T05:22:30.811 INFO:teuthology.orchestra.run.smithi012.stdout:3107 read 0x447290b thru 0x4481756 (0xee4c bytes) 2024-09-11T05:22:30.811 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.811 INFO:teuthology.orchestra.run.smithi012.stdout:3109 writesame 0x58731f8 thru 0x587e0cc data_size 0x3(0xaed5 bytes) 2024-09-11T05:22:30.817 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:30.817 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:30.818 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:30.818 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:30.819 INFO:teuthology.orchestra.run.smithi012.stdout:3110 write 0x7b7b49e thru 0x7b8a6e7 (0xf24a bytes) 2024-09-11T05:22:30.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:30.837 INFO:teuthology.orchestra.run.smithi012.stdout:3111 trunc from 0xd6aeeab to 0x1e53217 2024-09-11T05:22:30.868 INFO:teuthology.orchestra.run.smithi012.stdout:3112 write 0xdae5f27 thru 0xdaf25a0 (0xc67a bytes) 2024-09-11T05:22:30.870 INFO:teuthology.orchestra.run.smithi012.stdout:3113 writesame 0x1d78cc6 thru 0x1d7f1e3 data_size 0x7(0x651e bytes) 2024-09-11T05:22:30.874 INFO:teuthology.orchestra.run.smithi012.stdout:3114 read 0x330067 thru 0x334dfd (0x4d97 bytes) 2024-09-11T05:22:30.875 INFO:teuthology.orchestra.run.smithi012.stdout:3115 write 0x97ca30c thru 0x97d4063 (0x9d58 bytes) 2024-09-11T05:22:30.878 INFO:teuthology.orchestra.run.smithi012.stdout:3117 writesame 0xbbcfce9 thru 0xbbd9226 data_size 0x7(0x953e bytes) 2024-09-11T05:22:30.890 INFO:teuthology.orchestra.run.smithi012.stdout:3119 trunc from 0xdaf25a1 to 0x7babc1f 2024-09-11T05:22:30.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:30.893+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:30.908 INFO:teuthology.orchestra.run.smithi012.stdout:3120 write 0xb70046b thru 0xb701c61 (0x17f7 bytes) 2024-09-11T05:22:30.924 INFO:teuthology.orchestra.run.smithi012.stdout:3121 trunc from 0xb701c62 to 0x2e055c 2024-09-11T05:22:30.938 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.939 INFO:teuthology.orchestra.run.smithi012.stdout:3123 punch from 0x12ee5 to 0x1ada3, (0x7ebe bytes) 2024-09-11T05:22:30.939 INFO:teuthology.orchestra.run.smithi012.stdout:3124 punch from 0xc475d to 0xd468b, (0xff2e bytes) 2024-09-11T05:22:30.939 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.958 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:30.959 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:30.959 INFO:teuthology.orchestra.run.smithi012.stdout:3126 write 0xd53b66c thru 0xd549e61 (0xe7f6 bytes) 2024-09-11T05:22:30.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:30.976 INFO:teuthology.orchestra.run.smithi012.stdout:3129 trunc from 0xd549e62 to 0x18148ac 2024-09-11T05:22:30.985 INFO:teuthology.orchestra.run.smithi012.stdout:3130 read 0xaba7a6 thru 0xabc5f9 (0x1e54 bytes) 2024-09-11T05:22:30.985 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:30.985 INFO:teuthology.orchestra.run.smithi012.stdout:3135 punch from 0x123eec0 to 0x124984f, (0xa98f bytes) 2024-09-11T05:22:30.995 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:30.995+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:30.996 INFO:teuthology.orchestra.run.smithi012.stdout:3138 trunc from 0x18148ac to 0xb7d421f 2024-09-11T05:22:31.001 INFO:teuthology.orchestra.run.smithi012.stdout:3139 write 0x344804f thru 0x344b1b8 (0x316a bytes) 2024-09-11T05:22:31.004 INFO:teuthology.orchestra.run.smithi012.stdout:3140 write 0x922796e thru 0x922e600 (0x6c93 bytes) 2024-09-11T05:22:31.006 INFO:teuthology.orchestra.run.smithi012.stdout:3141 read 0x903cf25 thru 0x9049929 (0xca05 bytes) 2024-09-11T05:22:31.007 INFO:teuthology.orchestra.run.smithi012.stdout:3143 read 0x3e314ae thru 0x3e3330b (0x1e5e bytes) 2024-09-11T05:22:31.007 INFO:teuthology.orchestra.run.smithi012.stdout:3145 read 0x4b9ccab thru 0x4ba2937 (0x5c8d bytes) 2024-09-11T05:22:31.008 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.008 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.008 INFO:teuthology.orchestra.run.smithi012.stdout:3149 read 0x4fe13b3 thru 0x4fef17c (0xddca bytes) 2024-09-11T05:22:31.008 INFO:teuthology.orchestra.run.smithi012.stdout:3150 punch from 0x55b77f to 0x564e70, (0x96f1 bytes) 2024-09-11T05:22:31.008 INFO:teuthology.orchestra.run.smithi012.stdout:3151 write 0x6d70a22 thru 0x6d7e97c (0xdf5b bytes) 2024-09-11T05:22:31.010 INFO:teuthology.orchestra.run.smithi012.stdout:3153 read 0xb74665f thru 0xb75343a (0xcddc bytes) 2024-09-11T05:22:31.010 INFO:teuthology.orchestra.run.smithi012.stdout:3155 read 0x2c9b5f3 thru 0x2c9d0a6 (0x1ab4 bytes) 2024-09-11T05:22:31.010 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.010 INFO:teuthology.orchestra.run.smithi012.stdout:3158 writesame 0x81e8e1a thru 0x81ed331 data_size 0xc(0x4518 bytes) 2024-09-11T05:22:31.013 INFO:teuthology.orchestra.run.smithi012.stdout:3161 write 0x7854766 thru 0x7854cd1 (0x56c bytes) 2024-09-11T05:22:31.016 INFO:teuthology.orchestra.run.smithi012.stdout:3162 punch from 0x44b92e7 to 0x44bf17d, (0x5e96 bytes) 2024-09-11T05:22:31.016 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.016 INFO:teuthology.orchestra.run.smithi012.stdout:3166 write 0x7e6da96 thru 0x7e7d85f (0xfdca bytes) 2024-09-11T05:22:31.017 INFO:teuthology.orchestra.run.smithi012.stdout:3167 punch from 0x9be26c5 to 0x9bec77d, (0xa0b8 bytes) 2024-09-11T05:22:31.017 INFO:teuthology.orchestra.run.smithi012.stdout:3168 punch from 0x97b01df to 0x97b0591, (0x3b2 bytes) 2024-09-11T05:22:31.017 INFO:teuthology.orchestra.run.smithi012.stdout:3170 write 0xa08640b thru 0xa088f3a (0x2b30 bytes) 2024-09-11T05:22:31.021 INFO:teuthology.orchestra.run.smithi012.stdout:3171 write 0x8741274 thru 0x87432f9 (0x2086 bytes) 2024-09-11T05:22:31.024 INFO:teuthology.orchestra.run.smithi012.stdout:3172 writesame 0x3de4b52 thru 0x3de610f data_size 0x17(0x15be bytes) 2024-09-11T05:22:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:3173 read 0xb5624da thru 0xb56838f (0x5eb6 bytes) 2024-09-11T05:22:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:3174 write 0x1d54537 thru 0x1d61a70 (0xd53a bytes) 2024-09-11T05:22:31.030 INFO:teuthology.orchestra.run.smithi012.stdout:3176 write 0x3c6dace thru 0x3c79c13 (0xc146 bytes) 2024-09-11T05:22:31.033 INFO:teuthology.orchestra.run.smithi012.stdout:3177 write 0xabfbfaf thru 0xac0a4a3 (0xe4f5 bytes) 2024-09-11T05:22:31.033 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:22:31.032+0000 7f4182606640 -1 mon.a@0(leader).osd e64 definitely_dead 0 2024-09-11T05:22:31.037 INFO:teuthology.orchestra.run.smithi012.stdout:3178 read 0xd5fde8 thru 0xd6f013 (0xf22c bytes) 2024-09-11T05:22:31.037 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.045 INFO:teuthology.orchestra.run.smithi012.stdout:3180 write 0xe48d235 thru 0xe493eda (0x6ca6 bytes) 2024-09-11T05:22:31.048 INFO:teuthology.orchestra.run.smithi012.stdout:3181 writesame 0xbd441d2 thru 0xbd51b35 data_size 0x2(0xd964 bytes) 2024-09-11T05:22:31.063 INFO:teuthology.orchestra.run.smithi012.stdout:3183 write 0x3ba062 thru 0x3baffc (0xf9b bytes) 2024-09-11T05:22:31.065 INFO:teuthology.orchestra.run.smithi012.stdout:3184 write 0xa9efa8a thru 0xa9fc586 (0xcafd bytes) 2024-09-11T05:22:31.066 INFO:teuthology.orchestra.run.smithi012.stdout:3185 writesame 0x7a79ae4 thru 0x7a80468 data_size 0x7(0x6985 bytes) 2024-09-11T05:22:31.070 INFO:teuthology.orchestra.run.smithi012.stdout:3187 writesame 0x3c464ae thru 0x3c4f138 data_size 0x3(0x8c8b bytes) 2024-09-11T05:22:31.076 INFO:teuthology.orchestra.run.smithi012.stdout:3188 write 0x26e3bcd thru 0x26ec281 (0x86b5 bytes) 2024-09-11T05:22:31.079 INFO:teuthology.orchestra.run.smithi012.stdout:3189 read 0x8606a66 thru 0x8609c32 (0x31cd bytes) 2024-09-11T05:22:31.079 INFO:teuthology.orchestra.run.smithi012.stdout:3190 writesame 0xa6ccbd3 thru 0xa6d3d5e data_size 0x56(0x718c bytes) 2024-09-11T05:22:31.083 INFO:teuthology.orchestra.run.smithi012.stdout:3191 read 0xaf47200 thru 0xaf52d12 (0xbb13 bytes) 2024-09-11T05:22:31.083 INFO:teuthology.orchestra.run.smithi012.stdout:3193 punch from 0x59d39a1 to 0x59da706, (0x6d65 bytes) 2024-09-11T05:22:31.083 INFO:teuthology.orchestra.run.smithi012.stdout:3194 punch from 0xe2b698b to 0xe2bd0b7, (0x672c bytes) 2024-09-11T05:22:31.083 INFO:teuthology.orchestra.run.smithi012.stdout:3195 write 0x8b0e255 thru 0x8b157bf (0x756b bytes) 2024-09-11T05:22:31.086 INFO:teuthology.orchestra.run.smithi012.stdout:3196 read 0x75c3fe8 thru 0x75cfd25 (0xbd3e bytes) 2024-09-11T05:22:31.086 INFO:teuthology.orchestra.run.smithi012.stdout:3197 punch from 0x5dedf03 to 0x5df8fca, (0xb0c7 bytes) 2024-09-11T05:22:31.086 INFO:teuthology.orchestra.run.smithi012.stdout:3198 writesame 0x3a6896b thru 0x3a75307 data_size 0x1(0xc99d bytes) 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13285 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1032192~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337193714999998, 2024-09-11T05:22:31.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011665867, 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13285 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755753+0000", 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:31.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755756+0000", 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.225e-06 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755763+0000", 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4509999999999997e-06 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755768+0000", 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9389999999999996e-06 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767311+0000", 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011543589999999999 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767359+0000", 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7320000000000001e-05 2024-09-11T05:22:31.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767418+0000", 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9902999999999999e-05 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.100 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13288 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1490944~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337171032000001, 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011792074, 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13288 2024-09-11T05:22:31.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:31.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755776+0000", 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2199999999999999e-07 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755778+0000", 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755785+0000", 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7000000000000008e-06 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755790+0000", 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0769999999999998e-06 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767439+0000", 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011648067 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767496+0000", 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7098000000000001e-05 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767567+0000", 2024-09-11T05:22:31.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13298 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1949696~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337149105000002, 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011903945000000001, 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13298 2024-09-11T05:22:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.107 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755798+0000", 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2e-07 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755800+0000", 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.934e-06 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755806+0000", 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2899999999999999e-06 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755811+0000", 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8210000000000001e-06 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767588+0000", 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011776963999999999 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767636+0000", 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8304999999999999e-05 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767701+0000", 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5210999999999996e-05 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13305 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 2048000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337129621000003, 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996071000000001, 2024-09-11T05:22:31.112 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13305 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:31.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:22:31.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755819+0000", 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.888e-06 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755825+0000", 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9190000000000004e-06 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755830+0000", 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5740000000000003e-06 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767722+0000", 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011891273000000001 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767769+0000", 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7144000000000001e-05 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767813+0000", 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3863000000000003e-05 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13308 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1769472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337107955, 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012084722000000001, 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13308 2024-09-11T05:22:31.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755839+0000", 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755841+0000", 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:22:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755847+0000", 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1859999999999997e-06 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755852+0000", 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767833+0000", 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011981331 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767880+0000", 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6350000000000002e-05 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767923+0000", 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3568e-05 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13314 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1769472~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:31.123 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337088403000003, 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012198718000000001, 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13314 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.124 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755860+0000", 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7719999999999999e-06 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755867+0000", 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9260000000000003e-06 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755872+0000", 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767948+0000", 2024-09-11T05:22:31.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012076643 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767995+0000", 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6461999999999997e-05 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768057+0000", 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1846000000000004e-05 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.128 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13322 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337060272000002, 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012296951, 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13322 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755889+0000", 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755896+0000", 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8560000000000001e-06 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755901+0000", 2024-09-11T05:22:31.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1019999999999996e-06 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768078+0000", 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012177248999999999 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768126+0000", 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929000000000001e-05 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768183+0000", 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7005000000000001e-05 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13325 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.337038344, 2024-09-11T05:22:31.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01241014, 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13325 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:31.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:22:31.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755924+0000", 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5636000000000001e-05 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755931+0000", 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9500000000000004e-06 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.137 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755936+0000", 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1120000000000004e-06 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768203+0000", 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012267072 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768254+0000", 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0766000000000001e-05 2024-09-11T05:22:31.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768318+0000", 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4233000000000007e-05 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13333 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 573440~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.139 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.336291322999998, 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011798149000000001, 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13333 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756656+0000", 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4099999999999998e-07 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756659+0000", 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6219999999999998e-06 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756668+0000", 2024-09-11T05:22:31.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5210000000000002e-06 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756674+0000", 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8130000000000001e-06 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768339+0000", 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011665310999999999 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768391+0000", 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2179000000000003e-05 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768453+0000", 2024-09-11T05:22:31.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2062000000000003e-05 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13343 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335521462999999, 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011833961, 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13343 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757428+0000", 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757437+0000", 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:22:31.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757443+0000", 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769090+0000", 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011647014000000001 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769166+0000", 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5998e-05 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769259+0000", 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2699000000000001e-05 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13344 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1818624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335496149000001, 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996009, 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.151 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13344 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757451+0000", 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6699999999999999e-07 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757453+0000", 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:22:31.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757462+0000", 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1649999999999995e-06 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757467+0000", 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4890000000000003e-06 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769291+0000", 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011823422 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769370+0000", 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8658999999999993e-05 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769446+0000", 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6604e-05 2024-09-11T05:22:31.155 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13348 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335458868000003, 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.016500531999999998, 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13348 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757488+0000", 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.82e-07 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757491+0000", 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8080000000000001e-06 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757502+0000", 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1245e-05 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757510+0000", 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0669999999999992e-06 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769949+0000", 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012439131000000001 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770026+0000", 2024-09-11T05:22:31.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6464000000000005e-05 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.773988+0000", 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039622349999999997 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.161 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13351 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335427377000002, 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012814249, 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13351 2024-09-11T05:22:31.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.75e-07 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757522+0000", 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1739999999999999e-06 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757531+0000", 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8519999999999999e-06 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757539+0000", 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.763e-06 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770160+0000", 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012621267 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770234+0000", 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3619000000000001e-05 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770333+0000", 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9098999999999994e-05 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13353 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335397493999999, 2024-09-11T05:22:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012966811999999999, 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13353 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757552+0000", 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3209999999999999e-06 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757559+0000", 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2779999999999996e-06 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757564+0000", 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770358+0000", 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012793617 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770426+0000", 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8201000000000007e-05 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770516+0000", 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9889000000000006e-05 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13409 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 49152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335362775, 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013098782999999999, 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13409 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757588+0000", 2024-09-11T05:22:31.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1609999999999996e-06 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757598+0000", 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5189999999999998e-06 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757604+0000", 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770540+0000", 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012935854 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770605+0000", 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5505000000000004e-05 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770682+0000", 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7296e-05 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13413 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335333368999997, 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013233299, 2024-09-11T05:22:31.178 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13413 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.180 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757616+0000", 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1270000000000001e-06 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757624+0000", 2024-09-11T05:22:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4470000000000006e-06 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757629+0000", 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2220000000000001e-06 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770705+0000", 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013075646 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770770+0000", 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4678000000000007e-05 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770846+0000", 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6723000000000004e-05 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.183 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13419 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.335309864999999, 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013374044, 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.184 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13419 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757637+0000", 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:22:31.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757639+0000", 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9e-06 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757649+0000", 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7909999999999999e-06 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757654+0000", 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.378e-06 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770870+0000", 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013215873 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770935+0000", 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4887000000000004e-05 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.771010+0000", 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5778999999999994e-05 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:59624 3.19 3:9b48071f:::rbd_data.117971c15f82.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.930262159000002, 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.032257185000000001, 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 59624 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:31.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162689+0000", 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165796+0000", 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031078490000000002 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165845+0000", 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8242000000000003e-05 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165867+0000", 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2005e-05 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165990+0000", 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012330199999999999 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166150+0000", 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016035999999999999 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166799+0000", 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064827299999999999 2024-09-11T05:22:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191931+0000", 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025131982000000001 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194856+0000", 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002925825 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194897+0000", 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0252e-05 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194941+0000", 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4746000000000002e-05 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70775 3.6 e57/22 3:65762739:::rbd_data.1179db619f31.0000000000000005:head v 57'258, mlcod=57'256)", 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.2046189100000007, 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029681609000000001, 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888329+0000", 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.75e-06 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893284+0000", 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049547510000000003 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893317+0000", 2024-09-11T05:22:31.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2780000000000001e-05 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893327+0000", 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.893e-06 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893386+0000", 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9367999999999998e-05 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893414+0000", 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8028999999999999e-05 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.917939+0000", 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024524607 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918009+0000", 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0431000000000004e-05 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:76285 3.19 3:99554f66:::rbd_data.117930a4df71.000000000000001a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.94330056299999998, 2024-09-11T05:22:31.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.022701743, 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 76285 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.204 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149651+0000", 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2130000000000002e-06 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149661+0000", 2024-09-11T05:22:31.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0699999999999999e-05 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149666+0000", 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8459999999999999e-06 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149721+0000", 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4701999999999999e-05 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149869+0000", 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000147995 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.154094+0000", 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0042250810000000003 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172268+0000", 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.018174299000000001 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172280+0000", 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1839e-05 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172315+0000", 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5055999999999998e-05 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172347+0000", 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2283999999999998e-05 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.210 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:31.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:3199 read 0x7178234 thru 0x717d2e4 (0x50b1 bytes) 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:3200 write 0xb7eb65e thru 0xb7f7952 (0xc2f5 bytes) 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:3202 trunc from 0xe493edb to 0x3e07743 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:3203 writesame 0xec5eb4e thru 0xec69bb9 data_size 0xe(0xb06c bytes) 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:3204 write 0x1dec0f2 thru 0x1df3a49 (0x7958 bytes) 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:3205 write 0xc717b7d thru 0xc71f533 (0x79b7 bytes) 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:3208 punch from 0xa62b710 to 0xa62c1bf, (0xaaf bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3210 write 0xc2d4c35 thru 0xc2e42de (0xf6aa bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3211 read 0x7b76a9 thru 0x7c76a2 (0xfffa bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3212 trunc from 0xec69bba to 0x52aea6b 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3213 read 0x14773c thru 0x15046a (0x8d2f bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3214 read 0x38fe08f thru 0x3904d32 (0x6ca4 bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3216 read 0x293c73 thru 0x2a124a (0xd5d8 bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3217 write 0x4c12030 thru 0x4c16397 (0x4368 bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3218 write 0xc43283e thru 0xc43b727 (0x8eea bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3220 read 0x5b0c79e thru 0x5b146ab (0x7f0e bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3221 write 0xba181a5 thru 0xba1ee7b (0x6cd7 bytes) 2024-09-11T05:22:31.216 INFO:teuthology.orchestra.run.smithi012.stdout:3223 punch from 0x89630e5 to 0x8966f0f, (0x3e2a bytes) 2024-09-11T05:22:31.217 INFO:teuthology.orchestra.run.smithi012.stdout:3224 read 0x504c470 thru 0x504cff7 (0xb88 bytes) 2024-09-11T05:22:31.217 INFO:teuthology.orchestra.run.smithi012.stdout:3225 writesame 0x7528406 thru 0x752dbc7 data_size 0x2f(0x57c2 bytes) 2024-09-11T05:22:31.217 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:31.211+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:31.224 INFO:teuthology.orchestra.run.smithi012.stdout:3226 writesame 0xdb37017 thru 0xdb4545a data_size 0xe(0xe444 bytes) 2024-09-11T05:22:31.224 INFO:teuthology.orchestra.run.smithi012.stdout:3228 read 0xcbe7c93 thru 0xcbe8e2e (0x119c bytes) 2024-09-11T05:22:31.224 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.224 INFO:teuthology.orchestra.run.smithi012.stdout:3230 writesame 0x2215316 thru 0x221f5c6 data_size 0x1(0xa2b1 bytes) 2024-09-11T05:22:31.247 INFO:teuthology.orchestra.run.smithi012.stdout:3231 read 0xa858751 thru 0xa85b5fe (0x2eae bytes) 2024-09-11T05:22:31.247 INFO:teuthology.orchestra.run.smithi012.stdout:3232 write 0xb5ae9b thru 0xb666fb (0xb861 bytes) 2024-09-11T05:22:31.250 INFO:teuthology.orchestra.run.smithi012.stdout:3233 read 0x12a9fff thru 0x12b6900 (0xc902 bytes) 2024-09-11T05:22:31.250 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.250 INFO:teuthology.orchestra.run.smithi012.stdout:3240 read 0x77d7da7 thru 0x77dec36 (0x6e90 bytes) 2024-09-11T05:22:31.250 INFO:teuthology.orchestra.run.smithi012.stdout:3241 punch from 0x8658110 to 0x8659015, (0xf05 bytes) 2024-09-11T05:22:31.260 INFO:teuthology.orchestra.run.smithi012.stdout:3243 trunc from 0xdb4545b to 0x4bf193c 2024-09-11T05:22:31.286 INFO:teuthology.orchestra.run.smithi012.stdout:3245 write 0xc9e57e5 thru 0xc9f1448 (0xbc64 bytes) 2024-09-11T05:22:31.289 INFO:teuthology.orchestra.run.smithi012.stdout:3247 punch from 0x6f0d044 to 0x6f19858, (0xc814 bytes) 2024-09-11T05:22:31.289 INFO:teuthology.orchestra.run.smithi012.stdout:3248 write 0x55b5b0e thru 0x55c3798 (0xdc8b bytes) 2024-09-11T05:22:31.294 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.304 INFO:teuthology.orchestra.run.smithi012.stdout:3250 trunc from 0xc9f1449 to 0x397990c 2024-09-11T05:22:31.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:31.311+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:31.315 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.332 INFO:teuthology.orchestra.run.smithi012.stdout:3252 write 0xd052a6c thru 0xd0575e2 (0x4b77 bytes) 2024-09-11T05:22:31.335 INFO:teuthology.orchestra.run.smithi012.stdout:3253 punch from 0x3929f79 to 0x393374a, (0x97d1 bytes) 2024-09-11T05:22:31.335 INFO:teuthology.orchestra.run.smithi012.stdout:3254 read 0x2c99ba8 thru 0x2c9f22c (0x5685 bytes) 2024-09-11T05:22:31.335 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:31.335 INFO:teuthology.orchestra.run.smithi012.stdout:3257 punch from 0xbd4ba8c to 0xbd4dd91, (0x2305 bytes) 2024-09-11T05:22:31.335 INFO:teuthology.orchestra.run.smithi012.stdout:3258 read 0x3f355d8 thru 0x3f3e43e (0x8e67 bytes) 2024-09-11T05:22:31.335 INFO:teuthology.orchestra.run.smithi012.stdout:3259 read 0x5d4653d thru 0x5d5294b (0xc40f bytes) 2024-09-11T05:22:31.336 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:31.337 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:31.337 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:31.337 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:31.344 INFO:teuthology.orchestra.run.smithi012.stdout:3260 trunc from 0xd0575e3 to 0x4c004f5 2024-09-11T05:22:31.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:31.366 INFO:teuthology.orchestra.run.smithi012.stdout:3261 write 0x8e96390 thru 0x8ea5b16 (0xf787 bytes) 2024-09-11T05:22:31.369 INFO:teuthology.orchestra.run.smithi012.stdout:3262 punch from 0x14ec56a to 0x14edb16, (0x15ac bytes) 2024-09-11T05:22:31.369 INFO:teuthology.orchestra.run.smithi012.stdout:3263 punch from 0x8aa70b to 0x8b76e1, (0xcfd6 bytes) 2024-09-11T05:22:31.370 INFO:teuthology.orchestra.run.smithi012.stdout:3265 read 0xb9ea1e thru 0xbac5ec (0xdbcf bytes) 2024-09-11T05:22:31.370 INFO:teuthology.orchestra.run.smithi012.stdout:3266 punch from 0x1effcd1 to 0x1f0a84f, (0xab7e bytes) 2024-09-11T05:22:31.370 INFO:teuthology.orchestra.run.smithi012.stdout:3267 punch from 0x5d4df5a to 0x5d541f5, (0x629b bytes) 2024-09-11T05:22:31.372 INFO:teuthology.orchestra.run.smithi012.stdout:3268 trunc from 0x8ea5b17 to 0x6422b0e 2024-09-11T05:22:31.382 INFO:teuthology.orchestra.run.smithi012.stdout:3270 punch from 0x4b163d6 to 0x4b188d6, (0x2500 bytes) 2024-09-11T05:22:31.389 INFO:teuthology.orchestra.run.smithi012.stdout:3272 write 0x782cc99 thru 0x7836972 (0x9cda bytes) 2024-09-11T05:22:31.393 INFO:teuthology.orchestra.run.smithi012.stdout:3273 clone 27 order 25 su 524288 sc 15 2024-09-11T05:22:31.414 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:31.413+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:31.474 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:31.475 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:31.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:31.524 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:31.523+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:31.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:31.616+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:31.632 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:31.632 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58270 3.4 e40/22 3:262c4575:::rbd_data.11794a93f042.0000000000000025:head v 40'97, mlcod=39'93)", 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 28.014447438000001, 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.005817745, 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616992+0000", 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-07 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617010+0000", 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8865e-05 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617020+0000", 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3400000000000004e-06 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617026+0000", 2024-09-11T05:22:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0059999999999998e-06 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619296+0000", 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002270022 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619333+0000", 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7619e-05 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622766+0000", 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034327899999999998 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622809+0000", 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2425999999999997e-05 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58386 3.9 e40/22 3:904d4ffe:::rbd_data.11794a93f042.0000000000000053:head v 40'82, mlcod=40'80)", 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.985160554, 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004810847, 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-07 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646283+0000", 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646293+0000", 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6169999999999996e-06 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646297+0000", 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.639e-06 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646339+0000", 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1848999999999999e-05 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646356+0000", 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.698e-05 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651047+0000", 2024-09-11T05:22:31.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046910700000000003 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651089+0000", 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1298000000000003e-05 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.642 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58412 3.1e e40/37 3:7bbe3ffa:::rbd_data.11794a93f042.0000000000000063:head v 40'93, mlcod=40'91)", 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.973346718999998, 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047628849999999997, 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4700000000000001e-07 2024-09-11T05:22:31.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658101+0000", 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5229999999999995e-06 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658115+0000", 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3776e-05 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658124+0000", 2024-09-11T05:22:31.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3030000000000005e-06 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658183+0000", 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9382000000000002e-05 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658207+0000", 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3507999999999999e-05 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662817+0000", 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046103150000000002 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662854+0000", 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7431000000000001e-05 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58436 3.0 e40/22 3:01dc6865:::rbd_data.11794a93f042.000000000000006e:head v 40'96, mlcod=40'93)", 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:31.647 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.965424146, 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051595490000000003, 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666015+0000", 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666019+0000", 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3170000000000003e-06 2024-09-11T05:22:31.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666028+0000", 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4080000000000004e-06 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666035+0000", 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666084+0000", 2024-09-11T05:22:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9490999999999998e-05 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666108+0000", 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3728000000000001e-05 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671117+0000", 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050084129999999998 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671174+0000", 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7130999999999999e-05 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58444 3.4 e40/22 3:207494c7:::rbd_data.11794a93f042.0000000000000070:head v 40'103, mlcod=40'101)", 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.962256231000001, 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048760670000000004, 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669183+0000", 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5400000000000001e-07 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669189+0000", 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1449999999999996e-06 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669202+0000", 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2819999999999999e-05 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669209+0000", 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3540000000000002e-06 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669257+0000", 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7490000000000001e-05 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669270+0000", 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3018e-05 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674028+0000", 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047580419999999997 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674058+0000", 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0543999999999998e-05 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58574 3.9 e40/22 3:96a6d2a0:::rbd_data.11794a93f042.00000000000000b3:head v 40'84, mlcod=40'82)", 2024-09-11T05:22:31.656 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.918832801000001, 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048300169999999998, 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712612+0000", 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712622+0000", 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9340000000000001e-06 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712628+0000", 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3069999999999999e-06 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712676+0000", 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7731000000000001e-05 2024-09-11T05:22:31.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712688+0000", 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1659e-05 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717368+0000", 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046800399999999999 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717436+0000", 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7885999999999993e-05 2024-09-11T05:22:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 397 entries 40'85 (0'0) error 3:9228f1d6:::rbd_data.11794a93f042.00000000000000d9:head by client.4473.0:58643 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'83)", 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.891768019000001, 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004918164, 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739671+0000", 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3300000000000002e-07 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739678+0000", 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739694+0000", 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6099999999999998e-05 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739703+0000", 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3489999999999998e-06 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739776+0000", 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2795999999999999e-05 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744588+0000", 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004812424 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.664 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 988 entries 40'98 (0'0) error 3:7aa91a15:::rbd_data.11794a93f042.00000000000000da:head by client.4473.0:58645 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'96)", 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.891644216, 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047959609999999996, 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739795+0000", 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3600000000000003e-07 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739803+0000", 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5499999999999995e-06 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739823+0000", 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0182000000000001e-05 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739838+0000", 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4618e-05 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739894+0000", 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6373999999999999e-05 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744590+0000", 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046956009999999998 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58825 3.4 e40/22 3:20d0ea81:::rbd_data.11794a93f042.0000000000000129:head v 40'117, mlcod=40'115)", 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.843090544999999, 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048385770000000002, 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788353+0000", 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0309999999999998e-06 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788362+0000", 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2600000000000005e-06 2024-09-11T05:22:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788368+0000", 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.964e-06 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788419+0000", 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1829000000000001e-05 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788437+0000", 2024-09-11T05:22:31.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7671000000000001e-05 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793143+0000", 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047061539999999997 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793186+0000", 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3137999999999999e-05 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.0 epoch 40/22 rep_tid 309 entries 40'109 (0'0) error 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head by client.4473.0:58874 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.824594810000001, 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051466819999999996, 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806844+0000", 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9400000000000005e-07 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806852+0000", 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806873+0000", 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0216000000000001e-05 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806890+0000", 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7002000000000001e-05 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806949+0000", 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9206999999999997e-05 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.811990+0000", 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050413639999999996 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1034 entries 40'110 (0'0) error 3:7a5c3482:::rbd_data.11794a93f042.0000000000000147:head by client.4473.0:58878 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.821728105999998, 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050452520000000001, 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809711+0000", 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5099999999999999e-07 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809719+0000", 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1699999999999997e-06 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809741+0000", 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2204999999999998e-05 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809760+0000", 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8855000000000002e-05 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809835+0000", 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4746999999999994e-05 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.814755+0000", 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049206240000000002 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58889 3.0 e40/22 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head v 40'110, mlcod=40'108)", 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.818863001, 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050379939999999996, 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:31.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812576+0000", 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5300000000000003e-07 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812581+0000", 2024-09-11T05:22:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9150000000000004e-06 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812591+0000", 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.73e-06 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812597+0000", 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812641+0000", 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4471999999999997e-05 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812659+0000", 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8397e-05 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817574+0000", 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049149750000000002 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817613+0000", 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8899000000000001e-05 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1037 entries 40'111 (0'0) error 3:7a47fa34:::rbd_data.11794a93f042.000000000000014e:head by client.4473.0:58896 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'109)", 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.816018577000001, 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048999350000000002, 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815421+0000", 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5899999999999995e-07 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815428+0000", 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.695e-06 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815447+0000", 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9063999999999999e-05 2024-09-11T05:22:31.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815468+0000", 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1129e-05 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815560+0000", 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1926e-05 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820320+0000", 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047592620000000002 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59625 3.1e e40/37 3:788c33b7:::rbd_data.117971c15f82.0000000000000007:head v 40'119, mlcod=40'117)", 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 27.462669563999999, 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.023475949999999999, 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.688 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168771+0000", 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4399999999999999e-06 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171485+0000", 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0027135879999999999 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171507+0000", 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2240000000000001e-05 2024-09-11T05:22:31.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171519+0000", 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1625e-05 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171595+0000", 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6513000000000004e-05 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171620+0000", 2024-09-11T05:22:31.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4960000000000002e-05 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192195+0000", 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.020575192999999999 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192245+0000", 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9391000000000002e-05 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.692 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68526 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'203, mlcod=52'200)", 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.112425+0000", 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.519013499, 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050317799999999996, 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112425+0000", 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112425+0000", 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112426+0000", 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9999999999999997e-07 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112436+0000", 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0947e-05 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112446+0000", 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112453+0000", 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9009999999999997e-06 2024-09-11T05:22:31.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112500+0000", 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6589999999999999e-05 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112511+0000", 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1508999999999999e-05 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.117427+0000", 2024-09-11T05:22:31.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049158379999999996 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.117457+0000", 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9558999999999999e-05 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68527 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'204, mlcod=52'200)", 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:31.697 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.518253415, 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0070096050000000003, 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:31.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.75e-07 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113189+0000", 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5410000000000001e-06 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113198+0000", 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0429999999999996e-06 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113205+0000", 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7680000000000003e-06 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113242+0000", 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7641000000000001e-05 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113256+0000", 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4036000000000001e-05 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120148+0000", 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0068916020000000001 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120194+0000", 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6499000000000003e-05 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.701 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68528 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'205, mlcod=52'200)", 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.517504287, 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0062974270000000004, 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113938+0000", 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7720000000000001e-06 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113946+0000", 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6480000000000003e-06 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113952+0000", 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8610000000000003e-06 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113981+0000", 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9243000000000001e-05 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113991+0000", 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0064000000000001e-05 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120197+0000", 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0062062280000000003 2024-09-11T05:22:31.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120231+0000", 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4180000000000001e-05 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68529 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'206, mlcod=52'201)", 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.516550522999999, 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0053823090000000001, 2024-09-11T05:22:31.706 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2500000000000005e-07 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114893+0000", 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3080000000000001e-06 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114902+0000", 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.969e-06 2024-09-11T05:22:31.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114908+0000", 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.268e-06 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114940+0000", 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1930000000000001e-05 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114950+0000", 2024-09-11T05:22:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8539999999999992e-06 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120233+0000", 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0052830519999999999 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120270+0000", 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7302999999999998e-05 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68943 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'281, mlcod=52'278)", 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.548565+0000", 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.082873639000001, 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047432430000000003, 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548565+0000", 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548565+0000", 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548566+0000", 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4300000000000001e-06 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548576+0000", 2024-09-11T05:22:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0213e-05 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548601+0000", 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4593e-05 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548619+0000", 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8110000000000001e-05 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548727+0000", 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107833 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548763+0000", 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6458999999999998e-05 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.553281+0000", 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045176060000000004 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.553308+0000", 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6999e-05 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70786 3.0 e57/22 3:00e24595:::rbd_object_map.1179db619f31:head v 57'171, mlcod=57'166)", 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.930593+0000", 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.7008453840000008, 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050076629999999999, 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:31.715 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930593+0000", 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930593+0000", 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:31.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930594+0000", 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7599999999999997e-07 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930599+0000", 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3109999999999996e-06 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930610+0000", 2024-09-11T05:22:31.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1582e-05 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930617+0000", 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930666+0000", 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8751000000000001e-05 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:31.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930688+0000", 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1985999999999999e-05 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.935559+0000", 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004870816 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.935601+0000", 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1548999999999998e-05 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.719 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:31.720 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:31.720 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:31.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:22:31.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:31.722 INFO:teuthology.orchestra.run.smithi012.stderr:marked out osd.4. 2024-09-11T05:22:31.723 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:31.720+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:31.824 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:31.822+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:31.871 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:31.872 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:31.872 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:31.872 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:31.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:31.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:31.924+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:31.989 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:31.989 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:31.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:32.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:32.038+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:32.125 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:32.125+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:32.147 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:32.147 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:32.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:32.147 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.402827277999997, 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:32.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.402815390000001, 2024-09-11T05:22:32.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:32.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.402778169999998, 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:32.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.402763389, 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:32.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:32.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.402752053, 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:32.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:32.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.401601251999999, 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.401586797, 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:32.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:32.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.401576317, 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.184 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.401565849999997, 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.185 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:32.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:32.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:32.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.401547489999999, 2024-09-11T05:22:32.189 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:32.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:32.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:32.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:32.195 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.398838417999997, 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.196 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:32.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:32.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.398815417999998, 2024-09-11T05:22:32.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:32.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.398794055000003, 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.205 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:32.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.398772536000003, 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:32.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.398751609000001, 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:32.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.396918184999997, 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:32.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:32.223 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.396907872, 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:32.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:32.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.396897498999998, 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:32.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.396882470000001, 2024-09-11T05:22:32.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:32.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.236 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:32.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.238 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.396872461999997, 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:32.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:32.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:32.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:32.243 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:32.243 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:32.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:32.244 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:32.244+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:32.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:32.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:32.343+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:32.349 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:32.350 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:32.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:22:32.416 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:32.416 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:32.433 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:32.434 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:32.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:32.444+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:32.450 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:32.465 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:32.465 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:32.465 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:32.466 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:32.474 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:32.483 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:32.500 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:32.500 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:32.516 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:32.533 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:32.578 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:32.579 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:32.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:32.584+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:32.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:32.647 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:32.647+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:32.692 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:32.692 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:32.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:32.749 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:32.748+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:32.843 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:32.849 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:32.849+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:32.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:32.950 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:32.949+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:32.953 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:32.953 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:32.963 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:33.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:33.051+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:33.066 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:33.066 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:33.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:33.152 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:33.151+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:33.179 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:33.179 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:33.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:33.272 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:33.272+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:33.333 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:33.333 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:33.342 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:33.383 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:33.383+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:33.455 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:33.454+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:33.510 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:33.510 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:33.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:33.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:33.555+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:33.627 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-11T05:22:33.645 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:33.645 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:33.657 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:33.657 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:33.656+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:33.757 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:33.757+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:33.782 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:33.782 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:33.783 INFO:teuthology.orchestra.run.smithi012.stdout:3274 write 0xd2ba635 thru 0xd2c8dba (0xe786 bytes) 2024-09-11T05:22:33.788 INFO:teuthology.orchestra.run.smithi012.stdout:3275 writesame 0x933be55 thru 0x933f2e5 data_size 0x1(0x3491 bytes) 2024-09-11T05:22:33.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:33.800 INFO:teuthology.orchestra.run.smithi012.stdout:3277 write 0xa440d0d thru 0xa4454fe (0x47f2 bytes) 2024-09-11T05:22:33.805 INFO:teuthology.orchestra.run.smithi012.stdout:3278 writesame 0x4c61c37 thru 0x4c66300 data_size 0x29(0x46ca bytes) 2024-09-11T05:22:33.812 INFO:teuthology.orchestra.run.smithi012.stdout:3279 read 0x585c12 thru 0x58ba5d (0x5e4c bytes) 2024-09-11T05:22:33.822 INFO:teuthology.orchestra.run.smithi012.stdout:3282 write 0xe43ac85 thru 0xe44994f (0xeccb bytes) 2024-09-11T05:22:33.828 INFO:teuthology.orchestra.run.smithi012.stdout:3283 read 0x437cd60 thru 0x43886ef (0xb990 bytes) 2024-09-11T05:22:33.837 INFO:teuthology.orchestra.run.smithi012.stdout:3285 trunc from 0xe449950 to 0x75a16b1 2024-09-11T05:22:33.858 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:33.858+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:33.872 INFO:teuthology.orchestra.run.smithi012.stdout:3286 read 0x10c173d thru 0x10c2647 (0xf0b bytes) 2024-09-11T05:22:33.872 INFO:teuthology.orchestra.run.smithi012.stdout:3288 read 0x158a470 thru 0x15920b6 (0x7c47 bytes) 2024-09-11T05:22:33.872 INFO:teuthology.orchestra.run.smithi012.stdout:3289 read 0x4d43cea thru 0x4d4f670 (0xb987 bytes) 2024-09-11T05:22:33.873 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:33.873 INFO:teuthology.orchestra.run.smithi012.stdout:3291 clone 28 order 22 su 2097152 sc 2 2024-09-11T05:22:33.936 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:33.936 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:33.946 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:33.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:33.987+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:34.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:34.059+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:34.113 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:34.113 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:34.123 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:34.160 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:34.160+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:34.261 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:34.261+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:34.271 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:34.271 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:34.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:34.363 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:34.363+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:34.419 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:22:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:34.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:34.484 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:34.483+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:34.545 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:34.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:34.588+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:34.593 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:34.593 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:34.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:34.666 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:34.666+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:34.675 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:34.675 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:34.692 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:34.692 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:34.708 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:22:34.725 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:34.742 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:34.755 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13288 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1490944~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.998599489999997, 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011792074, 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13288 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755775+0000", 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755776+0000", 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2199999999999999e-07 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755778+0000", 2024-09-11T05:22:34.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755785+0000", 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7000000000000008e-06 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755790+0000", 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0769999999999998e-06 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767439+0000", 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011648067 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767496+0000", 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7098000000000001e-05 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767567+0000", 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.761 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13298 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1949696~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.998577562999998, 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011903945000000001, 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.762 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13298 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:34.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755798+0000", 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2e-07 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755800+0000", 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.934e-06 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755806+0000", 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2899999999999999e-06 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755811+0000", 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8210000000000001e-06 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767588+0000", 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011776963999999999 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767636+0000", 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8304999999999999e-05 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767701+0000", 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5210999999999996e-05 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.766 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13305 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 2048000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.998558078999999, 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996071000000001, 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13305 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:34.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755819+0000", 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.888e-06 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755825+0000", 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9190000000000004e-06 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755830+0000", 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5740000000000003e-06 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767722+0000", 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011891273000000001 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767769+0000", 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7144000000000001e-05 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767813+0000", 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3863000000000003e-05 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13308 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1769472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.998536412999997, 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012084722000000001, 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13308 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755839+0000", 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755841+0000", 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755847+0000", 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1859999999999997e-06 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755852+0000", 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767833+0000", 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011981331 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767880+0000", 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6350000000000002e-05 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767923+0000", 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3568e-05 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.775 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13314 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1769472~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.998516860999999, 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012198718000000001, 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.776 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13314 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755860+0000", 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7719999999999999e-06 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755867+0000", 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9260000000000003e-06 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755872+0000", 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767948+0000", 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012076643 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767995+0000", 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6461999999999997e-05 2024-09-11T05:22:34.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768057+0000", 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1846000000000004e-05 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13322 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.998488729999998, 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012296951, 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13322 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.781 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:34.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755889+0000", 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755896+0000", 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8560000000000001e-06 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755901+0000", 2024-09-11T05:22:34.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1019999999999996e-06 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768078+0000", 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012177248999999999 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768126+0000", 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929000000000001e-05 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768183+0000", 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7005000000000001e-05 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13325 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.998466802000003, 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01241014, 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13325 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755924+0000", 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5636000000000001e-05 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755931+0000", 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9500000000000004e-06 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755936+0000", 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1120000000000004e-06 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768203+0000", 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012267072 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768254+0000", 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0766000000000001e-05 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768318+0000", 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4233000000000007e-05 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13333 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 573440~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.997719781000001, 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011798149000000001, 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13333 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756655+0000", 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756656+0000", 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4099999999999998e-07 2024-09-11T05:22:34.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756659+0000", 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6219999999999998e-06 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756668+0000", 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5210000000000002e-06 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.756674+0000", 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8130000000000001e-06 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768339+0000", 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011665310999999999 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768391+0000", 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2179000000000003e-05 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768453+0000", 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2062000000000003e-05 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13343 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996949921000002, 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011833961, 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.794 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13343 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757428+0000", 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:22:34.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757437+0000", 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757443+0000", 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769090+0000", 2024-09-11T05:22:34.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011647014000000001 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769166+0000", 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5998e-05 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769259+0000", 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2699000000000001e-05 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13344 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1818624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996924606999997, 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996009, 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13344 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.799 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757451+0000", 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6699999999999999e-07 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757453+0000", 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757462+0000", 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1649999999999995e-06 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757467+0000", 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4890000000000003e-06 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769291+0000", 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011823422 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769370+0000", 2024-09-11T05:22:34.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8658999999999993e-05 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769446+0000", 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6604e-05 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13348 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996887326, 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.016500531999999998, 2024-09-11T05:22:34.803 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13348 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:34.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757488+0000", 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.82e-07 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757491+0000", 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8080000000000001e-06 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757502+0000", 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1245e-05 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757510+0000", 2024-09-11T05:22:34.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0669999999999992e-06 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769949+0000", 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012439131000000001 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770026+0000", 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6464000000000005e-05 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.773988+0000", 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039622349999999997 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13351 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996855834999998, 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012814249, 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13351 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.75e-07 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757522+0000", 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1739999999999999e-06 2024-09-11T05:22:34.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757531+0000", 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8519999999999999e-06 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757539+0000", 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.763e-06 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770160+0000", 2024-09-11T05:22:34.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012621267 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770234+0000", 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3619000000000001e-05 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770333+0000", 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9098999999999994e-05 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13353 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996825952000002, 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012966811999999999, 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13353 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757552+0000", 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3209999999999999e-06 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757559+0000", 2024-09-11T05:22:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2779999999999996e-06 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757564+0000", 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770358+0000", 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012793617 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770426+0000", 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8201000000000007e-05 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770516+0000", 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9889000000000006e-05 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13409 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 49152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996791233000003, 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013098782999999999, 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13409 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.818 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757588+0000", 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1609999999999996e-06 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757598+0000", 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5189999999999998e-06 2024-09-11T05:22:34.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757604+0000", 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770540+0000", 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012935854 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770605+0000", 2024-09-11T05:22:34.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5505000000000004e-05 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770682+0000", 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7296e-05 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13413 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996761827, 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013233299, 2024-09-11T05:22:34.822 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13413 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757616+0000", 2024-09-11T05:22:34.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1270000000000001e-06 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757624+0000", 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4470000000000006e-06 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757629+0000", 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2220000000000001e-06 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770705+0000", 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013075646 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770770+0000", 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4678000000000007e-05 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770846+0000", 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6723000000000004e-05 2024-09-11T05:22:34.826 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13419 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.996738323000002, 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013374044, 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13419 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:34.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757637+0000", 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757639+0000", 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9e-06 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757649+0000", 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7909999999999999e-06 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757654+0000", 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.378e-06 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770870+0000", 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013215873 2024-09-11T05:22:34.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770935+0000", 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4887000000000004e-05 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.771010+0000", 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5778999999999994e-05 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:59624 3.19 3:9b48071f:::rbd_data.117971c15f82.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 30.591690617000001, 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.032257185000000001, 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 59624 2024-09-11T05:22:34.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162689+0000", 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165796+0000", 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031078490000000002 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165845+0000", 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8242000000000003e-05 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165867+0000", 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2005e-05 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165990+0000", 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012330199999999999 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166150+0000", 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016035999999999999 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166799+0000", 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064827299999999999 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191931+0000", 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025131982000000001 2024-09-11T05:22:34.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194856+0000", 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002925825 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194897+0000", 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0252e-05 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194941+0000", 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4746000000000002e-05 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70775 3.6 e57/22 3:65762739:::rbd_data.1179db619f31.0000000000000005:head v 57'258, mlcod=57'256)", 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 12.866047368, 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029681609000000001, 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:34.838 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888329+0000", 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.75e-06 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893284+0000", 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049547510000000003 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893317+0000", 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2780000000000001e-05 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893327+0000", 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.893e-06 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893386+0000", 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9367999999999998e-05 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893414+0000", 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8028999999999999e-05 2024-09-11T05:22:34.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.917939+0000", 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024524607 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918009+0000", 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0431000000000004e-05 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:76285 3.19 3:99554f66:::rbd_data.117930a4df71.000000000000001a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.6047290209999998, 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.022701743, 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 76285 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:34.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149651+0000", 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2130000000000002e-06 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149661+0000", 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0699999999999999e-05 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149666+0000", 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8459999999999999e-06 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149721+0000", 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4701999999999999e-05 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149869+0000", 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000147995 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.154094+0000", 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0042250810000000003 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172268+0000", 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.018174299000000001 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172280+0000", 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1839e-05 2024-09-11T05:22:34.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172315+0000", 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5055999999999998e-05 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172347+0000", 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2283999999999998e-05 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:77037 3.4 3:26ddd74e:::rbd_data.117930a4df71.0000000000000010:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:31.226233+0000", 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.5281421760000002, 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.020930095999999999, 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 77037 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.849 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226233+0000", 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226233+0000", 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:34.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226235+0000", 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226243+0000", 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8659999999999995e-06 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226260+0000", 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6846000000000001e-05 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226268+0000", 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3130000000000001e-06 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226325+0000", 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7683000000000003e-05 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226442+0000", 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116494 2024-09-11T05:22:34.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.229876+0000", 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034346749999999999 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247078+0000", 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017201050999999998 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247089+0000", 2024-09-11T05:22:34.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1620000000000001e-05 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247123+0000", 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4283999999999999e-05 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247163+0000", 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9283000000000003e-05 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.854 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:34.855 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:34.855 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:34.855 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:34.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:34.857 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:34.857 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:34.858 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:34.858 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:34.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:34.855+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:34.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:34.956+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:35.004 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:35.004 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:35.005 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:35.005 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:35.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:22:35.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:35.096+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:35.158 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:35.159+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:35.160 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:35.161 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:35.161 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:35.161 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:35.161 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:35.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:22:35.259 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:35.259+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:35.319 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58270 3.4 e40/22 3:262c4575:::rbd_data.11794a93f042.0000000000000025:head v 40'97, mlcod=39'93)", 2024-09-11T05:22:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.700858751999998, 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.005817745, 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616991+0000", 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.616992+0000", 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-07 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617010+0000", 2024-09-11T05:22:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8865e-05 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617020+0000", 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3400000000000004e-06 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.617026+0000", 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0059999999999998e-06 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619296+0000", 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002270022 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.619333+0000", 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7619e-05 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622766+0000", 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034327899999999998 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.622809+0000", 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2425999999999997e-05 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58386 3.9 e40/22 3:904d4ffe:::rbd_data.11794a93f042.0000000000000053:head v 40'82, mlcod=40'80)", 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.671571868000001, 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004810847, 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646278+0000", 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-07 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646283+0000", 2024-09-11T05:22:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646293+0000", 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6169999999999996e-06 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646297+0000", 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.639e-06 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646339+0000", 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1848999999999999e-05 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.646356+0000", 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.698e-05 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651047+0000", 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046910700000000003 2024-09-11T05:22:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.651089+0000", 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1298000000000003e-05 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58412 3.1e e40/37 3:7bbe3ffa:::rbd_data.11794a93f042.0000000000000063:head v 40'93, mlcod=40'91)", 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.659758032999999, 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047628849999999997, 2024-09-11T05:22:35.329 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658092+0000", 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4700000000000001e-07 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658101+0000", 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5229999999999995e-06 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658115+0000", 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3776e-05 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658124+0000", 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3030000000000005e-06 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658183+0000", 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9382000000000002e-05 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.658207+0000", 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3507999999999999e-05 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662817+0000", 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046103150000000002 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.662854+0000", 2024-09-11T05:22:35.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7431000000000001e-05 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58436 3.0 e40/22 3:01dc6865:::rbd_data.11794a93f042.000000000000006e:head v 40'96, mlcod=40'93)", 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.651835460000001, 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051595490000000003, 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666014+0000", 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666015+0000", 2024-09-11T05:22:35.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666019+0000", 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3170000000000003e-06 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666028+0000", 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4080000000000004e-06 2024-09-11T05:22:35.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666035+0000", 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666084+0000", 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9490999999999998e-05 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.666108+0000", 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3728000000000001e-05 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671117+0000", 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050084129999999998 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.671174+0000", 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7130999999999999e-05 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58444 3.4 e40/22 3:207494c7:::rbd_data.11794a93f042.0000000000000070:head v 40'103, mlcod=40'101)", 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.648667544999999, 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048760670000000004, 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669182+0000", 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669183+0000", 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5400000000000001e-07 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669189+0000", 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1449999999999996e-06 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669202+0000", 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2819999999999999e-05 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669209+0000", 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3540000000000002e-06 2024-09-11T05:22:35.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669257+0000", 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7490000000000001e-05 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.669270+0000", 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3018e-05 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674028+0000", 2024-09-11T05:22:35.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047580419999999997 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.674058+0000", 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0543999999999998e-05 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58574 3.9 e40/22 3:96a6d2a0:::rbd_data.11794a93f042.00000000000000b3:head v 40'84, mlcod=40'82)", 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.605244115000001, 2024-09-11T05:22:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048300169999999998, 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712606+0000", 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7199999999999999e-07 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712612+0000", 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712622+0000", 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9340000000000001e-06 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712628+0000", 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3069999999999999e-06 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712676+0000", 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7731000000000001e-05 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.712688+0000", 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1659e-05 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717368+0000", 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046800399999999999 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.717436+0000", 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7885999999999993e-05 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.347 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.9 epoch 40/22 rep_tid 397 entries 40'85 (0'0) error 3:9228f1d6:::rbd_data.11794a93f042.00000000000000d9:head by client.4473.0:58643 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'83)", 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.578179333000001, 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004918164, 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739670+0000", 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739671+0000", 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3300000000000002e-07 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739678+0000", 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739694+0000", 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6099999999999998e-05 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739703+0000", 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3489999999999998e-06 2024-09-11T05:22:35.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739776+0000", 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2795999999999999e-05 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744588+0000", 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004812424 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 988 entries 40'98 (0'0) error 3:7aa91a15:::rbd_data.11794a93f042.00000000000000da:head by client.4473.0:58645 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'96)", 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.57805553, 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047959609999999996, 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739794+0000", 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739795+0000", 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3600000000000003e-07 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739803+0000", 2024-09-11T05:22:35.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5499999999999995e-06 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739823+0000", 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0182000000000001e-05 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739838+0000", 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4618e-05 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.739894+0000", 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6373999999999999e-05 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.744590+0000", 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0046956009999999998 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58825 3.4 e40/22 3:20d0ea81:::rbd_data.11794a93f042.0000000000000129:head v 40'117, mlcod=40'115)", 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:35.355 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.529501859, 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048385770000000002, 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788348+0000", 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788353+0000", 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0309999999999998e-06 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788362+0000", 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2600000000000005e-06 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788368+0000", 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.964e-06 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788419+0000", 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1829000000000001e-05 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.788437+0000", 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7671000000000001e-05 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793143+0000", 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047061539999999997 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.793186+0000", 2024-09-11T05:22:35.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3137999999999999e-05 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.0 epoch 40/22 rep_tid 309 entries 40'109 (0'0) error 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head by client.4473.0:58874 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.511006124000001, 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0051466819999999996, 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806843+0000", 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806844+0000", 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9400000000000005e-07 2024-09-11T05:22:35.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806852+0000", 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806873+0000", 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0216000000000001e-05 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806890+0000", 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7002000000000001e-05 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.806949+0000", 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9206999999999997e-05 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.811990+0000", 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050413639999999996 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.363 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1034 entries 40'110 (0'0) error 3:7a5c3482:::rbd_data.11794a93f042.0000000000000147:head by client.4473.0:58878 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'107)", 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.508139419999999, 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050452520000000001, 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:35.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809710+0000", 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809711+0000", 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5099999999999999e-07 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809719+0000", 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1699999999999997e-06 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809741+0000", 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2204999999999998e-05 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809760+0000", 2024-09-11T05:22:35.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8855000000000002e-05 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.809835+0000", 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4746999999999994e-05 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.814755+0000", 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049206240000000002 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:58889 3.0 e40/22 3:06a64194:::rbd_data.11794a93f042.0000000000000143:head v 40'110, mlcod=40'108)", 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.505274315000001, 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050379939999999996, 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812575+0000", 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812576+0000", 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5300000000000003e-07 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812581+0000", 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9150000000000004e-06 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812591+0000", 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.73e-06 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812597+0000", 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812641+0000", 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4471999999999997e-05 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.812659+0000", 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8397e-05 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817574+0000", 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049149750000000002 2024-09-11T05:22:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.817613+0000", 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8899000000000001e-05 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1e epoch 40/37 rep_tid 1037 entries 40'111 (0'0) error 3:7a47fa34:::rbd_data.11794a93f042.000000000000014e:head by client.4473.0:58896 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 40'109)", 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.502429890999998, 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048999350000000002, 2024-09-11T05:22:35.372 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815420+0000", 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815421+0000", 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5899999999999995e-07 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815428+0000", 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.695e-06 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815447+0000", 2024-09-11T05:22:35.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9063999999999999e-05 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815468+0000", 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1129e-05 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.815560+0000", 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1926e-05 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:03.820320+0000", 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047592620000000002 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:59625 3.1e e40/37 3:788c33b7:::rbd_data.117971c15f82.0000000000000007:head v 40'119, mlcod=40'117)", 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 31.149080877999999, 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.023475949999999999, 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.376 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168769+0000", 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.168771+0000", 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4399999999999999e-06 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171485+0000", 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0027135879999999999 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171507+0000", 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2240000000000001e-05 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171519+0000", 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1625e-05 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171595+0000", 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6513000000000004e-05 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.171620+0000", 2024-09-11T05:22:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4960000000000002e-05 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192195+0000", 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.020575192999999999 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.192245+0000", 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9391000000000002e-05 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68526 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'203, mlcod=52'200)", 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.112425+0000", 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.205424813, 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050317799999999996, 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112425+0000", 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112425+0000", 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112426+0000", 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9999999999999997e-07 2024-09-11T05:22:35.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112436+0000", 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0947e-05 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112446+0000", 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:22:35.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112453+0000", 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9009999999999997e-06 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112500+0000", 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6589999999999999e-05 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.112511+0000", 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1508999999999999e-05 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.117427+0000", 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049158379999999996 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.117457+0000", 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9558999999999999e-05 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68527 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'204, mlcod=52'200)", 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.204664729000001, 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0070096050000000003, 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113185+0000", 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.75e-07 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113189+0000", 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5410000000000001e-06 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113198+0000", 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0429999999999996e-06 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113205+0000", 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7680000000000003e-06 2024-09-11T05:22:35.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113242+0000", 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7641000000000001e-05 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113256+0000", 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4036000000000001e-05 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120148+0000", 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0068916020000000001 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120194+0000", 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6499000000000003e-05 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68528 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'205, mlcod=52'200)", 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:35.390 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.203915600999999, 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0062974270000000004, 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113934+0000", 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113938+0000", 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7720000000000001e-06 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113946+0000", 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6480000000000003e-06 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113952+0000", 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8610000000000003e-06 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113981+0000", 2024-09-11T05:22:35.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9243000000000001e-05 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.113991+0000", 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0064000000000001e-05 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120197+0000", 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0062062280000000003 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120231+0000", 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4180000000000001e-05 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68529 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'206, mlcod=52'201)", 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.202961837, 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0053823090000000001, 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.395 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114888+0000", 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2500000000000005e-07 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114893+0000", 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3080000000000001e-06 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114902+0000", 2024-09-11T05:22:35.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.969e-06 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114908+0000", 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.268e-06 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114940+0000", 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1930000000000001e-05 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.114950+0000", 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8539999999999992e-06 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120233+0000", 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0052830519999999999 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.120270+0000", 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7302999999999998e-05 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:68943 3.9 e52/22 3:900c3266:::rbd_object_map.11795977591d:head v 52'281, mlcod=52'278)", 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:17.548565+0000", 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.769284953, 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0047432430000000003, 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548565+0000", 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548565+0000", 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548566+0000", 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4300000000000001e-06 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548576+0000", 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0213e-05 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548601+0000", 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4593e-05 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548619+0000", 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8110000000000001e-05 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548727+0000", 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107833 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.548763+0000", 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6458999999999998e-05 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.553281+0000", 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0045176060000000004 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:17.553308+0000", 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6999e-05 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.404 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70786 3.0 e57/22 3:00e24595:::rbd_object_map.1179db619f31:head v 57'171, mlcod=57'166)", 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.930593+0000", 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 13.387256698, 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0050076629999999999, 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930593+0000", 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930593+0000", 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930594+0000", 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7599999999999997e-07 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930599+0000", 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3109999999999996e-06 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930610+0000", 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1582e-05 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930617+0000", 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930666+0000", 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8751000000000001e-05 2024-09-11T05:22:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.930688+0000", 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1985999999999999e-05 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.935559+0000", 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.004870816 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.935601+0000", 2024-09-11T05:22:35.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1548999999999998e-05 2024-09-11T05:22:35.409 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.409 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.409 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.409 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.409 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.409 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:35.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:22:35.412 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:35.410+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:35.471 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone27 from 0x75a16b1 (overlap 0x75a16b1) to 0x46940d0 2024-09-11T05:22:35.511 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:35.510+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:77616 3.b 3:d2f81839:::rbd_header.117934081e0e:head [call lock.unlock in=52b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:35.535098+0000", 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.001092099, 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001110785, 2024-09-11T05:22:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 77616 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535098+0000", 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535098+0000", 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535100+0000", 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.237e-06 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535105+0000", 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4319999999999998e-06 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535115+0000", 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0173000000000001e-05 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535120+0000", 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535177+0000", 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6589999999999999e-05 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535233+0000", 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6128999999999997e-05 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535340+0000", 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010711 2024-09-11T05:22:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.535884+0000", 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00054398200000000004 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536184+0000", 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000300394 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536214+0000", 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9986000000000001e-05 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:77616 3.b e69/22 ondisk, result = 0)", 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:35.536119+0000", 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.1036000000000002e-05, 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000160798, 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536119+0000", 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536119+0000", 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536120+0000", 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0999999999999999e-07 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536123+0000", 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5489999999999998e-06 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536133+0000", 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4390000000000006e-06 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536140+0000", 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0149999999999998e-06 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536177+0000", 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6683000000000001e-05 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.536182+0000", 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0130000000000001e-06 2024-09-11T05:22:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:22:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 2 2024-09-11T05:22:35.546 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:35.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:35.565 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-11T05:22:35.612 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:35.612+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:35.683 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:35.683 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:35.683 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:35.683 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:35.683 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:35.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:35.701 INFO:teuthology.orchestra.run.smithi012.stdout:3292 writesame 0x982a0b thru 0x98c4ad data_size 0x1(0x9aa3 bytes) 2024-09-11T05:22:35.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:35.711+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:35.728 INFO:teuthology.orchestra.run.smithi012.stdout:3294 read 0x93f06f thru 0x944134 (0x50c6 bytes) 2024-09-11T05:22:35.729 INFO:teuthology.orchestra.run.smithi012.stdout:3295 read 0x3adabac thru 0x3ade347 (0x379c bytes) 2024-09-11T05:22:35.729 INFO:teuthology.orchestra.run.smithi012.stdout:3296 write 0x66ecf0 thru 0x67aa15 (0xbd26 bytes) 2024-09-11T05:22:35.749 INFO:teuthology.orchestra.run.smithi012.stdout:3297 write 0xe90d1de thru 0xe9156d6 (0x84f9 bytes) 2024-09-11T05:22:35.752 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:35.752 INFO:teuthology.orchestra.run.smithi012.stdout:3299 read 0x264057a thru 0x2649e7e (0x9905 bytes) 2024-09-11T05:22:35.753 INFO:teuthology.orchestra.run.smithi012.stdout:3300 clone 29 order 21 su 131072 sc 4 2024-09-11T05:22:35.807 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.062636206000001, 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.062624317999997, 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.062587098000002, 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.062572316999997, 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.062560980999997, 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.061410180000003, 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.061395724999997, 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.061385244999997, 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.061374778000001, 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.061356418000003, 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.058647346000001, 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.058624346000002, 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.058602983, 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:35.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.058581464, 2024-09-11T05:22:35.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:35.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.058560536999998, 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.873 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:35.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.056727113000001, 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.056716799999997, 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:35.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:35.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.056706427000002, 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:35.886 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:35.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:35.890 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.056691397999998, 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:35.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:35.894 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.056681390000001, 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:35.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:35.898 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:35.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:35.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:35.899+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:36.001 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:36.001+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:36.011 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:36.011 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:36.011 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:36.011 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:36.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:36.103 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:36.103+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:36.163 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:36.164 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:36.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:36.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:36.202+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:36.304 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:36.304+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:36.317 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.683499671, 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.681358150000001, 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.681336586, 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.681322575000003, 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.679497273999999, 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.679482671000002, 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.679465366000002, 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.679441257000001, 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.679413181000001, 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.679386188999999, 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.67934563, 2024-09-11T05:22:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.679322243000001, 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.583337135999997, 2024-09-11T05:22:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.583317575999999, 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.583298360999997, 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:36.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.583277561000003, 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.388 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.392 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.699177045999999, 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:22:36.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:22:36.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:22:36.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.696187238, 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:22:36.399 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:22:36.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:22:36.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:36.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:22:36.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:22:36.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.231590346000001, 2024-09-11T05:22:36.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:22:36.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:22:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.6970064580000006, 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:22:36.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.421 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:36.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:36.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:36.421+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:36.492 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone28 from 0xe9156d7 (overlap 0x75a16b1) to 0x5e1abc0 2024-09-11T05:22:36.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:36.522+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:36.570 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:36.570 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:36.570 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:36.570 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:36.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:36.606 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-11T05:22:36.624 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:36.623+0000 7f155654c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33290) UID: 0 2024-09-11T05:22:36.684 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:36.685 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:36.685 INFO:teuthology.orchestra.run.smithi012.stdout:3301 read 0x86699 thru 0x939e2 (0xd34a bytes) 2024-09-11T05:22:36.686 INFO:teuthology.orchestra.run.smithi012.stdout:3302 writesame 0x2224b90 thru 0x22263a9 data_size 0x5(0x181a bytes) 2024-09-11T05:22:36.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:36.694 INFO:teuthology.orchestra.run.smithi012.stdout:3305 writesame 0x7c62a7c thru 0x7c69da5 data_size 0x1(0x732a bytes) 2024-09-11T05:22:36.711 INFO:teuthology.orchestra.run.smithi012.stdout:3306 trunc from 0xe9156d7 to 0xbefb9bd 2024-09-11T05:22:36.723 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6] out_osds: [7, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:22:36.723 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:22:36.724 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:22:36.724 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T05:22:36.724 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:22:36.737 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:36.737+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:36.753 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T05:22:36.754 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2024-09-11T05:22:36.754 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:22:36.754 DEBUG:teuthology.orchestra.run.smithi012:> type ceph-objectstore-tool 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.203462694999999, 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.203235198999998, 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.202980384999996, 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.202611490000002, 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.202449944000001, 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.202007209000001, 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.199860315999999, 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.197829763999998, 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.197809378999999, 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.980625574000001, 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.980604550000002, 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.980580295000003, 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.978901211, 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.978881864999998, 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.978861092999999, 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.978841682999999, 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.978821214, 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.978802324, 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.969464531, 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.969453704999999, 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:36.895 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:36.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:36.898 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T05:22:36.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:36.899 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:36.897+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:36.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2024-09-11T05:22:36.997 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:36.996+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:37.043 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:37.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:37.063 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:37.081 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:37.098 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:37.098+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:37.155 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:37.156 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:37.156 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:37.163 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:37.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:37.199+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:37.300 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:37.300+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:37.308 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:37.308 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:37.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:37.308 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:37.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 68.556667082000004, 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:37.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:37.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:37.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:37.316 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.553588519999998, 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:37.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.553571220000002, 2024-09-11T05:22:37.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:37.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.553545184999997, 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.553528958999998, 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.553506503000001, 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.553472423999999, 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.553434803000002, 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.552869962999999, 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.552820865000001, 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.268165787000001, 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.268146168999998, 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.265556115000003, 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.265125973000004, 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.265091552999998, 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.214001238999998, 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.143549622000002, 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63898 3.11 3:89620d31:::rbd_data.117960679f52.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.186479690999999, 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709826999999999, 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63898 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120804+0000", 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120808+0000", 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120817+0000", 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120821+0000", 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120858+0000", 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6863999999999998e-05 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120951+0000", 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2541999999999996e-05 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.124305+0000", 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00335389 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140413+0000", 2024-09-11T05:22:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016108245 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140444+0000", 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1578000000000002e-05 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140482+0000", 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140513+0000", 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1477999999999999e-05 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:70954 3.14 e57/22 3:2fcfd35d:::rbd_data.1179db619f31.0000000000000009:head v 57'288, mlcod=56'286)", 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.341714469999999, 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023605603999999999, 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965570+0000", 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7630000000000001e-06 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971434+0000", 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058634300000000002 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971457+0000", 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3436999999999999e-05 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971471+0000", 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3776e-05 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971538+0000", 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7074000000000002e-05 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971565+0000", 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6914e-05 2024-09-11T05:22:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989115+0000", 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017549754000000001 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989174+0000", 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9456000000000001e-05 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71938 3.f 3:f110c0b8:::rbd_data.1179db619f31.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.807536018, 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027012653000000001, 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71938 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499748+0000", 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:22:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499752+0000", 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499762+0000", 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7610000000000002e-06 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499767+0000", 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.118e-06 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499813+0000", 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6168999999999998e-05 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499871+0000", 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8394999999999999e-05 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.503877+0000", 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040059290000000001 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526608+0000", 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022730899999999998 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526628+0000", 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9556e-05 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526686+0000", 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7839e-05 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526760+0000", 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4146000000000005e-05 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:37.407 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:37.409 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:37.408+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:37.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:37.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:22:37.510 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:37.509+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:37.521 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:37.521 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:37.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:37.610 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:37.610+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:37.649 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:37.649 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:37.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:37.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:37.710+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:37.773 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:37.773 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:37.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:37.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:37.822+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:37.912 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:37.913+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:37.929 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:37.929 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:37.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:38.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:38.012+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:38.044 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:38.044 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:38.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:38.138 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:38.137+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:38.203 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:38.203 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:38.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:38.215 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:38.215+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:38.316 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:38.315+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:38.359 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:38.359 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:38.360 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:38.360 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:38.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:38.417 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:38.417+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:38.426 INFO:teuthology.orchestra.run.smithi012.stdout:3.9 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:3.4 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:3.1a 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:3.14 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:3.13 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:2.7 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:2.3 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:3.0 2024-09-11T05:22:38.427 INFO:teuthology.orchestra.run.smithi012.stdout:2.1 2024-09-11T05:22:38.433 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:22:38.443 INFO:teuthology.orchestra.run.smithi012.stdout:3308 read 0x8e97382 thru 0x8ea2d58 (0xb9d7 bytes) 2024-09-11T05:22:38.443 INFO:teuthology.orchestra.run.smithi012.stdout:3310 read 0x7935c79 thru 0x7944bd3 (0xef5b bytes) 2024-09-11T05:22:38.443 INFO:teuthology.orchestra.run.smithi012.stdout:3311 read 0x1f350d1 thru 0x1f3884c (0x377c bytes) 2024-09-11T05:22:38.444 INFO:teuthology.orchestra.run.smithi012.stdout:3312 read 0x4586bb thru 0x466c74 (0xe5ba bytes) 2024-09-11T05:22:38.444 INFO:teuthology.orchestra.run.smithi012.stdout:3313 read 0x8b8593d thru 0x8b87517 (0x1bdb bytes) 2024-09-11T05:22:38.456 INFO:teuthology.orchestra.run.smithi012.stdout:3314 trunc from 0xbefb9bd to 0x1dbc490 2024-09-11T05:22:38.491 INFO:teuthology.orchestra.run.smithi012.stdout:3315 write 0x51fa137 thru 0x51fa2b6 (0x180 bytes) 2024-09-11T05:22:38.494 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:38.494 INFO:teuthology.orchestra.run.smithi012.stdout:3318 read 0x19c79f2 thru 0x19ca5e2 (0x2bf1 bytes) 2024-09-11T05:22:38.495 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:38.505 INFO:teuthology.orchestra.run.smithi012.stdout:3321 write 0x8f9de18 thru 0x8fadd68 (0xff51 bytes) 2024-09-11T05:22:38.509 INFO:teuthology.orchestra.run.smithi012.stdout:3323 write 0x5f373ab thru 0x5f3b95c (0x45b2 bytes) 2024-09-11T05:22:38.511 INFO:teuthology.orchestra.run.smithi012.stdout:3324 clone 30 order 21 su 262144 sc 6 2024-09-11T05:22:38.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:38.516+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:38.538 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:38.538 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:38.538 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:38.538 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:38.538 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:38.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:38.618 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:38.619+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:38.696 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:38.696 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:38.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:38.696 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.951428610999997, 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.697 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.951416723000001, 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.701 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:38.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.951379502999998, 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.951364722000001, 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.711 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:38.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.715 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.951353386000001, 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:38.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.720 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.950202585, 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:38.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:38.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.950188130000001, 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:38.729 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.950177650000001, 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.730 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:38.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.734 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.950167182999998, 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:38.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:38.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.950148822999999, 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:38.739 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:38.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:38.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:38.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.947439750999997, 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:38.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:38.749 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.947416750999999, 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:38.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.947395387999997, 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.754 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:38.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.947373869000003, 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:38.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:38.763 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.947352942000002, 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:38.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.767 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.945519517999998, 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.768 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.772 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.945509205, 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:38.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:38.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:38.776 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.945498831999998, 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.777 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:38.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.945483803000002, 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:38.781 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:38.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 39.945473794999998, 2024-09-11T05:22:38.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:38.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:38.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:38.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:38.789 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:38.791 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:38.791 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:38.790+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:38.891 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:38.891+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:38.907 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:38.907 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:38.907 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:38.907 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:38.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:38.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op export --pgid 2.7 --file /var/log/ceph/exp.2.7.2 2024-09-11T05:22:38.992 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:38.991+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:39.060 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:39.060 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:39.060 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:39.060 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:39.060 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:39.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:39.093 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:39.093+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:39.173 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.539266558999998, 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:39.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:39.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:39.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:39.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:39.179 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.537125037999999, 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.537103473999998, 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:39.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.189 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.537089463000001, 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.190 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:39.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:39.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.196 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535264161999997, 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:39.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535249559, 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:39.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:39.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535232254, 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.206 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:39.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535208144999999, 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:39.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.215 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535180068999999, 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:39.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:39.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535153076999997, 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:39.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535112517999998, 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:39.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.535089130999999, 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:39.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.439104024000002, 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:39.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:39.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:39.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.439084463999997, 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:39.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.439065249000002, 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.439044449000001, 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:39.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:39.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.250 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.554943934000001, 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:22:39.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:22:39.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:22:39.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:22:39.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.257 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.551954126, 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:22:39.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.087357234000001, 2024-09-11T05:22:39.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:22:39.271 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.552773346, 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:22:39.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:22:39.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:22:39.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.278 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:39.280 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:39.280 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:39.280+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:39.380 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:39.380+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:39.425 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:39.425 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:39.434 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:39.481 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:39.480+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:39.509 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone29 from 0x8fadd69 (overlap 0x1dbc490) to 0x1ac30e8 2024-09-11T05:22:39.581 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:39.581 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:39.582 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:39.582 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:39.582 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:39.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:39.581+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:39.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:39.602 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-11T05:22:39.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:39.682+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:39.697 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.099741237000003, 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.099513741000003, 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.099258927000001, 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.098890032, 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.098728485999999, 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.098285750999999, 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.096138858000003, 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.094108306000003, 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.094087921000003, 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.876904115999999, 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.876883092, 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.876858837, 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.875179752999998, 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.875160407000003, 2024-09-11T05:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.875139634999996, 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.875120225000003, 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.875099755999997, 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.875080865999998, 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.865743072999997, 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.865732246999997, 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:39.790 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:39.792 INFO:teuthology.orchestra.run.smithi012.stdout:3325 write 0xc818a92 thru 0xc8191a2 (0x711 bytes) 2024-09-11T05:22:39.792 INFO:teuthology.orchestra.run.smithi012.stdout:3326 write 0xe524bd6 thru 0xe533dec (0xf217 bytes) 2024-09-11T05:22:39.792 INFO:teuthology.orchestra.run.smithi012.stdout:3327 trunc from 0xe533ded to 0xac01631 2024-09-11T05:22:39.792 INFO:teuthology.orchestra.run.smithi012.stdout:3328 trunc from 0xac01631 to 0x33426e3 2024-09-11T05:22:39.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:39.793 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:39.791+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:39.796 INFO:teuthology.orchestra.run.smithi012.stdout:3329 read 0x32cbdc8 thru 0x32d4c49 (0x8e82 bytes) 2024-09-11T05:22:39.797 INFO:teuthology.orchestra.run.smithi012.stdout:3330 read 0x15a8693 thru 0x15b1d7e (0x96ec bytes) 2024-09-11T05:22:39.797 INFO:teuthology.orchestra.run.smithi012.stdout:3331 writesame 0x308edca thru 0x309b7cf data_size 0x13(0xca06 bytes) 2024-09-11T05:22:39.801 INFO:teuthology.orchestra.run.smithi012.stdout:3332 trunc from 0x33426e3 to 0x137a27d 2024-09-11T05:22:39.824 INFO:teuthology.orchestra.run.smithi012.stdout:3334 read 0x706118 thru 0x7068ca (0x7b3 bytes) 2024-09-11T05:22:39.825 INFO:teuthology.orchestra.run.smithi012.stdout:3339 write 0xe4f492 thru 0xe58b57 (0x96c6 bytes) 2024-09-11T05:22:39.833 INFO:teuthology.orchestra.run.smithi012.stdout:3340 write 0x2f143f9 thru 0x2f1f432 (0xb03a bytes) 2024-09-11T05:22:39.848 INFO:teuthology.orchestra.run.smithi012.stdout:3341 writesame 0x9010a41 thru 0x90166dd data_size 0x7(0x5c9d bytes) 2024-09-11T05:22:39.848 INFO:teuthology.orchestra.run.smithi012.stdout:3342 read 0x1645bf8 thru 0x164fb49 (0x9f52 bytes) 2024-09-11T05:22:39.848 INFO:teuthology.orchestra.run.smithi012.stdout:3345 read 0x6de56e9 thru 0x6de59b4 (0x2cc bytes) 2024-09-11T05:22:39.849 INFO:teuthology.orchestra.run.smithi012.stdout:3346 writesame 0x37c60da thru 0x37d45f2 data_size 0x1(0xe519 bytes) 2024-09-11T05:22:39.871 INFO:teuthology.orchestra.run.smithi012.stdout:3347 write 0x358f51b thru 0x359570e (0x61f4 bytes) 2024-09-11T05:22:39.875 INFO:teuthology.orchestra.run.smithi012.stdout:3348 punch from 0x8f47559 to 0x8f536c7, (0xc16e bytes) 2024-09-11T05:22:39.875 INFO:teuthology.orchestra.run.smithi012.stdout:3349 read 0x2af0caa thru 0x2af2af9 (0x1e50 bytes) 2024-09-11T05:22:39.875 INFO:teuthology.orchestra.run.smithi012.stdout:3350 write 0x58e7d1c thru 0x58f561a (0xd8ff bytes) 2024-09-11T05:22:39.877 INFO:teuthology.orchestra.run.smithi012.stdout:3352 punch from 0x3529424 to 0x353094a, (0x7526 bytes) 2024-09-11T05:22:39.879 INFO:teuthology.orchestra.run.smithi012.stdout:3353 trunc from 0x90166de to 0xa980c33 2024-09-11T05:22:39.883 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:39.885 INFO:teuthology.orchestra.run.smithi012.stdout:3356 trunc from 0xa980c33 to 0x956c8fd 2024-09-11T05:22:39.892 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:39.892+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:39.895 INFO:teuthology.orchestra.run.smithi012.stdout:3357 write 0x9a95809 thru 0x9a9a086 (0x487e bytes) 2024-09-11T05:22:39.898 INFO:teuthology.orchestra.run.smithi012.stdout:3359 trunc from 0x9a9a087 to 0x95d0f9e 2024-09-11T05:22:39.904 INFO:teuthology.orchestra.run.smithi012.stdout:3360 write 0x4b26ae2 thru 0x4b3643e (0xf95d bytes) 2024-09-11T05:22:39.907 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:39.915 INFO:teuthology.orchestra.run.smithi012.stdout:3362 writesame 0xa85da09 thru 0xa868d76 data_size 0x77(0xb36e bytes) 2024-09-11T05:22:39.915 INFO:teuthology.orchestra.run.smithi012.stdout:3364 read 0x47f843b thru 0x4803002 (0xabc8 bytes) 2024-09-11T05:22:39.915 INFO:teuthology.orchestra.run.smithi012.stdout:3366 read 0x14e74b3 thru 0x14e9938 (0x2486 bytes) 2024-09-11T05:22:39.915 INFO:teuthology.orchestra.run.smithi012.stdout:3367 punch from 0x35abf1a to 0x35b18b1, (0x5997 bytes) 2024-09-11T05:22:39.915 INFO:teuthology.orchestra.run.smithi012.stdout:3368 writesame 0x1e2e130 thru 0x1e317dd data_size 0x3(0x36ae bytes) 2024-09-11T05:22:39.919 INFO:teuthology.orchestra.run.smithi012.stdout:3369 trunc from 0xa868d77 to 0xa63473c 2024-09-11T05:22:39.926 INFO:teuthology.orchestra.run.smithi012.stdout:3370 trunc from 0xa63473c to 0x8e2bfbc 2024-09-11T05:22:39.936 INFO:teuthology.orchestra.run.smithi012.stdout:3371 clone 31 order 18 su 65536 sc 13 2024-09-11T05:22:39.940 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:39.941 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:39.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:39.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:39.992+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:40.093 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:40.093 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:40.093 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:40.093 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:40.093 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:40.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:40.092+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:40.101 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:40.193 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:40.193+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10509 3.10 3:0e4b85b7:::rbd_data.117977dc529b.0000000000000006:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.673553255999998, 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0081221729999999999, 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.207 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10509 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532128+0000", 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532129+0000", 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.052e-06 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532146+0000", 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6931000000000001e-05 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532158+0000", 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2207e-05 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532164+0000", 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2210000000000002e-06 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532223+0000", 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9338e-05 2024-09-11T05:22:40.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.532325+0000", 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101656 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.540250+0000", 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079247680000000004 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:10994 3.10 3:0b01f203:::rbd_data.117977dc529b.0000000000000017:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.644679828999998, 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052453930000000001, 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10994 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561001+0000", 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561003+0000", 2024-09-11T05:22:40.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.323e-06 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561010+0000", 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6420000000000001e-06 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561029+0000", 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8564999999999999e-05 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561039+0000", 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0046e-05 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561107+0000", 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7922999999999993e-05 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.561253+0000", 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014678200000000001 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.566247+0000", 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049931120000000001 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15377 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.231132914, 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039582419999999998, 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.216 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15377 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974548+0000", 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974549+0000", 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3200000000000005e-07 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974551+0000", 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.706e-06 2024-09-11T05:22:40.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974559+0000", 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4390000000000003e-06 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974564+0000", 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5249999999999996e-06 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.977991+0000", 2024-09-11T05:22:40.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003426742 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978091+0000", 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9469000000000006e-05 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978506+0000", 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00041572899999999999 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15378 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.231108398000003, 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00436718, 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15378 2024-09-11T05:22:40.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974573+0000", 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974575+0000", 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3250000000000002e-06 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974582+0000", 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.951e-06 2024-09-11T05:22:40.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974589+0000", 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0269999999999998e-06 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978537+0000", 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039479529999999997 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978616+0000", 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8851999999999997e-05 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978940+0000", 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000323572 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15379 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:40.225 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.231084123999999, 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045646519999999998, 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15379 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:40.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974597+0000", 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974599+0000", 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2139999999999999e-06 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974615+0000", 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5330999999999999e-05 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974621+0000", 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8069999999999996e-06 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.978989+0000", 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043679410000000002 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979086+0000", 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7297e-05 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979161+0000", 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5617000000000005e-05 2024-09-11T05:22:40.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15380 3.10 3:0ac046a2:::rbd_data.117977dc529b.000000000000003d:8 [read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.231051929000003, 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00473859, 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.230 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15380 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974629+0000", 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4900000000000001e-07 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974636+0000", 2024-09-11T05:22:40.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.601e-06 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974644+0000", 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4719999999999998e-06 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.974649+0000", 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4210000000000003e-06 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979201+0000", 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045517919999999998 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979287+0000", 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5981000000000002e-05 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.979368+0000", 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0873999999999999e-05 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16758 3.10 3:0ff05fec:::rbd_data.1179c3639760.000000000000000a:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.847763106999999, 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0180985, 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.235 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16758 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357918+0000", 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357923+0000", 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3120000000000001e-06 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357935+0000", 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2104e-05 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357951+0000", 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5818999999999999e-05 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.357961+0000", 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5980000000000003e-06 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358021+0000", 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0650999999999999e-05 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.358125+0000", 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103479 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.361575+0000", 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034500619999999998 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375931+0000", 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014355698 2024-09-11T05:22:40.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375944+0000", 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3328e-05 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375980+0000", 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5760999999999999e-05 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.376016+0000", 2024-09-11T05:22:40.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6687999999999998e-05 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16758 3.10 e32/22 ondisk, result = 0)", 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.837258337000002, 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075142530000000003, 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.241 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368423+0000", 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368424+0000", 2024-09-11T05:22:40.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3120000000000001e-06 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368431+0000", 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8129999999999998e-06 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368448+0000", 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6980999999999999e-05 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.368458+0000", 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375910+0000", 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074519 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375918+0000", 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9589999999999995e-06 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.375937+0000", 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8527999999999999e-05 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16860 3.a 3:55f78c79:::rbd_data.1179c3639760.000000000000000e:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.673872858000003, 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014769262999999999, 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.245 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16860 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531808+0000", 2024-09-11T05:22:40.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531809+0000", 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531813+0000", 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3730000000000003e-06 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531824+0000", 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0494e-05 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531829+0000", 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1669999999999998e-06 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531878+0000", 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9027999999999999e-05 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.531974+0000", 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5874999999999999e-05 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.534209+0000", 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022353020000000002 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546470+0000", 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012260630999999999 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546499+0000", 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9436000000000001e-05 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546545+0000", 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5445999999999998e-05 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546577+0000", 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2536999999999997e-05 2024-09-11T05:22:40.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:16860 3.a e32/22 ondisk, result = 0)", 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.663557011000002, 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044590660000000002, 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542124+0000", 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542125+0000", 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.096e-06 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542128+0000", 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0639999999999998e-06 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542139+0000", 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0915e-05 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.542148+0000", 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6060000000000003e-06 2024-09-11T05:22:40.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546490+0000", 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043424780000000003 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546496+0000", 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0000000000000002e-06 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.546583+0000", 2024-09-11T05:22:40.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6907e-05 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39459 3.a 3:54bd4aae:::rbd_data.1179ab1e2350.0000000000000015:head [write 0~0] snapc a=[a] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.367134376000003, 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041154470000000004, 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39459 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838547+0000", 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2099999999999997e-07 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838550+0000", 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4540000000000001e-06 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838555+0000", 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.838558+0000", 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4709999999999999e-06 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839659+0000", 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011004089999999999 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839734+0000", 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4967000000000002e-05 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.839916+0000", 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018229300000000001 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842435+0000", 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002519257 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842572+0000", 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013645199999999999 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842619+0000", 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7586000000000001e-05 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.842662+0000", 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2879000000000001e-05 2024-09-11T05:22:40.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:62325 3.1e e44/43 3:7ca35b74:::rbd_data.1179377e61aa.0000000000000002:head v 44'132, mlcod=0'0)", 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.721092835, 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050778849999999999, 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484588+0000", 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5300000000000001e-07 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484592+0000", 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8e-06 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484602+0000", 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5459999999999997e-06 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484607+0000", 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3800000000000002e-06 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484638+0000", 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1235000000000002e-05 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.484653+0000", 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4713e-05 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.489632+0000", 2024-09-11T05:22:40.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049786029999999998 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:08.489666+0000", 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4455000000000001e-05 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63746 3.10 3:0d130168:::rbd_data.117960679f52.0000000000000042:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,truncate 917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:40.265 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.221739298999999, 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042747189999999997, 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63746 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:40.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983942+0000", 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3099999999999996e-07 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983947+0000", 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.464e-06 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983957+0000", 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0086e-05 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.983963+0000", 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1179999999999997e-06 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984031+0000", 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8106000000000001e-05 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984128+0000", 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6523999999999999e-05 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.984261+0000", 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013350699999999999 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.985139+0000", 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00087741999999999996 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988160+0000", 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030213229999999998 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988195+0000", 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5413999999999997e-05 2024-09-11T05:22:40.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:11.988216+0000", 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0925999999999999e-05 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64134 3.a 3:5751da01:::rbd_header.117960679f52:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.661570390000001, 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087579719999999993, 2024-09-11T05:22:40.271 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64134 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544111+0000", 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544112+0000", 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.37e-06 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544118+0000", 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9839999999999998e-06 2024-09-11T05:22:40.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544131+0000", 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.343e-05 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544140+0000", 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8729999999999996e-06 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544199+0000", 2024-09-11T05:22:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8375999999999998e-05 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.544204+0000", 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0799999999999996e-06 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.551581+0000", 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073776379999999997 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.551674+0000", 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552026+0000", 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00035214799999999999 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552628+0000", 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060198599999999999 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552809+0000", 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018109199999999999 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552840+0000", 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1229000000000002e-05 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.552869+0000", 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8090999999999999e-05 2024-09-11T05:22:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64494 3.a 3:57baaaa4:::rbd_data.1179fd54a524.000000000000006c:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.390510812999999, 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013982322, 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64494 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815170+0000", 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815171+0000", 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3149999999999999e-06 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815178+0000", 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9319999999999999e-06 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815189+0000", 2024-09-11T05:22:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.076e-05 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815195+0000", 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815239+0000", 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4459999999999998e-05 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.815331+0000", 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2139999999999995e-05 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.817519+0000", 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021876619999999999 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829065+0000", 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011545778 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829077+0000", 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2266000000000001e-05 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829114+0000", 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7214e-05 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.829152+0000", 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8133999999999998e-05 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:64528 3.a 3:57baaaa4:::rbd_data.1179fd54a524.000000000000006c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.336313928999999, 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0049568420000000004, 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 64528 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869367+0000", 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869369+0000", 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5689999999999999e-06 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869375+0000", 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2389999999999999e-06 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869389+0000", 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4303e-05 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.869397+0000", 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9270000000000005e-06 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870007+0000", 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00061024400000000002 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870060+0000", 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2630000000000003e-05 2024-09-11T05:22:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.870128+0000", 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7992999999999998e-05 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.871474+0000", 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001346222 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874232+0000", 2024-09-11T05:22:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027579499999999999 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874286+0000", 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4103e-05 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.874324+0000", 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7662e-05 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:70793 3.10 3:096c4687:::rbd_data.1179db619f31.0000000000000011:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 8126464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.276117930000002, 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039886560000000001, 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 70793 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929563+0000", 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929565+0000", 2024-09-11T05:22:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929573+0000", 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7260000000000002e-06 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929588+0000", 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5007999999999999e-05 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929597+0000", 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6320000000000003e-06 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929648+0000", 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1175999999999999e-05 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929740+0000", 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1545999999999994e-05 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.929849+0000", 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010922899999999999 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.930411+0000", 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00056223299999999998 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933483+0000", 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030712040000000001 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933516+0000", 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3751000000000003e-05 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.933552+0000", 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5261e-05 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71634 3.10 3:096c4687:::rbd_data.1179db619f31.0000000000000011:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.061057442999999, 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018691636000000001, 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71634 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144624+0000", 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144626+0000", 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2019999999999998e-06 2024-09-11T05:22:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144635+0000", 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.662e-06 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144654+0000", 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9086999999999999e-05 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144664+0000", 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0003000000000001e-05 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144729+0000", 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4789000000000006e-05 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.144797+0000", 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7335999999999994e-05 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.147776+0000", 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002978938 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163184+0000", 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015408597 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163202+0000", 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7907e-05 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163263+0000", 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1122000000000002e-05 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163315+0000", 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1993000000000002e-05 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(client.4473.0:71634 3.10 e57/45 ondisk, result = 0)", 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.049288705999999, 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068001270000000004, 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156392+0000", 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156393+0000", 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1480000000000001e-06 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156400+0000", 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7329999999999997e-06 2024-09-11T05:22:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156415+0000", 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4554e-05 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.156424+0000", 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4239999999999999e-06 2024-09-11T05:22:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163165+0000", 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0067404370000000002 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163176+0000", 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1603000000000001e-05 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.163192+0000", 2024-09-11T05:22:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6228000000000001e-05 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71952 3.a 3:50a56b0b:::rbd_data.1179db619f31.0000000000000002:head [stat,truncate 7995392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.542047+0000", 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.66363385, 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042337670000000003, 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71952 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542047+0000", 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542047+0000", 2024-09-11T05:22:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542049+0000", 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.827e-06 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542054+0000", 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1229999999999999e-06 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542068+0000", 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4319e-05 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542077+0000", 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5900000000000008e-06 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542730+0000", 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000652825 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.542826+0000", 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6382e-05 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.543447+0000", 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00062088499999999995 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.545975+0000", 2024-09-11T05:22:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025279320000000001 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.546167+0000", 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019202499999999999 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.546228+0000", 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0809e-05 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.546281+0000", 2024-09-11T05:22:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3050000000000002e-05 2024-09-11T05:22:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.312 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:40.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:40.314 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:40.312+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:Exporting 2.7 info 2.7( empty local-lis/les=60/61 n=0 ec=18/18 lis/c=60/60 les/c/f=61/61/0 sis=60) 2024-09-11T05:22:40.347 INFO:teuthology.orchestra.run.smithi012.stderr:Export successful 2024-09-11T05:22:40.414 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:40.412+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:40.458 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:22:40.458 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:40.458 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:40.459 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:40.459 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:40.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:40.519 INFO:teuthology.orchestra.run.smithi012.stdout:flattening image image_client.0-clone30 2024-09-11T05:22:40.552 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:40.551+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:40.615 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:40.614+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:40.617 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:40.617 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:40.617 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:40.617 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:40.617 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:40.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:40.682 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-11T05:22:40.716 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:40.715+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:40.729 INFO:teuthology.orchestra.run.smithi012.stdout:3372 trunc from 0x8e2bfbc to 0x74459ad 2024-09-11T05:22:40.757 INFO:teuthology.orchestra.run.smithi012.stdout:3373 trunc from 0x74459ad to 0xc8c62e 2024-09-11T05:22:40.780 INFO:teuthology.orchestra.run.smithi012.stdout:3374 punch from 0xaf565b to 0xafd806, (0x81ab bytes) 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 72.031314641999998, 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:40.783 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:40.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:40.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:40.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.028236079999999, 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:40.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.028218780000003, 2024-09-11T05:22:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.028192744999998, 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.028176518999999, 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.028154063000002, 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.028119984, 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.028082363000003, 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.027517523, 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.027468425000002, 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.742813347000002, 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.742793728999999, 2024-09-11T05:22:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.740203674999997, 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.739773532999997, 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.739739112999999, 2024-09-11T05:22:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.688648798999999, 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.618197182000003, 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63898 3.11 3:89620d31:::rbd_data.117960679f52.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.661127251, 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709826999999999, 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63898 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120804+0000", 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:22:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120808+0000", 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120817+0000", 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120821+0000", 2024-09-11T05:22:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120858+0000", 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6863999999999998e-05 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120951+0000", 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2541999999999996e-05 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.124305+0000", 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00335389 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140413+0000", 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016108245 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140444+0000", 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1578000000000002e-05 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140482+0000", 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140513+0000", 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1477999999999999e-05 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:70954 3.14 e57/22 3:2fcfd35d:::rbd_data.1179db619f31.0000000000000009:head v 57'288, mlcod=56'286)", 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.816362030000001, 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023605603999999999, 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965570+0000", 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7630000000000001e-06 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971434+0000", 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058634300000000002 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971457+0000", 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3436999999999999e-05 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971471+0000", 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3776e-05 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971538+0000", 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7074000000000002e-05 2024-09-11T05:22:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971565+0000", 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6914e-05 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989115+0000", 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017549754000000001 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989174+0000", 2024-09-11T05:22:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9456000000000001e-05 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71938 3.f 3:f110c0b8:::rbd_data.1179db619f31.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.282183578000001, 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027012653000000001, 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71938 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499748+0000", 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499752+0000", 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499762+0000", 2024-09-11T05:22:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7610000000000002e-06 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499767+0000", 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.118e-06 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499813+0000", 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6168999999999998e-05 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499871+0000", 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8394999999999999e-05 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.503877+0000", 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040059290000000001 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526608+0000", 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022730899999999998 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526628+0000", 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9556e-05 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526686+0000", 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7839e-05 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526760+0000", 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4146000000000005e-05 2024-09-11T05:22:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:40.879 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:40.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:40.882 INFO:teuthology.orchestra.run.smithi012.stdout:3375 trunc from 0xc8c62e to 0xc1b176a 2024-09-11T05:22:40.882 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:40.882 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:40.882 INFO:teuthology.orchestra.run.smithi012.stdout:3379 read 0x6ee14eb thru 0x6eeeef1 (0xda07 bytes) 2024-09-11T05:22:40.882 INFO:teuthology.orchestra.run.smithi012.stdout:3380 punch from 0xa9fe8a6 to 0xa9ffbbf, (0x1319 bytes) 2024-09-11T05:22:40.882 INFO:teuthology.orchestra.run.smithi012.stdout:3381 trunc from 0xc1b176a to 0x1232d93 2024-09-11T05:22:40.882 INFO:teuthology.orchestra.run.smithi012.stdout:3382 punch from 0xe33a9a to 0xe40d86, (0xd2ec bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3383 read 0x11cd608 thru 0x11d7215 (0x9c0e bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3384 trunc from 0x1232d93 to 0x6891c2b 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3385 writesame 0x128ec84 thru 0x128fec4 data_size 0x1(0x1241 bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3386 writesame 0xb148832 thru 0xb148cf1 data_size 0x1(0x4c0 bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3387 write 0x3c71433 thru 0x3c714f8 (0xc6 bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3388 read 0xa72358e thru 0xa731688 (0xe0fb bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3389 writesame 0x362d1b4 thru 0x3639c5e data_size 0xd(0xcaab bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3390 write 0xc3ca6a6 thru 0xc3d6441 (0xbd9c bytes) 2024-09-11T05:22:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:3391 write 0x28dd703 thru 0x28eae95 (0xd793 bytes) 2024-09-11T05:22:40.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --force --op remove --pgid 2.7 2024-09-11T05:22:40.885 INFO:teuthology.orchestra.run.smithi012.stdout:3392 write 0xe166edd thru 0xe167839 (0x95d bytes) 2024-09-11T05:22:40.885 INFO:teuthology.orchestra.run.smithi012.stdout:3393 read 0x51844d1 thru 0x5193447 (0xef77 bytes) 2024-09-11T05:22:40.885 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:40.885 INFO:teuthology.orchestra.run.smithi012.stdout:3395 write 0x51da07f thru 0x51e26e0 (0x8662 bytes) 2024-09-11T05:22:40.885 INFO:teuthology.orchestra.run.smithi012.stdout:3396 read 0x909d580 thru 0x90a2e9d (0x591e bytes) 2024-09-11T05:22:40.885 INFO:teuthology.orchestra.run.smithi012.stdout:3397 read 0x2f5cbd thru 0x2f9262 (0x35a6 bytes) 2024-09-11T05:22:40.885 INFO:teuthology.orchestra.run.smithi012.stdout:3398 write 0x507457d thru 0x5084111 (0xfb95 bytes) 2024-09-11T05:22:40.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:40.879+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:40.886 INFO:teuthology.orchestra.run.smithi012.stdout:3399 punch from 0x92f36c8 to 0x92ff796, (0xc0ce bytes) 2024-09-11T05:22:40.894 INFO:teuthology.orchestra.run.smithi012.stdout:3400 trunc from 0xe16783a to 0x2564da4 2024-09-11T05:22:40.908 INFO:teuthology.orchestra.run.smithi012.stdout:3401 trunc from 0x2564da4 to 0x346aab7 2024-09-11T05:22:40.917 INFO:teuthology.orchestra.run.smithi012.stdout:3405 trunc from 0x346aab7 to 0xffed3f 2024-09-11T05:22:40.929 INFO:teuthology.orchestra.run.smithi012.stdout:3406 read 0x7b76b3 thru 0x7c2014 (0xa962 bytes) 2024-09-11T05:22:40.930 INFO:teuthology.orchestra.run.smithi012.stdout:3407 read 0xb38f1a thru 0xb39ad1 (0xbb8 bytes) 2024-09-11T05:22:40.943 INFO:teuthology.orchestra.run.smithi012.stdout:3408 writesame 0x5ed8a08 thru 0x5ee7aec data_size 0x1(0xf0e5 bytes) 2024-09-11T05:22:40.947 INFO:teuthology.orchestra.run.smithi012.stdout:3409 trunc from 0x5ee7aed to 0x2a75671 2024-09-11T05:22:40.953 INFO:teuthology.orchestra.run.smithi012.stdout:3410 punch from 0x1773a2 to 0x177b78, (0x7d6 bytes) 2024-09-11T05:22:40.953 INFO:teuthology.orchestra.run.smithi012.stdout:3411 punch from 0x26a9dbf to 0x26b7eec, (0xe12d bytes) 2024-09-11T05:22:40.953 INFO:teuthology.orchestra.run.smithi012.stdout:3412 punch from 0x28d847d to 0x28e1e8b, (0x9a0e bytes) 2024-09-11T05:22:40.953 INFO:teuthology.orchestra.run.smithi012.stdout:3413 read 0x5c8cfe thru 0x5d489a (0xbb9d bytes) 2024-09-11T05:22:40.965 INFO:teuthology.orchestra.run.smithi012.stdout:3415 trunc from 0x2a75671 to 0xc73e8e3 2024-09-11T05:22:40.970 INFO:teuthology.orchestra.run.smithi012.stdout:3416 read 0x94f7ce4 thru 0x94fe927 (0x6c44 bytes) 2024-09-11T05:22:40.970 INFO:teuthology.orchestra.run.smithi012.stdout:3418 read 0xf60204 thru 0xf6ab75 (0xa972 bytes) 2024-09-11T05:22:40.970 INFO:teuthology.orchestra.run.smithi012.stdout:3419 write 0x983b710 thru 0x983c7bb (0x10ac bytes) 2024-09-11T05:22:40.973 INFO:teuthology.orchestra.run.smithi012.stdout:3420 punch from 0x5a12e4b to 0x5a1373c, (0x8f1 bytes) 2024-09-11T05:22:40.973 INFO:teuthology.orchestra.run.smithi012.stdout:3421 write 0x2c91e29 thru 0x2c9a51a (0x86f2 bytes) 2024-09-11T05:22:40.976 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:40.976 INFO:teuthology.orchestra.run.smithi012.stdout:3423 read 0x2bd379d thru 0x2bdc292 (0x8af6 bytes) 2024-09-11T05:22:40.976 INFO:teuthology.orchestra.run.smithi012.stdout:3425 punch from 0x330a593 to 0x3318166, (0xdbd3 bytes) 2024-09-11T05:22:40.976 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:40.976 INFO:teuthology.orchestra.run.smithi012.stdout:3428 read 0x257c880 thru 0x2588f6e (0xc6ef bytes) 2024-09-11T05:22:40.981 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:40.980+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:40.988 INFO:teuthology.orchestra.run.smithi012.stdout:3429 trunc from 0xc73e8e3 to 0x1bf17d6 2024-09-11T05:22:40.997 INFO:teuthology.orchestra.run.smithi012.stdout:3431 punch from 0x19ad77e to 0x19bac53, (0xd4d5 bytes) 2024-09-11T05:22:40.998 INFO:teuthology.orchestra.run.smithi012.stdout:3432 read 0x118f9fa thru 0x1193759 (0x3d60 bytes) 2024-09-11T05:22:41.010 INFO:teuthology.orchestra.run.smithi012.stdout:3433 write 0x852cc91 thru 0x8538134 (0xb4a4 bytes) 2024-09-11T05:22:41.019 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:41.019 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:41.024 INFO:teuthology.orchestra.run.smithi012.stdout:3434 writesame 0xc0d4505 thru 0xc0d9b6d data_size 0x1(0x5669 bytes) 2024-09-11T05:22:41.024 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.024 INFO:teuthology.orchestra.run.smithi012.stdout:3436 write 0x746032f thru 0x7465627 (0x52f9 bytes) 2024-09-11T05:22:41.027 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.027 INFO:teuthology.orchestra.run.smithi012.stdout:3438 write 0x2fd45ee thru 0x2fe2cce (0xe6e1 bytes) 2024-09-11T05:22:41.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:41.031 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.031 INFO:teuthology.orchestra.run.smithi012.stdout:3440 read 0x4f98b0e thru 0x4fa6851 (0xdd44 bytes) 2024-09-11T05:22:41.031 INFO:teuthology.orchestra.run.smithi012.stdout:3442 read 0x5540eed thru 0x5547073 (0x6187 bytes) 2024-09-11T05:22:41.031 INFO:teuthology.orchestra.run.smithi012.stdout:3443 read 0x1c542fb thru 0x1c55630 (0x1336 bytes) 2024-09-11T05:22:41.031 INFO:teuthology.orchestra.run.smithi012.stdout:3444 read 0x3b21883 thru 0x3b261da (0x4958 bytes) 2024-09-11T05:22:41.031 INFO:teuthology.orchestra.run.smithi012.stdout:3445 write 0xa7432ef thru 0xa748751 (0x5463 bytes) 2024-09-11T05:22:41.034 INFO:teuthology.orchestra.run.smithi012.stdout:3446 read 0xaa32318 thru 0xaa33229 (0xf12 bytes) 2024-09-11T05:22:41.034 INFO:teuthology.orchestra.run.smithi012.stdout:3447 write 0x14e9e2d thru 0x14f0174 (0x6348 bytes) 2024-09-11T05:22:41.039 INFO:teuthology.orchestra.run.smithi012.stdout:3448 read 0xb7b1231 thru 0xb7b9a2c (0x87fc bytes) 2024-09-11T05:22:41.039 INFO:teuthology.orchestra.run.smithi012.stdout:3449 punch from 0x2cce940 to 0x2cdde4d, (0xf50d bytes) 2024-09-11T05:22:41.048 INFO:teuthology.orchestra.run.smithi012.stdout:3450 trunc from 0xc0d9b6e to 0x3a55f9b 2024-09-11T05:22:41.068 INFO:teuthology.orchestra.run.smithi012.stdout:3451 write 0x43c110c thru 0x43c5504 (0x43f9 bytes) 2024-09-11T05:22:41.071 INFO:teuthology.orchestra.run.smithi012.stdout:3452 punch from 0x281c511 to 0x2829fdd, (0xdacc bytes) 2024-09-11T05:22:41.080 INFO:teuthology.orchestra.run.smithi012.stdout:3453 write 0x6d8869c thru 0x6d968dc (0xe241 bytes) 2024-09-11T05:22:41.082 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:41.080+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:41.085 INFO:teuthology.orchestra.run.smithi012.stdout:3454 punch from 0x36ec79b to 0x36f7c6a, (0xb4cf bytes) 2024-09-11T05:22:41.085 INFO:teuthology.orchestra.run.smithi012.stdout:3455 punch from 0x4607448 to 0x460df56, (0x6b0e bytes) 2024-09-11T05:22:41.085 INFO:teuthology.orchestra.run.smithi012.stdout:3456 punch from 0x15db7bf to 0x15e71ba, (0xb9fb bytes) 2024-09-11T05:22:41.085 INFO:teuthology.orchestra.run.smithi012.stdout:3458 punch from 0x1a65e12 to 0x1a67ecc, (0x20ba bytes) 2024-09-11T05:22:41.085 INFO:teuthology.orchestra.run.smithi012.stdout:3459 write 0x32daf76 thru 0x32e4abb (0x9b46 bytes) 2024-09-11T05:22:41.090 INFO:teuthology.orchestra.run.smithi012.stdout:3460 punch from 0x5557144 to 0x555c743, (0x55ff bytes) 2024-09-11T05:22:41.098 INFO:teuthology.orchestra.run.smithi012.stdout:3461 write 0x8d9e3ab thru 0x8da0ae9 (0x273f bytes) 2024-09-11T05:22:41.102 INFO:teuthology.orchestra.run.smithi012.stdout:3462 writesame 0x34fb6c7 thru 0x3509863 data_size 0x25(0xe19d bytes) 2024-09-11T05:22:41.108 INFO:teuthology.orchestra.run.smithi012.stdout:3463 trunc from 0x8da0aea to 0x764dedc 2024-09-11T05:22:41.117 INFO:teuthology.orchestra.run.smithi012.stdout:3466 read 0x6ba0458 thru 0x6babe22 (0xb9cb bytes) 2024-09-11T05:22:41.117 INFO:teuthology.orchestra.run.smithi012.stdout:3467 read 0x44d1b51 thru 0x44d2677 (0xb27 bytes) 2024-09-11T05:22:41.117 INFO:teuthology.orchestra.run.smithi012.stdout:3469 read 0x1195948 thru 0x11a0846 (0xaeff bytes) 2024-09-11T05:22:41.117 INFO:teuthology.orchestra.run.smithi012.stdout:3470 punch from 0x103a10 to 0x1050af, (0x169f bytes) 2024-09-11T05:22:41.117 INFO:teuthology.orchestra.run.smithi012.stdout:3471 read 0x72f76ab thru 0x730364b (0xbfa1 bytes) 2024-09-11T05:22:41.117 INFO:teuthology.orchestra.run.smithi012.stdout:3472 trunc from 0x764dedc to 0x7ce6d33 2024-09-11T05:22:41.122 INFO:teuthology.orchestra.run.smithi012.stdout:3474 read 0x6027aa2 thru 0x602b2b8 (0x3817 bytes) 2024-09-11T05:22:41.122 INFO:teuthology.orchestra.run.smithi012.stdout:3476 read 0x2d00d78 thru 0x2d0e683 (0xd90c bytes) 2024-09-11T05:22:41.122 INFO:teuthology.orchestra.run.smithi012.stdout:3478 punch from 0x15b0a82 to 0x15bbb21, (0xb09f bytes) 2024-09-11T05:22:41.122 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.122 INFO:teuthology.orchestra.run.smithi012.stdout:3480 read 0x5d8d2e thru 0x5dfad6 (0x6da9 bytes) 2024-09-11T05:22:41.129 INFO:teuthology.orchestra.run.smithi012.stdout:3481 write 0x9977339 thru 0x99781e5 (0xead bytes) 2024-09-11T05:22:41.134 INFO:teuthology.orchestra.run.smithi012.stdout:3483 trunc from 0x99781e6 to 0x7d85c49 2024-09-11T05:22:41.143 INFO:teuthology.orchestra.run.smithi012.stdout:3485 writesame 0x5dfae74 thru 0x5dfe9b1 data_size 0x1(0x3b3e bytes) 2024-09-11T05:22:41.153 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:41.153 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:41.154 INFO:teuthology.orchestra.run.smithi012.stdout:3488 punch from 0xf600c to 0x1037e0, (0xd7d4 bytes) 2024-09-11T05:22:41.154 INFO:teuthology.orchestra.run.smithi012.stdout:3489 writesame 0x55e44d1 thru 0x55e536b data_size 0x1(0xe9b bytes) 2024-09-11T05:22:41.164 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:41.165 INFO:teuthology.orchestra.run.smithi012.stdout:3490 writesame 0xac79d98 thru 0xac88116 data_size 0x1b(0xe37f bytes) 2024-09-11T05:22:41.165 INFO:teuthology.orchestra.run.smithi012.stdout:3491 write 0x52b9fa thru 0x537ca2 (0xc2a9 bytes) 2024-09-11T05:22:41.169 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.170 INFO:teuthology.orchestra.run.smithi012.stdout:3493 write 0x5712fe3 thru 0x5722b4a (0xfb68 bytes) 2024-09-11T05:22:41.173 INFO:teuthology.orchestra.run.smithi012.stdout:3494 write 0x95d2f51 thru 0x95e20be (0xf16e bytes) 2024-09-11T05:22:41.177 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.177 INFO:teuthology.orchestra.run.smithi012.stdout:3496 writesame 0x610d8c thru 0x61a232 data_size 0x81(0x94a7 bytes) 2024-09-11T05:22:41.180 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.181 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.181 INFO:teuthology.orchestra.run.smithi012.stdout:3500 read 0x1127ccf thru 0x1135212 (0xd544 bytes) 2024-09-11T05:22:41.181 INFO:teuthology.orchestra.run.smithi012.stdout:3501 write 0xa9f21b3 thru 0xaa008a6 (0xe6f4 bytes) 2024-09-11T05:22:41.183 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:41.181+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:41.184 INFO:teuthology.orchestra.run.smithi012.stdout:3502 punch from 0x6e2a6e9 to 0x6e38783, (0xe09a bytes) 2024-09-11T05:22:41.184 INFO:teuthology.orchestra.run.smithi012.stdout:3504 punch from 0x77d2e53 to 0x77d943d, (0x65ea bytes) 2024-09-11T05:22:41.185 INFO:teuthology.orchestra.run.smithi012.stdout:3505 read 0xa88b95c thru 0xa895b87 (0xa22c bytes) 2024-09-11T05:22:41.185 INFO:teuthology.orchestra.run.smithi012.stdout:3506 read 0xb41951 thru 0xb511c6 (0xf876 bytes) 2024-09-11T05:22:41.196 INFO:teuthology.orchestra.run.smithi012.stdout:3507 trunc from 0xac88117 to 0x4e3db0 2024-09-11T05:22:41.225 INFO:teuthology.orchestra.run.smithi012.stdout:3508 trunc from 0x4e3db0 to 0x12a50ff 2024-09-11T05:22:41.229 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.229 INFO:teuthology.orchestra.run.smithi012.stdout:3511 read 0x534e48 thru 0x536026 (0x11df bytes) 2024-09-11T05:22:41.229 INFO:teuthology.orchestra.run.smithi012.stdout:3513 read 0xc01bc1 thru 0xc077b1 (0x5bf1 bytes) 2024-09-11T05:22:41.245 INFO:teuthology.orchestra.run.smithi012.stdout:3514 write 0xa2e5601 thru 0xa2ed4ce (0x7ece bytes) 2024-09-11T05:22:41.249 INFO:teuthology.orchestra.run.smithi012.stdout:3515 read 0xa0a8da6 thru 0xa0b7003 (0xe25e bytes) 2024-09-11T05:22:41.249 INFO:teuthology.orchestra.run.smithi012.stdout:3516 read 0x754e3be thru 0x7552adf (0x4722 bytes) 2024-09-11T05:22:41.249 INFO:teuthology.orchestra.run.smithi012.stdout:3517 write 0x9702f78 thru 0x9709a13 (0x6a9c bytes) 2024-09-11T05:22:41.253 INFO:teuthology.orchestra.run.smithi012.stdout:3520 read 0x3562fab thru 0x3570779 (0xd7cf bytes) 2024-09-11T05:22:41.253 INFO:teuthology.orchestra.run.smithi012.stdout:3521 punch from 0x7e66d4b to 0x7e7638a, (0xf63f bytes) 2024-09-11T05:22:41.253 INFO:teuthology.orchestra.run.smithi012.stdout:3522 writesame 0x35bec93 thru 0x35c0c1a data_size 0x4(0x1f88 bytes) 2024-09-11T05:22:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:3523 read 0xbde64a thru 0xbeccc1 (0xe678 bytes) 2024-09-11T05:22:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:3528 write 0x2eea30 thru 0x2f99c2 (0xaf93 bytes) 2024-09-11T05:22:41.272 INFO:teuthology.orchestra.run.smithi012.stdout:3529 writesame 0xc373815 thru 0xc381c22 data_size 0x1(0xe40e bytes) 2024-09-11T05:22:41.272 INFO:teuthology.orchestra.run.smithi012.stdout:3530 write 0xb0bb32b thru 0xb0c199a (0x6670 bytes) 2024-09-11T05:22:41.277 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.277 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.277 INFO:teuthology.orchestra.run.smithi012.stdout:3533 write 0x76f3880 thru 0x76f7b4d (0x42ce bytes) 2024-09-11T05:22:41.284 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:41.282+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:41.291 INFO:teuthology.orchestra.run.smithi012.stdout:3535 write 0xecc91c1 thru 0xeccda8a (0x48ca bytes) 2024-09-11T05:22:41.292 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:41.292 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:41.294 INFO:teuthology.orchestra.run.smithi012.stdout:3537 write 0x6e2d7f8 thru 0x6e3ac4d (0xd456 bytes) 2024-09-11T05:22:41.298 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.298 INFO:teuthology.orchestra.run.smithi012.stdout:3539 write 0xb44473 thru 0xb461d7 (0x1d65 bytes) 2024-09-11T05:22:41.301 INFO:teuthology.orchestra.run.smithi012.stdout:3540 write 0x9c5eb8b thru 0x9c65ed0 (0x7346 bytes) 2024-09-11T05:22:41.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:41.316 INFO:teuthology.orchestra.run.smithi012.stdout:3541 trunc from 0xeccda8b to 0x4d7e96b 2024-09-11T05:22:41.326 INFO:teuthology.orchestra.run.smithi012.stdout:3542 punch from 0xdf605c to 0xdfe954, (0x88f8 bytes) 2024-09-11T05:22:41.333 INFO:teuthology.orchestra.run.smithi012.stdout:3545 write 0x63938f2 thru 0x6394322 (0xa31 bytes) 2024-09-11T05:22:41.342 INFO:teuthology.orchestra.run.smithi012.stdout:3546 trunc from 0x6394323 to 0xa65addb 2024-09-11T05:22:41.348 INFO:teuthology.orchestra.run.smithi012.stdout:3548 read 0x17a9417 thru 0x17aac30 (0x181a bytes) 2024-09-11T05:22:41.348 INFO:teuthology.orchestra.run.smithi012.stdout:3549 punch from 0x3f17c3a to 0x3f22b77, (0xaf3d bytes) 2024-09-11T05:22:41.348 INFO:teuthology.orchestra.run.smithi012.stdout:3551 flatten 2024-09-11T05:22:41.362 INFO:teuthology.orchestra.run.smithi012.stdout:3553 writesame 0xa4c7eda thru 0xa4caf99 data_size 0x50(0x30c0 bytes) 2024-09-11T05:22:41.376 INFO:teuthology.orchestra.run.smithi012.stdout:3556 writesame 0xe111c39 thru 0xe11313e data_size 0x1a(0x1506 bytes) 2024-09-11T05:22:41.377 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.377 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.377 INFO:teuthology.orchestra.run.smithi012.stdout:3559 read 0x86f58e3 thru 0x86faa74 (0x5192 bytes) 2024-09-11T05:22:41.377 INFO:teuthology.orchestra.run.smithi012.stdout:3560 write 0xaecad91 thru 0xaeda172 (0xf3e2 bytes) 2024-09-11T05:22:41.380 INFO:teuthology.orchestra.run.smithi012.stdout:3561 read 0x7c8581c thru 0x7c8d6ba (0x7e9f bytes) 2024-09-11T05:22:41.380 INFO:teuthology.orchestra.run.smithi012.stdout:3562 write 0x86cc936 thru 0x86d86e8 (0xbdb3 bytes) 2024-09-11T05:22:41.384 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:41.383+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:41.385 INFO:teuthology.orchestra.run.smithi012.stdout:3565 write 0x4f6e866 thru 0x4f71076 (0x2811 bytes) 2024-09-11T05:22:41.389 INFO:teuthology.orchestra.run.smithi012.stdout:3566 punch from 0x83de9fd to 0x83e2cc6, (0x42c9 bytes) 2024-09-11T05:22:41.389 INFO:teuthology.orchestra.run.smithi012.stdout:3567 writesame 0x9aa27b0 thru 0x9aa8994 data_size 0x1(0x61e5 bytes) 2024-09-11T05:22:41.410 INFO:teuthology.orchestra.run.smithi012.stdout:3569 trunc from 0xe11313f to 0x7f42efd 2024-09-11T05:22:41.420 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.421 INFO:teuthology.orchestra.run.smithi012.stdout:3573 punch from 0x6805277 to 0x6813fef, (0xed78 bytes) 2024-09-11T05:22:41.423 INFO:teuthology.orchestra.run.smithi012.stdout:3574 trunc from 0x7f42efd to 0x58248c4 2024-09-11T05:22:41.431 INFO:teuthology.orchestra.run.smithi012.stdout:3575 read 0x562b003 thru 0x562da8c (0x2a8a bytes) 2024-09-11T05:22:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:22:41.440 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:41.440 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:41.449 INFO:teuthology.orchestra.run.smithi012.stdout:3576 writesame 0xb663c86 thru 0xb66f9e9 data_size 0x5c(0xbd64 bytes) 2024-09-11T05:22:41.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:41.457 INFO:teuthology.orchestra.run.smithi012.stdout:3577 trunc from 0xb66f9ea to 0x5c51d11 2024-09-11T05:22:41.462 INFO:teuthology.orchestra.run.smithi012.stdout:3578 read 0x111b626 thru 0x112673f (0xb11a bytes) 2024-09-11T05:22:41.462 INFO:teuthology.orchestra.run.smithi012.stdout:3581 read 0x18a16ce thru 0x18a2fb5 (0x18e8 bytes) 2024-09-11T05:22:41.463 INFO:teuthology.orchestra.run.smithi012.stdout:3582 writesame 0x50267b8 thru 0x5032add data_size 0x1(0xc326 bytes) 2024-09-11T05:22:41.486 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:41.485+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:41.487 INFO:teuthology.orchestra.run.smithi012.stdout:3583 punch from 0x14c1b75 to 0x14c823b, (0x66c6 bytes) 2024-09-11T05:22:41.487 INFO:teuthology.orchestra.run.smithi012.stdout:3584 punch from 0x436ed43 to 0x4378a43, (0x9d00 bytes) 2024-09-11T05:22:41.487 INFO:teuthology.orchestra.run.smithi012.stdout:3585 punch from 0x47f9c3a to 0x47fc6f8, (0x2abe bytes) 2024-09-11T05:22:41.487 INFO:teuthology.orchestra.run.smithi012.stdout:3586 read 0x35c2331 thru 0x35c2e1b (0xaeb bytes) 2024-09-11T05:22:41.487 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.488 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.488 INFO:teuthology.orchestra.run.smithi012.stdout:3594 read 0x46170e8 thru 0x4618c6f (0x1b88 bytes) 2024-09-11T05:22:41.488 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.488 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.488 INFO:teuthology.orchestra.run.smithi012.stdout:3598 write 0x3e3ca5e thru 0x3e446a3 (0x7c46 bytes) 2024-09-11T05:22:41.490 INFO:teuthology.orchestra.run.smithi012.stdout:3599 read 0x864c90 thru 0x87269c (0xda0d bytes) 2024-09-11T05:22:41.490 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.490 INFO:teuthology.orchestra.run.smithi012.stdout:3602 read 0x3e4349e thru 0x3e5215a (0xecbd bytes) 2024-09-11T05:22:41.492 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.493 INFO:teuthology.orchestra.run.smithi012.stdout:3604 punch from 0x2501182 to 0x250419a, (0x3018 bytes) 2024-09-11T05:22:41.493 INFO:teuthology.orchestra.run.smithi012.stdout:3605 trunc from 0x5c51d11 to 0x5b52ca2 2024-09-11T05:22:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:3606 write 0x7aa66cb thru 0x7ab1465 (0xad9b bytes) 2024-09-11T05:22:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:3607 writesame 0x215ed59 thru 0x215f7c0 data_size 0x6(0xa68 bytes) 2024-09-11T05:22:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:3610 write 0xe591bbc thru 0xe597ba0 (0x5fe5 bytes) 2024-09-11T05:22:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:3612 trunc from 0xe597ba1 to 0xa815919 2024-09-11T05:22:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:3614 read 0x8a8a27f thru 0x8a8ced2 (0x2c54 bytes) 2024-09-11T05:22:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:3615 punch from 0x9496e38 to 0x94a181c, (0xa9e4 bytes) 2024-09-11T05:22:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:3616 read 0x3bd44ac thru 0x3bda74e (0x62a3 bytes) 2024-09-11T05:22:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:3618 write 0x595c37a thru 0x5964214 (0x7e9b bytes) 2024-09-11T05:22:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:3619 write 0x7f74848 thru 0x7f828b5 (0xe06e bytes) 2024-09-11T05:22:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:3620 write 0xddeb6ed thru 0xddeeff7 (0x390b bytes) 2024-09-11T05:22:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:3621 read 0x2f75812 thru 0x2f777df (0x1fce bytes) 2024-09-11T05:22:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:3623 trunc from 0xddeeff8 to 0x9417a9a 2024-09-11T05:22:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:3624 punch from 0x82dff6c to 0x82e48b7, (0x494b bytes) 2024-09-11T05:22:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:3625 read 0x71e4301 thru 0x71e4816 (0x516 bytes) 2024-09-11T05:22:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:3627 write 0xa13d4c2 thru 0xa14c5a4 (0xf0e3 bytes) 2024-09-11T05:22:41.586 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:41.585+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:3630 read 0x377d070 thru 0x3781807 (0x4798 bytes) 2024-09-11T05:22:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:3631 writesame 0x8c5312e thru 0x8c5859d data_size 0x4(0x5470 bytes) 2024-09-11T05:22:41.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:3632 read 0x3be1605 thru 0x3be8a2d (0x7429 bytes) 2024-09-11T05:22:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:3634 read 0x7546bf5 thru 0x754768d (0xa99 bytes) 2024-09-11T05:22:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:3637 punch from 0x7795baa to 0x779adc2, (0x5218 bytes) 2024-09-11T05:22:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:3639 read 0x375ae1 thru 0x380915 (0xae35 bytes) 2024-09-11T05:22:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:3640 punch from 0x87847ee to 0x8792fe3, (0xe7f5 bytes) 2024-09-11T05:22:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:3642 read 0x50fb711 thru 0x5108e53 (0xd743 bytes) 2024-09-11T05:22:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:3645 write 0x738d4f7 thru 0x73995e4 (0xc0ee bytes) 2024-09-11T05:22:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:3648 read 0x891991c thru 0x891ecbc (0x53a1 bytes) 2024-09-11T05:22:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:3649 punch from 0x543e30c to 0x5448381, (0xa075 bytes) 2024-09-11T05:22:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:3651 write 0x47c5e08 thru 0x47d235a (0xc553 bytes) 2024-09-11T05:22:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:3652 read 0x4bc93ed thru 0x4bd9394 (0xffa8 bytes) 2024-09-11T05:22:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:3654 write 0x3f7ebeb thru 0x3f8a20a (0xb620 bytes) 2024-09-11T05:22:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:3655 read 0x9e648ee thru 0x9e69b17 (0x522a bytes) 2024-09-11T05:22:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:3657 trunc from 0xa14c5a5 to 0xd46668a 2024-09-11T05:22:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:3658 trunc from 0xd46668a to 0x58ee611 2024-09-11T05:22:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:3659 write 0x86f325 thru 0x86feaa (0xb86 bytes) 2024-09-11T05:22:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:3660 read 0x1908d0f thru 0x190a82a (0x1b1c bytes) 2024-09-11T05:22:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:3662 trunc from 0x58ee611 to 0x3fa0802 2024-09-11T05:22:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:3665 read 0x3130fcc thru 0x3134a74 (0x3aa9 bytes) 2024-09-11T05:22:41.667 INFO:teuthology.orchestra.run.smithi012.stdout:3668 trunc from 0x3fa0802 to 0xe9aac12 2024-09-11T05:22:41.672 INFO:teuthology.orchestra.run.smithi012.stdout:3669 write 0x7d105f3 thru 0x7d1890d (0x831b bytes) 2024-09-11T05:22:41.675 INFO:teuthology.orchestra.run.smithi012.stdout:3670 punch from 0x2bbae27 to 0x2bbed45, (0x3f1e bytes) 2024-09-11T05:22:41.676 INFO:teuthology.orchestra.run.smithi012.stdout:3671 read 0x40fe814 thru 0x41005bd (0x1daa bytes) 2024-09-11T05:22:41.676 INFO:teuthology.orchestra.run.smithi012.stdout:3675 write 0x57f5d6b thru 0x57fa021 (0x42b7 bytes) 2024-09-11T05:22:41.680 INFO:teuthology.orchestra.run.smithi012.stdout:3677 read 0x5aff063 thru 0x5b02e0f (0x3dad bytes) 2024-09-11T05:22:41.680 INFO:teuthology.orchestra.run.smithi012.stdout:3678 write 0x31fee37 thru 0x32007eb (0x19b5 bytes) 2024-09-11T05:22:41.683 INFO:teuthology.orchestra.run.smithi012.stdout:3679 write 0x9dc564 thru 0x9e4af5 (0x8592 bytes) 2024-09-11T05:22:41.687 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:41.686+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:41.688 INFO:teuthology.orchestra.run.smithi012.stdout:3680 write 0x5804a6d thru 0x580d4d4 (0x8a68 bytes) 2024-09-11T05:22:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:3681 clone 32 order 19 su 8192 sc 3 2024-09-11T05:22:41.714 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:41.714 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:41.723 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:41.788 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:41.787+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:41.878 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:41.879 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:41.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:41.889 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:41.888+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:41.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:41.989+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:41.995 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:41.995 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:41.995 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:41.995 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:41.995 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:42.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:42.045 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T05:22:42.062 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:42.063 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:42.080 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:42.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:42.090+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:42.097 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:42.097 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:42.115 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:42.115 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:42.133 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:42.133 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:42.136 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:22:42.137 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:22:42.153 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:42.153 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:42.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:42.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:42.202+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:42.272 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:42.272 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:42.281 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:42.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:42.291+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:42.385 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:42.385 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:42.393 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:42.392+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:42.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:42.494 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:42.492+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:42.502 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:42.502 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:42.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:42.541 INFO:teuthology.orchestra.run.smithi012.stdout: marking collection for removal 2024-09-11T05:22:42.541 INFO:teuthology.orchestra.run.smithi012.stdout:setting '_remove' omap key 2024-09-11T05:22:42.548 INFO:teuthology.orchestra.run.smithi012.stdout:finish_remove_pgs 2.7_head removing 2.7 2024-09-11T05:22:42.548 INFO:teuthology.orchestra.run.smithi012.stdout:Remove successful 2024-09-11T05:22:42.595 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:42.594+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:42.645 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-11T05:22:42.656 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:42.656 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:42.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:42.706 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:42.706+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:42.796 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:42.795+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:42.807 INFO:teuthology.orchestra.run.smithi012.stdout:3683 read 0x6533c84 thru 0x65357a3 (0x1b20 bytes) 2024-09-11T05:22:42.808 INFO:teuthology.orchestra.run.smithi012.stdout:3687 read 0x5e66878 thru 0x5e71b99 (0xb322 bytes) 2024-09-11T05:22:42.808 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.808 INFO:teuthology.orchestra.run.smithi012.stdout:3689 punch from 0x42ea7b3 to 0x42ed598, (0x2de5 bytes) 2024-09-11T05:22:42.809 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:42.809 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:42.811 INFO:teuthology.orchestra.run.smithi012.stdout:3692 write 0xcb8b60e thru 0xcb97633 (0xc026 bytes) 2024-09-11T05:22:42.818 INFO:teuthology.orchestra.run.smithi012.stdout:3693 read 0x5784b86 thru 0x5794233 (0xf6ae bytes) 2024-09-11T05:22:42.818 INFO:teuthology.orchestra.run.smithi012.stdout:3694 read 0xd2a0765 thru 0xd2ac784 (0xc020 bytes) 2024-09-11T05:22:42.818 INFO:teuthology.orchestra.run.smithi012.stdout:3695 writesame 0xb243174 thru 0xb24e67f data_size 0x2(0xb50c bytes) 2024-09-11T05:22:42.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:42.825 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.825 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.825 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.825 INFO:teuthology.orchestra.run.smithi012.stdout:3699 punch from 0x62714bb to 0x62723a1, (0xee6 bytes) 2024-09-11T05:22:42.826 INFO:teuthology.orchestra.run.smithi012.stdout:3700 write 0x9cb7ea5 thru 0x9cbd9da (0x5b36 bytes) 2024-09-11T05:22:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.829 INFO:teuthology.orchestra.run.smithi012.stdout:3704 write 0xdf02833 thru 0xdf11a5c (0xf22a bytes) 2024-09-11T05:22:42.833 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.847 INFO:teuthology.orchestra.run.smithi012.stdout:3706 trunc from 0xe9aac12 to 0x1fe660c 2024-09-11T05:22:42.881 INFO:teuthology.orchestra.run.smithi012.stdout:3707 write 0xaf35aad thru 0xaf3abfd (0x5151 bytes) 2024-09-11T05:22:42.885 INFO:teuthology.orchestra.run.smithi012.stdout:3708 punch from 0x815f4b1 to 0x8164aad, (0x55fc bytes) 2024-09-11T05:22:42.891 INFO:teuthology.orchestra.run.smithi012.stdout:3709 write 0xbd69f48 thru 0xbd7784e (0xd907 bytes) 2024-09-11T05:22:42.895 INFO:teuthology.orchestra.run.smithi012.stdout:3710 read 0xb4e22cd thru 0xb4f11f9 (0xef2d bytes) 2024-09-11T05:22:42.895 INFO:teuthology.orchestra.run.smithi012.stdout:3711 write 0x1f85fbc thru 0x1f86de7 (0xe2c bytes) 2024-09-11T05:22:42.897 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:42.896+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:42.906 INFO:teuthology.orchestra.run.smithi012.stdout:3712 trunc from 0xbd7784f to 0x35f9a04 2024-09-11T05:22:42.932 INFO:teuthology.orchestra.run.smithi012.stdout:3713 write 0xd96b9da thru 0xd96f164 (0x378b bytes) 2024-09-11T05:22:42.937 INFO:teuthology.orchestra.run.smithi012.stdout:3714 write 0x15b8020 thru 0x15bd470 (0x5451 bytes) 2024-09-11T05:22:42.941 INFO:teuthology.orchestra.run.smithi012.stdout:3716 read 0x92a6e6e thru 0x92ac2ff (0x5492 bytes) 2024-09-11T05:22:42.941 INFO:teuthology.orchestra.run.smithi012.stdout:3717 read 0x9c0d63 thru 0x9c4535 (0x37d3 bytes) 2024-09-11T05:22:42.941 INFO:teuthology.orchestra.run.smithi012.stdout:3718 read 0xc098d0f thru 0xc0997a2 (0xa94 bytes) 2024-09-11T05:22:42.947 INFO:teuthology.orchestra.run.smithi012.stdout:3719 trunc from 0xd96f165 to 0x82f637c 2024-09-11T05:22:42.957 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.963 INFO:teuthology.orchestra.run.smithi012.stdout:3721 trunc from 0x82f637c to 0x28d8f50 2024-09-11T05:22:42.969 INFO:teuthology.orchestra.run.smithi012.stdout:3723 read 0x23dc6f3 thru 0x23ea16f (0xda7d bytes) 2024-09-11T05:22:42.969 INFO:teuthology.orchestra.run.smithi012.stdout:3724 read 0x16a68f5 thru 0x16b3b70 (0xd27c bytes) 2024-09-11T05:22:42.969 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:42.969 INFO:teuthology.orchestra.run.smithi012.stdout:3726 punch from 0x168e442 to 0x1695cdf, (0x789d bytes) 2024-09-11T05:22:42.969 INFO:teuthology.orchestra.run.smithi012.stdout:3728 read 0x93b80f thru 0x94841b (0xcc0d bytes) 2024-09-11T05:22:42.970 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:42.970 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:42.970 INFO:teuthology.orchestra.run.smithi012.stdout:3729 read 0xe10f17 thru 0xe133ac (0x2496 bytes) 2024-09-11T05:22:42.978 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:42.987 INFO:teuthology.orchestra.run.smithi012.stdout:3731 writesame 0xd034383 thru 0xd03fadc data_size 0x3(0xb75a bytes) 2024-09-11T05:22:42.992 INFO:teuthology.orchestra.run.smithi012.stdout:3732 write 0xd3e9bae thru 0xd3f274b (0x8b9e bytes) 2024-09-11T05:22:42.996 INFO:teuthology.orchestra.run.smithi012.stdout:3733 writesame 0x7341d90 thru 0x7344db9 data_size 0x2d(0x302a bytes) 2024-09-11T05:22:42.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:42.997+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:43.001 INFO:teuthology.orchestra.run.smithi012.stdout:3734 trunc from 0xd3f274c to 0xe855765 2024-09-11T05:22:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:3741 writesame 0xc89cea3 thru 0xc89ed7b data_size 0x1(0x1ed9 bytes) 2024-09-11T05:22:43.025 INFO:teuthology.orchestra.run.smithi012.stdout:3742 trunc from 0xe855765 to 0xff1445 2024-09-11T05:22:43.046 INFO:teuthology.orchestra.run.smithi012.stdout:3743 write 0x7a1e3 thru 0x84aec (0xa90a bytes) 2024-09-11T05:22:43.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.7.2 2024-09-11T05:22:43.060 INFO:teuthology.orchestra.run.smithi012.stdout:3745 write 0xd8bf72 thru 0xd98ba8 (0xcc37 bytes) 2024-09-11T05:22:43.065 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.066 INFO:teuthology.orchestra.run.smithi012.stdout:3747 trunc from 0xff1445 to 0x2a46932 2024-09-11T05:22:43.091 INFO:teuthology.orchestra.run.smithi012.stdout:3749 write 0xdb5b623 thru 0xdb6a930 (0xf30e bytes) 2024-09-11T05:22:43.091 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:43.091 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:43.096 INFO:teuthology.orchestra.run.smithi012.stdout:3750 trunc from 0xdb6a931 to 0xd039a4f 2024-09-11T05:22:43.098 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:43.099 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:43.098+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:43.105 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.106 INFO:teuthology.orchestra.run.smithi012.stdout:3755 trunc from 0xd039a4f to 0xb91f175 2024-09-11T05:22:43.112 INFO:teuthology.orchestra.run.smithi012.stdout:3756 write 0x2cd46fd thru 0x2cd6074 (0x1978 bytes) 2024-09-11T05:22:43.115 INFO:teuthology.orchestra.run.smithi012.stdout:3757 write 0x204faa3 thru 0x205a635 (0xab93 bytes) 2024-09-11T05:22:43.119 INFO:teuthology.orchestra.run.smithi012.stdout:3758 write 0x2f1a46a thru 0x2f1c1f3 (0x1d8a bytes) 2024-09-11T05:22:43.123 INFO:teuthology.orchestra.run.smithi012.stdout:3759 read 0x76b3b44 thru 0x76c364f (0xfb0c bytes) 2024-09-11T05:22:43.134 INFO:teuthology.orchestra.run.smithi012.stdout:3760 trunc from 0xb91f175 to 0x13827f2 2024-09-11T05:22:43.146 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.154 INFO:teuthology.orchestra.run.smithi012.stdout:3762 trunc from 0x13827f2 to 0x78f759b 2024-09-11T05:22:43.159 INFO:teuthology.orchestra.run.smithi012.stdout:3765 read 0x40734ba thru 0x407a672 (0x71b9 bytes) 2024-09-11T05:22:43.166 INFO:teuthology.orchestra.run.smithi012.stdout:3766 writesame 0x8b280e2 thru 0x8b36803 data_size 0x61(0xe722 bytes) 2024-09-11T05:22:43.166 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.166 INFO:teuthology.orchestra.run.smithi012.stdout:3768 punch from 0x820d243 to 0x8212f92, (0x5d4f bytes) 2024-09-11T05:22:43.166 INFO:teuthology.orchestra.run.smithi012.stdout:3769 read 0x52142f6 thru 0x52195cd (0x52d8 bytes) 2024-09-11T05:22:43.166 INFO:teuthology.orchestra.run.smithi012.stdout:3771 read 0x6899a9e thru 0x68a56ec (0xbc4f bytes) 2024-09-11T05:22:43.175 INFO:teuthology.orchestra.run.smithi012.stdout:3773 write 0xc3a94a4 thru 0xc3aa3f2 (0xf4f bytes) 2024-09-11T05:22:43.178 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.178 INFO:teuthology.orchestra.run.smithi012.stdout:3776 write 0xa1419e2 thru 0xa14f03d (0xd65c bytes) 2024-09-11T05:22:43.183 INFO:teuthology.orchestra.run.smithi012.stdout:3777 punch from 0x66f8bd1 to 0x66fb682, (0x2ab1 bytes) 2024-09-11T05:22:43.183 INFO:teuthology.orchestra.run.smithi012.stdout:3779 write 0x151051d thru 0x1516a7c (0x6560 bytes) 2024-09-11T05:22:43.192 INFO:teuthology.orchestra.run.smithi012.stdout:3780 write 0xcbc87bc thru 0xcbcee39 (0x667e bytes) 2024-09-11T05:22:43.196 INFO:teuthology.orchestra.run.smithi012.stdout:3782 writesame 0x8d4b26e thru 0x8d528e8 data_size 0x7(0x767b bytes) 2024-09-11T05:22:43.200 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:43.198+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:43.201 INFO:teuthology.orchestra.run.smithi012.stdout:3784 writesame 0x2e79b55 thru 0x2e7a336 data_size 0x1(0x7e2 bytes) 2024-09-11T05:22:43.205 INFO:teuthology.orchestra.run.smithi012.stdout:3785 punch from 0x39fc0ee to 0x3a02cee, (0x6c00 bytes) 2024-09-11T05:22:43.205 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.205 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.205 INFO:teuthology.orchestra.run.smithi012.stdout:3790 read 0xb19a86a thru 0xb1a8250 (0xd9e7 bytes) 2024-09-11T05:22:43.206 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:43.206 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:43.215 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:43.217 INFO:teuthology.orchestra.run.smithi012.stdout:3791 trunc from 0xcbcee3a to 0x14d775f 2024-09-11T05:22:43.240 INFO:teuthology.orchestra.run.smithi012.stdout:3792 write 0x70c7657 thru 0x70c8626 (0xfd0 bytes) 2024-09-11T05:22:43.243 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.243 INFO:teuthology.orchestra.run.smithi012.stdout:3796 write 0x1329868 thru 0x1338664 (0xedfd bytes) 2024-09-11T05:22:43.247 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.248 INFO:teuthology.orchestra.run.smithi012.stdout:3798 punch from 0x5b69d18 to 0x5b78430, (0xe718 bytes) 2024-09-11T05:22:43.248 INFO:teuthology.orchestra.run.smithi012.stdout:3799 read 0x68cd9de thru 0x68ce085 (0x6a8 bytes) 2024-09-11T05:22:43.248 INFO:teuthology.orchestra.run.smithi012.stdout:3800 read 0x4ba97b thru 0x4c6571 (0xbbf7 bytes) 2024-09-11T05:22:43.250 INFO:teuthology.orchestra.run.smithi012.stdout:3801 trunc from 0x70c8627 to 0x8571a20 2024-09-11T05:22:43.255 INFO:teuthology.orchestra.run.smithi012.stdout:3802 trunc from 0x8571a20 to 0x8db0960 2024-09-11T05:22:43.260 INFO:teuthology.orchestra.run.smithi012.stdout:3803 punch from 0x38046d8 to 0x380844c, (0x3d74 bytes) 2024-09-11T05:22:43.260 INFO:teuthology.orchestra.run.smithi012.stdout:3804 writesame 0x8fd475 thru 0x908b06 data_size 0x1(0xb692 bytes) 2024-09-11T05:22:43.277 INFO:teuthology.orchestra.run.smithi012.stdout:3805 punch from 0x1d080e7 to 0x1d14c65, (0xcb7e bytes) 2024-09-11T05:22:43.277 INFO:teuthology.orchestra.run.smithi012.stdout:3806 write 0x3c7b05a thru 0x3c865c7 (0xb56e bytes) 2024-09-11T05:22:43.285 INFO:teuthology.orchestra.run.smithi012.stdout:3807 writesame 0x34e3ef4 thru 0x34e3f05 data_size 0x1(0x12 bytes) 2024-09-11T05:22:43.287 INFO:teuthology.orchestra.run.smithi012.stdout:3808 read 0x827046b thru 0x8274679 (0x420f bytes) 2024-09-11T05:22:43.294 INFO:teuthology.orchestra.run.smithi012.stdout:3809 write 0xaaff6ee thru 0xab0b37e (0xbc91 bytes) 2024-09-11T05:22:43.300 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:43.299+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:43.301 INFO:teuthology.orchestra.run.smithi012.stdout:3812 read 0x5fb76de thru 0x5fc280a (0xb12d bytes) 2024-09-11T05:22:43.302 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.302 INFO:teuthology.orchestra.run.smithi012.stdout:3815 punch from 0x6019426 to 0x6019756, (0x330 bytes) 2024-09-11T05:22:43.303 INFO:teuthology.orchestra.run.smithi012.stdout:3816 trunc from 0xab0b37f to 0x9add4f9 2024-09-11T05:22:43.313 INFO:teuthology.orchestra.run.smithi012.stdout:3817 trunc from 0x9add4f9 to 0x7979148 2024-09-11T05:22:43.318 INFO:teuthology.orchestra.run.smithi012.stdout:3818 write 0x248831a thru 0x24952bf (0xcfa6 bytes) 2024-09-11T05:22:43.322 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.325 INFO:teuthology.orchestra.run.smithi012.stdout:3820 trunc from 0x7979148 to 0x56cea3b 2024-09-11T05:22:43.333 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.339 INFO:teuthology.orchestra.run.smithi012.stdout:3823 write 0x631b764 thru 0x6320514 (0x4db1 bytes) 2024-09-11T05:22:43.354 INFO:teuthology.orchestra.run.smithi012.stdout:3824 write 0x9dc56ca thru 0x9dd3ae3 (0xe41a bytes) 2024-09-11T05:22:43.360 INFO:teuthology.orchestra.run.smithi012.stdout:3825 write 0x24bdf7c thru 0x24c9881 (0xb906 bytes) 2024-09-11T05:22:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:3827 read 0x9d8f71a thru 0x9d8fe47 (0x72e bytes) 2024-09-11T05:22:43.365 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:43.365 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:43.369 INFO:teuthology.orchestra.run.smithi012.stdout:3828 trunc from 0x9dd3ae4 to 0x3a53516 2024-09-11T05:22:43.375 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:43.379 INFO:teuthology.orchestra.run.smithi012.stdout:3829 punch from 0x3daa19 to 0x3e8794, (0xdd7b bytes) 2024-09-11T05:22:43.392 INFO:teuthology.orchestra.run.smithi012.stdout:3830 write 0xabc1d73 thru 0xabcf880 (0xdb0e bytes) 2024-09-11T05:22:43.395 INFO:teuthology.orchestra.run.smithi012.stdout:3832 write 0x5dde952 thru 0x5de100c (0x26bb bytes) 2024-09-11T05:22:43.399 INFO:teuthology.orchestra.run.smithi012.stdout:3834 punch from 0x4511d6c to 0x45180ce, (0x6362 bytes) 2024-09-11T05:22:43.399 INFO:teuthology.orchestra.run.smithi012.stdout:3836 writesame 0x1f655d0 thru 0x1f66136 data_size 0x7(0xb67 bytes) 2024-09-11T05:22:43.401 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:43.400+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:3837 write 0xe407a93 thru 0xe4100eb (0x8659 bytes) 2024-09-11T05:22:43.415 INFO:teuthology.orchestra.run.smithi012.stdout:3838 read 0x25d5c42 thru 0x25d84ea (0x28a9 bytes) 2024-09-11T05:22:43.422 INFO:teuthology.orchestra.run.smithi012.stdout:3839 trunc from 0xe4100ec to 0x7fd4554 2024-09-11T05:22:43.439 INFO:teuthology.orchestra.run.smithi012.stdout:3840 write 0x9bc2fb3 thru 0x9bd15fe (0xe64c bytes) 2024-09-11T05:22:43.446 INFO:teuthology.orchestra.run.smithi012.stdout:3842 write 0x57ad9e0 thru 0x57b4a00 (0x7021 bytes) 2024-09-11T05:22:43.453 INFO:teuthology.orchestra.run.smithi012.stdout:3845 punch from 0x7ce0e0b to 0x7cec26b, (0xb460 bytes) 2024-09-11T05:22:43.453 INFO:teuthology.orchestra.run.smithi012.stdout:3847 read 0x32ddcb2 thru 0x32e012a (0x2479 bytes) 2024-09-11T05:22:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:3851 punch from 0x7cbe5c to 0x7db533, (0xf6d7 bytes) 2024-09-11T05:22:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:3854 read 0x74fd2a9 thru 0x7507c04 (0xa95c bytes) 2024-09-11T05:22:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:3855 read 0x926fc91 thru 0x92708d2 (0xc42 bytes) 2024-09-11T05:22:43.454 INFO:teuthology.orchestra.run.smithi012.stdout:3857 write 0x54e0b3b thru 0x54ee35a (0xd820 bytes) 2024-09-11T05:22:43.459 INFO:teuthology.orchestra.run.smithi012.stdout:3858 write 0x363df2d thru 0x364621e (0x82f2 bytes) 2024-09-11T05:22:43.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:22:43.463 INFO:teuthology.orchestra.run.smithi012.stdout:3859 punch from 0x8e74ef6 to 0x8e774bb, (0x25c5 bytes) 2024-09-11T05:22:43.466 INFO:teuthology.orchestra.run.smithi012.stdout:3861 trunc from 0x9bd15ff to 0x7090b78 2024-09-11T05:22:43.475 INFO:teuthology.orchestra.run.smithi012.stdout:3862 read 0x3d6bed8 thru 0x3d7539e (0x94c7 bytes) 2024-09-11T05:22:43.482 INFO:teuthology.orchestra.run.smithi012.stdout:3863 write 0x893db73 thru 0x894364d (0x5adb bytes) 2024-09-11T05:22:43.497 INFO:teuthology.orchestra.run.smithi012.stdout:3864 write 0xcc602e1 thru 0xcc6e105 (0xde25 bytes) 2024-09-11T05:22:43.501 INFO:teuthology.orchestra.run.smithi012.stdout:3865 writesame 0xacf736e thru 0xad0390c data_size 0x1(0xc59f bytes) 2024-09-11T05:22:43.502 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:43.500+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:43.513 INFO:teuthology.orchestra.run.smithi012.stdout:3870 read 0xaba9586 thru 0xabafcb5 (0x6730 bytes) 2024-09-11T05:22:43.513 INFO:teuthology.orchestra.run.smithi012.stdout:3872 write 0x5887c8 thru 0x5978dc (0xf115 bytes) 2024-09-11T05:22:43.532 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:43.532 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:43.533 INFO:teuthology.orchestra.run.smithi012.stdout:3873 trunc from 0xcc6e106 to 0x695c398 2024-09-11T05:22:43.542 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:43.554 INFO:teuthology.orchestra.run.smithi012.stdout:3875 write 0xb8b6e81 thru 0xb8c3f26 (0xd0a6 bytes) 2024-09-11T05:22:43.565 INFO:teuthology.orchestra.run.smithi012.stdout:3876 writesame 0xc57dd20 thru 0xc586b53 data_size 0x26(0x8e34 bytes) 2024-09-11T05:22:43.571 INFO:teuthology.orchestra.run.smithi012.stdout:3877 write 0xd7caa8b thru 0xd7cbb18 (0x108e bytes) 2024-09-11T05:22:43.574 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.574 INFO:teuthology.orchestra.run.smithi012.stdout:3881 writesame 0x33b1274 thru 0x33bdbf9 data_size 0x7(0xc986 bytes) 2024-09-11T05:22:43.580 INFO:teuthology.orchestra.run.smithi012.stdout:3882 write 0x4563bcd thru 0x4568a7b (0x4eaf bytes) 2024-09-11T05:22:43.585 INFO:teuthology.orchestra.run.smithi012.stdout:3883 trunc from 0xd7cbb19 to 0xce858fe 2024-09-11T05:22:43.594 INFO:teuthology.orchestra.run.smithi012.stdout:3886 writesame 0xa48c2d4 thru 0xa49af1c data_size 0xd(0xec49 bytes) 2024-09-11T05:22:43.602 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.603 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:43.603 INFO:teuthology.orchestra.run.smithi012.stdout:3893 trunc from 0xce858fe to 0xd54a7de 2024-09-11T05:22:43.608 INFO:teuthology.orchestra.run.smithi012.stdout:3896 write 0x5de5412 thru 0x5df063a (0xb229 bytes) 2024-09-11T05:22:43.613 INFO:teuthology.orchestra.run.smithi012.stdout:3897 write 0xe140c6 thru 0xe1b284 (0x71bf bytes) 2024-09-11T05:22:43.614 INFO:teuthology.orchestra.run.smithi012.stdout:3898 clone 33 order 24 su 4194304 sc 5 2024-09-11T05:22:43.625 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:43.625+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:43.687 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:43.687 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:43.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:43.737 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:43.736+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:43.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:43.805+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:43.841 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:43.841 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:43.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:43.909 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:43.908+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:43.957 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:43.957 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:43.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:44.010 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:44.009+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:44.073 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:44.074 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:44.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:44.109 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:44.109+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:44.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:44.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:44.209+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:44.237 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:44.238 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:44.247 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:44.291 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:44.292 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:44.311 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:44.310+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:44.311 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T05:22:44.328 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:44.328 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:44.345 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:44.346 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:44.363 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:44.363 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:44.380 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:44.396 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:44.396 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:44.396 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:44.396 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:44.397 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:44.401 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:22:44.401 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:22:44.405 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:44.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:44.446+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:44.461 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:22:44.492 INFO:teuthology.orchestra.run.smithi012.stdout:get_pg_num_history pg_num_history pg_num_history(e70 pg_nums {1={15=1},2={18=8},3={22=32}} deleted_pools ) 2024-09-11T05:22:44.492 INFO:teuthology.orchestra.run.smithi012.stdout:Importing pgid 2.7 2024-09-11T05:22:44.492 INFO:teuthology.orchestra.run.smithi012.stdout:write_pg epoch 61 info 2.7( empty local-lis/les=60/61 n=0 ec=18/18 lis/c=60/60 les/c/f=61/61/0 sis=60) 2024-09-11T05:22:44.497 INFO:teuthology.orchestra.run.smithi012.stdout:Import successful 2024-09-11T05:22:44.512 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:44.511+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:44.522 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone32 from 0xd54a7de (overlap 0xff1445) to 0x198206 2024-09-11T05:22:44.580 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:44.580 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:44.580 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:44.580 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:44.580 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:44.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:44.631 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:44.630+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:44.637 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-11T05:22:44.714 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:44.714+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:44.763 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.763 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13298 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1949696~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.005985652, 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011903945000000001, 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13298 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755797+0000", 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755798+0000", 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2e-07 2024-09-11T05:22:44.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755800+0000", 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.934e-06 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755806+0000", 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2899999999999999e-06 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755811+0000", 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8210000000000001e-06 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767588+0000", 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011776963999999999 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767636+0000", 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8304999999999999e-05 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767701+0000", 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5210999999999996e-05 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13305 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 2048000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.005966168, 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996071000000001, 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.768 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13305 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755817+0000", 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755819+0000", 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.888e-06 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755825+0000", 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9190000000000004e-06 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755830+0000", 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5740000000000003e-06 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767722+0000", 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011891273000000001 2024-09-11T05:22:44.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767769+0000", 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7144000000000001e-05 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767813+0000", 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3863000000000003e-05 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13308 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1769472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.005944501999998, 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012084722000000001, 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13308 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755838+0000", 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755839+0000", 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:22:44.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755841+0000", 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755847+0000", 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1859999999999997e-06 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755852+0000", 2024-09-11T05:22:44.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767833+0000", 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011981331 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767880+0000", 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6350000000000002e-05 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767923+0000", 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3568e-05 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13314 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1769472~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.005924950000001, 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012198718000000001, 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13314 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755858+0000", 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755860+0000", 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7719999999999999e-06 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755867+0000", 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9260000000000003e-06 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755872+0000", 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767948+0000", 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012076643 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.767995+0000", 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6461999999999997e-05 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768057+0000", 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1846000000000004e-05 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13322 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.005896819, 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012296951, 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13322 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755886+0000", 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755889+0000", 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755896+0000", 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8560000000000001e-06 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755901+0000", 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1019999999999996e-06 2024-09-11T05:22:44.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768078+0000", 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012177248999999999 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768126+0000", 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929000000000001e-05 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768183+0000", 2024-09-11T05:22:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7005000000000001e-05 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13325 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1081344~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.005874890999998, 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01241014, 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13325 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755908+0000", 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755924+0000", 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5636000000000001e-05 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755931+0000", 2024-09-11T05:22:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9500000000000004e-06 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.755936+0000", 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1120000000000004e-06 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768203+0000", 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012267072 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768254+0000", 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0766000000000001e-05 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.768318+0000", 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4233000000000007e-05 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13343 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004358009999997, 2024-09-11T05:22:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011833961, 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13343 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757425+0000", 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757428+0000", 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757437+0000", 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757443+0000", 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769090+0000", 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011647014000000001 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769166+0000", 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5998e-05 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769259+0000", 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2699000000000001e-05 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.794 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13344 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1818624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004332695999999, 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011996009, 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13344 2024-09-11T05:22:44.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757450+0000", 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757451+0000", 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6699999999999999e-07 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757453+0000", 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757462+0000", 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1649999999999995e-06 2024-09-11T05:22:44.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757467+0000", 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4890000000000003e-06 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769291+0000", 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011823422 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769370+0000", 2024-09-11T05:22:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8658999999999993e-05 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769446+0000", 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6604e-05 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13348 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004295415000001, 2024-09-11T05:22:44.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.016500531999999998, 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13348 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757487+0000", 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757488+0000", 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.82e-07 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757491+0000", 2024-09-11T05:22:44.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8080000000000001e-06 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757502+0000", 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1245e-05 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757510+0000", 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0669999999999992e-06 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.769949+0000", 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012439131000000001 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770026+0000", 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6464000000000005e-05 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.773988+0000", 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0039622349999999997 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13351 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004263924, 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012814249, 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13351 2024-09-11T05:22:44.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757519+0000", 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.75e-07 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757522+0000", 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1739999999999999e-06 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757531+0000", 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8519999999999999e-06 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757539+0000", 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.763e-06 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770160+0000", 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012621267 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770234+0000", 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3619000000000001e-05 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770333+0000", 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9098999999999994e-05 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13353 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004234040999997, 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012966811999999999, 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13353 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757549+0000", 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757552+0000", 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3209999999999999e-06 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757559+0000", 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2779999999999996e-06 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757564+0000", 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770358+0000", 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012793617 2024-09-11T05:22:44.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770426+0000", 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8201000000000007e-05 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770516+0000", 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9889000000000006e-05 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13409 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 49152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004199321999998, 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013098782999999999, 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13409 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757584+0000", 2024-09-11T05:22:44.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757588+0000", 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1609999999999996e-06 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757598+0000", 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5189999999999998e-06 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757604+0000", 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8880000000000002e-06 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770540+0000", 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012935854 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770605+0000", 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5505000000000004e-05 2024-09-11T05:22:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770682+0000", 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7296e-05 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13413 3.0 3:042d4e90:::rbd_data.1179262aa3d7.000000000000000e:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004169916000002, 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013233299, 2024-09-11T05:22:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13413 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757613+0000", 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757616+0000", 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1270000000000001e-06 2024-09-11T05:22:44.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757624+0000", 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4470000000000006e-06 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757629+0000", 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2220000000000001e-06 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770705+0000", 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013075646 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770770+0000", 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4678000000000007e-05 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770846+0000", 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6723000000000004e-05 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:13419 3.0 3:03196139:::rbd_data.1179262aa3d7.0000000000000010:5 [read 229376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.004146411999997, 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013374044, 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 13419 2024-09-11T05:22:44.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757636+0000", 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757637+0000", 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757639+0000", 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9e-06 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757649+0000", 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7909999999999999e-06 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.757654+0000", 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.378e-06 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770870+0000", 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013215873 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.770935+0000", 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4887000000000004e-05 2024-09-11T05:22:44.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:53.771010+0000", 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5778999999999994e-05 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:59624 3.19 3:9b48071f:::rbd_data.117971c15f82.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.599098705999999, 2024-09-11T05:22:44.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.032257185000000001, 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 59624 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162684+0000", 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.162689+0000", 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165796+0000", 2024-09-11T05:22:44.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031078490000000002 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165845+0000", 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8242000000000003e-05 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165867+0000", 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2005e-05 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.165990+0000", 2024-09-11T05:22:44.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012330199999999999 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166150+0000", 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016035999999999999 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.166799+0000", 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064827299999999999 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:44.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.191931+0000", 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.025131982000000001 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194856+0000", 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002925825 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194897+0000", 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0252e-05 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:04.194941+0000", 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4746000000000002e-05 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:70775 3.6 e57/22 3:65762739:::rbd_data.1179db619f31.0000000000000005:head v 57'258, mlcod=57'256)", 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.873455456999999, 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.029681609000000001, 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:44.832 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888327+0000", 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.888329+0000", 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.75e-06 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893284+0000", 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0049547510000000003 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893317+0000", 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2780000000000001e-05 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893327+0000", 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.893e-06 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893386+0000", 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9367999999999998e-05 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.893414+0000", 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8028999999999999e-05 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.917939+0000", 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.024524607 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:21.918009+0000", 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0431000000000004e-05 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.836 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:76285 3.19 3:99554f66:::rbd_data.117930a4df71.000000000000001a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.612137110000001, 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.022701743, 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 76285 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149646+0000", 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149651+0000", 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2130000000000002e-06 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149661+0000", 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0699999999999999e-05 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149666+0000", 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8459999999999999e-06 2024-09-11T05:22:44.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149721+0000", 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4701999999999999e-05 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.149869+0000", 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000147995 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.154094+0000", 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0042250810000000003 2024-09-11T05:22:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172268+0000", 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.018174299000000001 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172280+0000", 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1839e-05 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172315+0000", 2024-09-11T05:22:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5055999999999998e-05 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:30.172347+0000", 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2283999999999998e-05 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:77037 3.4 3:26ddd74e:::rbd_data.117930a4df71.0000000000000010:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:31.226233+0000", 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 13.535550264999999, 2024-09-11T05:22:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.020930095999999999, 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 77037 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226233+0000", 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226233+0000", 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226235+0000", 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226243+0000", 2024-09-11T05:22:44.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8659999999999995e-06 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226260+0000", 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6846000000000001e-05 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226268+0000", 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3130000000000001e-06 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226325+0000", 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7683000000000003e-05 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.226442+0000", 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116494 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 2", 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.229876+0000", 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034346749999999999 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247078+0000", 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017201050999999998 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247089+0000", 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1620000000000001e-05 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247123+0000", 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4283999999999999e-05 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:31.247163+0000", 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9283000000000003e-05 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:77751 3.19 3:9b06e424:::rbd_data.117960ca2f2d.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:35.708237+0000", 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 9.0535463489999994, 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.020577310000000001, 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 77751 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708237+0000", 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708237+0000", 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708237+0000", 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7400000000000002e-07 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708242+0000", 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.673e-06 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708253+0000", 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0852e-05 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708258+0000", 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1989999999999997e-06 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708305+0000", 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6749999999999998e-05 2024-09-11T05:22:44.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.708411+0000", 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106586 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.711802+0000", 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033904859999999998 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.728670+0000", 2024-09-11T05:22:44.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.016867920000000002 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.728689+0000", 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9644e-05 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.728757+0000", 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7330999999999996e-05 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:35.728814+0000", 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6994999999999999e-05 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:82211 3.19 3:98c10f36:::rbd_data.1179da19fbd7.0000000000000013:head [stat,delete] snapc 23=[23] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:44.533110+0000", 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.22867306100000001, 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012002842, 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:44.854 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 82211 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.533110+0000", 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.533110+0000", 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:44.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.533111+0000", 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.78e-07 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.533115+0000", 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.464e-06 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:44.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.533125+0000", 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4700000000000008e-06 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.533132+0000", 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.537978+0000", 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0048462820000000004 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:44.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.538060+0000", 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1415000000000006e-05 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 3", 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.538177+0000", 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011736 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.541550+0000", 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033728320000000001 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.544305+0000", 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002755033 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.545071+0000", 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00076604799999999997 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:44.545113+0000", 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1650999999999998e-05 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:44.860 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:44.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:44.862 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:44.860+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:44.926 INFO:teuthology.orchestra.run.smithi012.stdout:3901 flatten 2024-09-11T05:22:44.962 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:44.962+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:44.981 INFO:teuthology.orchestra.run.smithi012.stdout:3902 write 0x53c4275 thru 0x53cd389 (0x9115 bytes) 2024-09-11T05:22:44.985 INFO:teuthology.orchestra.run.smithi012.stdout:3905 read 0x5ae623d thru 0x5ae8a2b (0x27ef bytes) 2024-09-11T05:22:44.987 INFO:teuthology.orchestra.run.smithi012.stdout:3906 trunc from 0xd54a7de to 0xb6d75ec 2024-09-11T05:22:44.994 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:44.994 INFO:teuthology.orchestra.run.smithi012.stdout:3909 read 0x60a6699 thru 0x60b39f0 (0xd358 bytes) 2024-09-11T05:22:44.994 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:44.995 INFO:teuthology.orchestra.run.smithi012.stdout:3911 write 0x979d6e0 thru 0x97a9742 (0xc063 bytes) 2024-09-11T05:22:44.997 INFO:teuthology.orchestra.run.smithi012.stdout:3912 punch from 0x4285fd9 to 0x4292315, (0xc33c bytes) 2024-09-11T05:22:44.997 INFO:teuthology.orchestra.run.smithi012.stdout:3913 write 0x605af06 thru 0x606183b (0x6936 bytes) 2024-09-11T05:22:45.000 INFO:teuthology.orchestra.run.smithi012.stdout:3914 read 0x65a496a thru 0x65a499d (0x34 bytes) 2024-09-11T05:22:45.001 INFO:teuthology.orchestra.run.smithi012.stdout:3915 read 0x6a5a4c4 thru 0x6a62bd7 (0x8714 bytes) 2024-09-11T05:22:45.008 INFO:teuthology.orchestra.run.smithi012.stdout:3918 trunc from 0xb6d75ec to 0x4d38dea 2024-09-11T05:22:45.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /var/log/ceph/exp.2.7.2 2024-09-11T05:22:45.029 INFO:teuthology.orchestra.run.smithi012.stdout:3919 trunc from 0x4d38dea to 0xabf941a 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:83814 3.18 3:191e4799:::rbd_object_map.117968ef4d31:head [call lock.assert_locked in=44b,call rbd.object_map_resize in=29b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:45.029553+0000", 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.00082446600000000004, 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000850313, 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 83814 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029553+0000", 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029553+0000", 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029556+0000", 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1480000000000002e-06 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029572+0000", 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5692000000000002e-05 2024-09-11T05:22:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029599+0000", 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.7239000000000001e-05 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029610+0000", 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0511e-05 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029673+0000", 2024-09-11T05:22:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3120999999999994e-05 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029749+0000", 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6328000000000005e-05 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:45.029934+0000", 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00018533199999999999 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:22:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 1 2024-09-11T05:22:45.036 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:45.036 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.036 INFO:teuthology.orchestra.run.smithi012.stdout:3921 read 0xa488121 thru 0xa49617c (0xe05c bytes) 2024-09-11T05:22:45.041 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:45.042 INFO:teuthology.orchestra.run.smithi012.stdout:3922 write 0xb9cd308 thru 0xb9d8e17 (0xbb10 bytes) 2024-09-11T05:22:45.046 INFO:teuthology.orchestra.run.smithi012.stdout:3923 writesame 0xb2bad4c thru 0xb2c7f88 data_size 0x1(0xd23d bytes) 2024-09-11T05:22:45.063 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:45.063+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:45.069 INFO:teuthology.orchestra.run.smithi012.stdout:3924 writesame 0x3371fde thru 0x3376011 data_size 0xe(0x4034 bytes) 2024-09-11T05:22:45.071 INFO:teuthology.orchestra.run.smithi012.stdout:3926 writesame 0x16b91db thru 0x16c5b3e data_size 0x2(0xc964 bytes) 2024-09-11T05:22:45.080 INFO:teuthology.orchestra.run.smithi012.stdout:3928 read 0xac13fd4 thru 0xac1fa64 (0xba91 bytes) 2024-09-11T05:22:45.080 INFO:teuthology.orchestra.run.smithi012.stdout:3929 write 0x8cee6f2 thru 0x8cf4c7f (0x658e bytes) 2024-09-11T05:22:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.092 INFO:teuthology.orchestra.run.smithi012.stdout:3934 trunc from 0xb9d8e18 to 0x3a72231 2024-09-11T05:22:45.104 INFO:teuthology.orchestra.run.smithi012.stdout:3935 read 0x2cf2924 thru 0x2cf63ef (0x3acc bytes) 2024-09-11T05:22:45.105 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.105 INFO:teuthology.orchestra.run.smithi012.stdout:3939 write 0x355f1d4 thru 0x3562772 (0x359f bytes) 2024-09-11T05:22:45.106 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.106 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.109 INFO:teuthology.orchestra.run.smithi012.stdout:3943 trunc from 0x3a72231 to 0x14194d8 2024-09-11T05:22:45.117 INFO:teuthology.orchestra.run.smithi012.stdout:3944 read 0x912fbe thru 0x91aef9 (0x7f3c bytes) 2024-09-11T05:22:45.127 INFO:teuthology.orchestra.run.smithi012.stdout:3945 write 0x4b11b55 thru 0x4b15b20 (0x3fcc bytes) 2024-09-11T05:22:45.140 INFO:teuthology.orchestra.run.smithi012.stdout:3947 write 0x97dd438 thru 0x97df985 (0x254e bytes) 2024-09-11T05:22:45.143 INFO:teuthology.orchestra.run.smithi012.stdout:3948 punch from 0x1ae3645 to 0x1af306b, (0xfa26 bytes) 2024-09-11T05:22:45.143 INFO:teuthology.orchestra.run.smithi012.stdout:3949 writesame 0x4c4ec14 thru 0x4c57645 data_size 0x62(0x8a32 bytes) 2024-09-11T05:22:45.144 INFO:teuthology.orchestra.run.smithi012.stdout:3950 read 0x4ab1aed thru 0x4ab6f1e (0x5432 bytes) 2024-09-11T05:22:45.146 INFO:teuthology.orchestra.run.smithi012.stdout:3951 trunc from 0x97df986 to 0x8250cc2 2024-09-11T05:22:45.154 INFO:teuthology.orchestra.run.smithi012.stdout:3952 punch from 0x63885e3 to 0x63899f5, (0x1412 bytes) 2024-09-11T05:22:45.154 INFO:teuthology.orchestra.run.smithi012.stdout:3953 punch from 0x7d3d354 to 0x7d3eaec, (0x1798 bytes) 2024-09-11T05:22:45.154 INFO:teuthology.orchestra.run.smithi012.stdout:3954 write 0x1b6d57b thru 0x1b7c87a (0xf300 bytes) 2024-09-11T05:22:45.163 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:45.163+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:45.164 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:45.164 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:45.168 INFO:teuthology.orchestra.run.smithi012.stdout:3955 write 0xe01513b thru 0xe01b24b (0x6111 bytes) 2024-09-11T05:22:45.174 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:45.179 INFO:teuthology.orchestra.run.smithi012.stdout:3956 trunc from 0xe01b24c to 0x75b5f16 2024-09-11T05:22:45.199 INFO:teuthology.orchestra.run.smithi012.stdout:3957 writesame 0x809149a thru 0x8096707 data_size 0x3(0x526e bytes) 2024-09-11T05:22:45.199 INFO:teuthology.orchestra.run.smithi012.stdout:3958 write 0x6285f37 thru 0x628c2ca (0x6394 bytes) 2024-09-11T05:22:45.203 INFO:teuthology.orchestra.run.smithi012.stdout:3959 write 0x116dd0d thru 0x116ec96 (0xf8a bytes) 2024-09-11T05:22:45.204 INFO:teuthology.orchestra.run.smithi012.stdout:3960 read 0x1a07a2c thru 0x1a1473c (0xcd11 bytes) 2024-09-11T05:22:45.204 INFO:teuthology.orchestra.run.smithi012.stdout:3961 punch from 0x7907b4d to 0x7911b8f, (0xa042 bytes) 2024-09-11T05:22:45.204 INFO:teuthology.orchestra.run.smithi012.stdout:3962 write 0x7b478da thru 0x7b4ac36 (0x335d bytes) 2024-09-11T05:22:45.207 INFO:teuthology.orchestra.run.smithi012.stdout:3963 write 0x423ac37 thru 0x4246455 (0xb81f bytes) 2024-09-11T05:22:45.208 INFO:teuthology.orchestra.run.smithi012.stdout:3964 read 0x61b6091 thru 0x61be3b5 (0x8325 bytes) 2024-09-11T05:22:45.209 INFO:teuthology.orchestra.run.smithi012.stdout:3967 writesame 0x3743974 thru 0x3744d7e data_size 0x1(0x140b bytes) 2024-09-11T05:22:45.211 INFO:teuthology.orchestra.run.smithi012.stdout:3971 read 0x2171c34 thru 0x217769d (0x5a6a bytes) 2024-09-11T05:22:45.212 INFO:teuthology.orchestra.run.smithi012.stdout:3972 clone 34 order 19 su 262144 sc 14 2024-09-11T05:22:45.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:45.263+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:45.291 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.546948487000002, 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.546936598999999, 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.546899379000003, 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.546884597999998, 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.546873261999998, 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.545722460999997, 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.545708005999998, 2024-09-11T05:22:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.545697525999998, 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.545687059000002, 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.545668698999997, 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.542959627000002, 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.542936627000003, 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.542915264000001, 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.542893745000001, 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.542872817999999, 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.541039394000002, 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.541029080999998, 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.541018708000003, 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.541003678999999, 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.540993671000003, 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:45.390 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:45.392 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:45.392 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:45.391+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:45.493 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:45.492+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:45.501 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:45.501 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:45.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:45.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:45.592+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:45.613 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-11T05:22:45.615 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:45.616 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:45.616 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:45.616 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:45.616 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:45.618 INFO:teuthology.orchestra.run.smithi012.stdout:3974 write 0x7855b21 thru 0x7860ff6 (0xb4d6 bytes) 2024-09-11T05:22:45.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:45.632 INFO:teuthology.orchestra.run.smithi012.stdout:3975 writesame 0x93097e7 thru 0x930b564 data_size 0xa(0x1d7e bytes) 2024-09-11T05:22:45.632 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.640 INFO:teuthology.orchestra.run.smithi012.stdout:3977 write 0xbf4b7fd thru 0xbf4d8ce (0x20d2 bytes) 2024-09-11T05:22:45.644 INFO:teuthology.orchestra.run.smithi012.stdout:3979 write 0x23c6283 thru 0x23c6b18 (0x896 bytes) 2024-09-11T05:22:45.647 INFO:teuthology.orchestra.run.smithi012.stdout:3980 read 0xa61cbfd thru 0xa62b716 (0xeb1a bytes) 2024-09-11T05:22:45.647 INFO:teuthology.orchestra.run.smithi012.stdout:3982 punch from 0x2bbb5da to 0x2bbd450, (0x1e76 bytes) 2024-09-11T05:22:45.647 INFO:teuthology.orchestra.run.smithi012.stdout:3983 read 0x9b5e61a thru 0x9b6b53e (0xcf25 bytes) 2024-09-11T05:22:45.647 INFO:teuthology.orchestra.run.smithi012.stdout:3984 punch from 0x1ddf239 to 0x1ded2be, (0xe085 bytes) 2024-09-11T05:22:45.647 INFO:teuthology.orchestra.run.smithi012.stdout:3986 read 0x20ab826 thru 0x20b41c2 (0x899d bytes) 2024-09-11T05:22:45.648 INFO:teuthology.orchestra.run.smithi012.stdout:3988 punch from 0x2c7ab6c to 0x2c85fe7, (0xb47b bytes) 2024-09-11T05:22:45.648 INFO:teuthology.orchestra.run.smithi012.stdout:3989 punch from 0xad35a68 to 0xad40133, (0xa6cb bytes) 2024-09-11T05:22:45.648 INFO:teuthology.orchestra.run.smithi012.stdout:3990 punch from 0xa596159 to 0xa59e6b2, (0x8559 bytes) 2024-09-11T05:22:45.648 INFO:teuthology.orchestra.run.smithi012.stdout:3991 read 0x17a74d6 thru 0x17b6d35 (0xf860 bytes) 2024-09-11T05:22:45.649 INFO:teuthology.orchestra.run.smithi012.stdout:3992 write 0x339273d thru 0x33988a5 (0x6169 bytes) 2024-09-11T05:22:45.652 INFO:teuthology.orchestra.run.smithi012.stdout:3993 write 0x3ec5281 thru 0x3ec720c (0x1f8c bytes) 2024-09-11T05:22:45.658 INFO:teuthology.orchestra.run.smithi012.stdout:3994 read 0xacbc0d3 thru 0xacc9e6d (0xdd9b bytes) 2024-09-11T05:22:45.658 INFO:teuthology.orchestra.run.smithi012.stdout:3995 trunc from 0xbf4d8cf to 0xc44b4fd 2024-09-11T05:22:45.668 INFO:teuthology.orchestra.run.smithi012.stdout:3996 writesame 0xc43f3b1 thru 0xc44cf4f data_size 0x3(0xdb9f bytes) 2024-09-11T05:22:45.678 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.678 INFO:teuthology.orchestra.run.smithi012.stdout:3999 punch from 0x69cc273 to 0x69cea8e, (0x281b bytes) 2024-09-11T05:22:45.678 INFO:teuthology.orchestra.run.smithi012.stdout:4003 writesame 0x41a03ea thru 0x41a359b data_size 0x1(0x31b2 bytes) 2024-09-11T05:22:45.688 INFO:teuthology.orchestra.run.smithi012.stdout:4004 punch from 0x947223a to 0x9475a4f, (0x3815 bytes) 2024-09-11T05:22:45.694 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:45.694+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:45.696 INFO:teuthology.orchestra.run.smithi012.stdout:4005 write 0xe70b813 thru 0xe70fb63 (0x4351 bytes) 2024-09-11T05:22:45.700 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.700 INFO:teuthology.orchestra.run.smithi012.stdout:4008 read 0xbab7612 thru 0xbac0d01 (0x96f0 bytes) 2024-09-11T05:22:45.700 INFO:teuthology.orchestra.run.smithi012.stdout:4009 read 0xb2807bc thru 0xb28085e (0xa3 bytes) 2024-09-11T05:22:45.700 INFO:teuthology.orchestra.run.smithi012.stdout:4010 write 0x74bb0b6 thru 0x74c1444 (0x638f bytes) 2024-09-11T05:22:45.704 INFO:teuthology.orchestra.run.smithi012.stdout:4011 write 0x84a1aa thru 0x84f530 (0x5387 bytes) 2024-09-11T05:22:45.710 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.710 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.710 INFO:teuthology.orchestra.run.smithi012.stdout:4014 punch from 0xccffecd to 0xcd059b6, (0x5ae9 bytes) 2024-09-11T05:22:45.710 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.710 INFO:teuthology.orchestra.run.smithi012.stdout:4017 write 0x16fa0d4 thru 0x1705dbf (0xbcec bytes) 2024-09-11T05:22:45.714 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.714 INFO:teuthology.orchestra.run.smithi012.stdout:4019 punch from 0xc9b4f8b to 0xc9b672a, (0x179f bytes) 2024-09-11T05:22:45.714 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.714 INFO:teuthology.orchestra.run.smithi012.stdout:4021 write 0x6247454 thru 0x624fb35 (0x86e2 bytes) 2024-09-11T05:22:45.717 INFO:teuthology.orchestra.run.smithi012.stdout:4022 read 0xb3fb thru 0x1055e (0x5164 bytes) 2024-09-11T05:22:45.731 INFO:teuthology.orchestra.run.smithi012.stdout:4023 trunc from 0xe70fb64 to 0x235c141 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.099452376999999, 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.734 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:45.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.738 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.097310856, 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.739 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:45.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.097289291999999, 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:45.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:45.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.097275281000002, 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:45.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095449979999998, 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:45.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:45.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:45.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095435377000001, 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:45.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:45.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:45.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095418072000001, 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:45.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095393962999999, 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:45.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:45.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095365887, 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.779 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095338894999998, 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:45.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095298335999999, 2024-09-11T05:22:45.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.788 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.095274949, 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.789 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:45.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.999289842000003, 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:45.793 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:45.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.999270281999998, 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.802 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.999251067000003, 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:45.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.999230267000002, 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:45.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:45.811 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.115129752000001, 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:22:45.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:22:45.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.112139943999999, 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.818 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:22:45.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:22:45.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.647543052, 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:22:45.826 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:22:45.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.112959163999999, 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:22:45.833 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:22:45.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:45.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.839 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:45.840 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:45.840 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:45.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:45.842 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:45.840+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:45.843 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.843 INFO:teuthology.orchestra.run.smithi012.stdout:4027 writesame 0xacb0bdb thru 0xacb231f data_size 0x7(0x1745 bytes) 2024-09-11T05:22:45.843 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.843 INFO:teuthology.orchestra.run.smithi012.stdout:4034 write 0x7ec5006 thru 0x7ed2c2a (0xdc25 bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4035 read 0x31deb62 thru 0x31e3d7d (0x521c bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4036 punch from 0x1151fe3 to 0x115d7b6, (0xb7d3 bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4038 flatten 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4040 punch from 0x6ff60d8 to 0x6fff349, (0x9271 bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4041 writesame 0x5eaa73f thru 0x5eb7406 data_size 0x4(0xccc8 bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4043 read 0x3885a02 thru 0x388659e (0xb9d bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4045 writesame 0xa7e8152 thru 0xa7f1ad3 data_size 0x31(0x9982 bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4046 writesame 0x3d66131 thru 0x3d67cf6 data_size 0xa(0x1bc6 bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4047 writesame 0xc264e96 thru 0xc26cb93 data_size 0x3(0x7cfe bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4049 punch from 0x9dc03c4 to 0x9dc2a62, (0x269e bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4051 read 0x2157a98 thru 0x215cabd (0x5026 bytes) 2024-09-11T05:22:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:4052 writesame 0x8a281f3 thru 0x8a2ff92 data_size 0x86(0x7da0 bytes) 2024-09-11T05:22:45.845 INFO:teuthology.orchestra.run.smithi012.stdout:4054 trunc from 0xc26cb94 to 0x44c4df0 2024-09-11T05:22:45.850 INFO:teuthology.orchestra.run.smithi012.stdout:4055 punch from 0xf29262 to 0xf36e70, (0xdc0e bytes) 2024-09-11T05:22:45.861 INFO:teuthology.orchestra.run.smithi012.stdout:4056 writesame 0x946d8c2 thru 0x947983d data_size 0x3c(0xbf7c bytes) 2024-09-11T05:22:45.867 INFO:teuthology.orchestra.run.smithi012.stdout:4057 trunc from 0x947983e to 0x32ae164 2024-09-11T05:22:45.877 INFO:teuthology.orchestra.run.smithi012.stdout:4058 write 0x2556ba8 thru 0x255da86 (0x6edf bytes) 2024-09-11T05:22:45.881 INFO:teuthology.orchestra.run.smithi012.stdout:4059 read 0x1218889 thru 0x1226e6e (0xe5e6 bytes) 2024-09-11T05:22:45.881 INFO:teuthology.orchestra.run.smithi012.stdout:4060 punch from 0x1997fd4 to 0x199caca, (0x4af6 bytes) 2024-09-11T05:22:45.881 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.881 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.881 INFO:teuthology.orchestra.run.smithi012.stdout:4068 read 0x107a942 thru 0x10809da (0x6099 bytes) 2024-09-11T05:22:45.881 INFO:teuthology.orchestra.run.smithi012.stdout:4069 trunc from 0x32ae164 to 0x33e71e5 2024-09-11T05:22:45.896 INFO:teuthology.orchestra.run.smithi012.stdout:4070 write 0x7cafd43 thru 0x7cba9e7 (0xaca5 bytes) 2024-09-11T05:22:45.899 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.899 INFO:teuthology.orchestra.run.smithi012.stdout:4072 writesame 0x32d4808 thru 0x32d704d data_size 0x5(0x2846 bytes) 2024-09-11T05:22:45.903 INFO:teuthology.orchestra.run.smithi012.stdout:4073 write 0x5ef4064 thru 0x5ef416f (0x10c bytes) 2024-09-11T05:22:45.905 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.909 INFO:teuthology.orchestra.run.smithi012.stdout:4077 trunc from 0x7cba9e8 to 0x4af0dac 2024-09-11T05:22:45.918 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.918 INFO:teuthology.orchestra.run.smithi012.stdout:4079 write 0x1caa360 thru 0x1cb4bb1 (0xa852 bytes) 2024-09-11T05:22:45.937 INFO:teuthology.orchestra.run.smithi012.stdout:4082 write 0xdef093f thru 0xdefae94 (0xa556 bytes) 2024-09-11T05:22:45.940 INFO:teuthology.orchestra.run.smithi012.stdout:4083 read 0x535833d thru 0x535b53d (0x3201 bytes) 2024-09-11T05:22:45.940 INFO:teuthology.orchestra.run.smithi012.stdout:4085 write 0xd3b735f thru 0xd3c2db2 (0xba54 bytes) 2024-09-11T05:22:45.941 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:45.941+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:45.943 INFO:teuthology.orchestra.run.smithi012.stdout:4088 read 0x3011e60 thru 0x30135cd (0x176e bytes) 2024-09-11T05:22:45.944 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.944 INFO:teuthology.orchestra.run.smithi012.stdout:4090 write 0xd356db9 thru 0xd365922 (0xeb6a bytes) 2024-09-11T05:22:45.946 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.950 INFO:teuthology.orchestra.run.smithi012.stdout:4092 trunc from 0xdefae95 to 0xae93f3c 2024-09-11T05:22:45.970 INFO:teuthology.orchestra.run.smithi012.stdout:4096 writesame 0xe62817e thru 0xe63170b data_size 0x1b(0x958e bytes) 2024-09-11T05:22:45.970 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.971 INFO:teuthology.orchestra.run.smithi012.stdout:4098 read 0x7f9e370 thru 0x7fa95bd (0xb24e bytes) 2024-09-11T05:22:45.971 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:45.971 INFO:teuthology.orchestra.run.smithi012.stdout:4100 write 0x67e7138 thru 0x67f0ba0 (0x9a69 bytes) 2024-09-11T05:22:45.973 INFO:teuthology.orchestra.run.smithi012.stdout:4101 write 0xaabec1 thru 0xab90db (0xd21b bytes) 2024-09-11T05:22:45.976 INFO:teuthology.orchestra.run.smithi012.stdout:4103 writesame 0xc2eb3eb thru 0xc2f1dee data_size 0x17(0x6a04 bytes) 2024-09-11T05:22:45.994 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:45.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:45.994 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:45.995 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:45.995 INFO:teuthology.orchestra.run.smithi012.stdout:4105 trunc from 0xe63170c to 0x72f0e5 2024-09-11T05:22:46.005 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:46.019 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.029 INFO:teuthology.orchestra.run.smithi012.stdout:4107 writesame 0x4965ddf thru 0x496e8e9 data_size 0x69(0x8b0b bytes) 2024-09-11T05:22:46.039 INFO:teuthology.orchestra.run.smithi012.stdout:4110 write 0x7fcf06c thru 0x7fdbcf0 (0xcc85 bytes) 2024-09-11T05:22:46.042 INFO:teuthology.orchestra.run.smithi012.stdout:4111 writesame 0x592082f thru 0x5925891 data_size 0x1(0x5063 bytes) 2024-09-11T05:22:46.047 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:46.046+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:46.059 INFO:teuthology.orchestra.run.smithi012.stdout:4113 trunc from 0x7fdbcf1 to 0x3f71149 2024-09-11T05:22:46.070 INFO:teuthology.orchestra.run.smithi012.stdout:4114 trunc from 0x3f71149 to 0x26773c5 2024-09-11T05:22:46.081 INFO:teuthology.orchestra.run.smithi012.stdout:4115 write 0x2daf415 thru 0x2db2aea (0x36d6 bytes) 2024-09-11T05:22:46.093 INFO:teuthology.orchestra.run.smithi012.stdout:4116 writesame 0x5fdf1bb thru 0x5fdf5b5 data_size 0x1(0x3fb bytes) 2024-09-11T05:22:46.108 INFO:teuthology.orchestra.run.smithi012.stdout:4117 write 0xedd5e49 thru 0xede46ba (0xe872 bytes) 2024-09-11T05:22:46.111 INFO:teuthology.orchestra.run.smithi012.stdout:4119 read 0xa0e93c1 thru 0xa0e9a3b (0x67b bytes) 2024-09-11T05:22:46.111 INFO:teuthology.orchestra.run.smithi012.stdout:4123 read 0xc9f8cd7 thru 0xc9fa216 (0x1540 bytes) 2024-09-11T05:22:46.116 INFO:teuthology.orchestra.run.smithi012.stdout:4124 trunc from 0xede46bb to 0xaa61c11 2024-09-11T05:22:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:4126 write 0x78fd7a1 thru 0x7900b2c (0x338c bytes) 2024-09-11T05:22:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:4127 punch from 0x94cfb91 to 0x94da01a, (0xa489 bytes) 2024-09-11T05:22:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:4128 read 0x7913fba thru 0x791675f (0x27a6 bytes) 2024-09-11T05:22:46.132 INFO:teuthology.orchestra.run.smithi012.stdout:4129 writesame 0x7dcf6a9 thru 0x7dcfa33 data_size 0x1(0x38b bytes) 2024-09-11T05:22:46.134 INFO:teuthology.orchestra.run.smithi012.stdout:4130 read 0x9baf66b thru 0x9bbc141 (0xcad7 bytes) 2024-09-11T05:22:46.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:46.142+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:4133 trunc from 0xaa61c11 to 0x343069 2024-09-11T05:22:46.153 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:46.153 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:46.153 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:46.160 INFO:teuthology.orchestra.run.smithi012.stdout:4134 read 0x14e137 thru 0x1534d0 (0x539a bytes) 2024-09-11T05:22:46.160 INFO:teuthology.orchestra.run.smithi012.stdout:4135 read 0xcb0de thru 0xd50d9 (0x9ffc bytes) 2024-09-11T05:22:46.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:46.168 INFO:teuthology.orchestra.run.smithi012.stdout:4136 writesame 0x33f1ae9 thru 0x33f74d8 data_size 0x8(0x59f0 bytes) 2024-09-11T05:22:46.177 INFO:teuthology.orchestra.run.smithi012.stdout:4137 write 0x6a3b54e thru 0x6a3bad6 (0x589 bytes) 2024-09-11T05:22:46.187 INFO:teuthology.orchestra.run.smithi012.stdout:4140 trunc from 0x6a3bad7 to 0xbbd599c 2024-09-11T05:22:46.192 INFO:teuthology.orchestra.run.smithi012.stdout:4141 punch from 0x51713cd to 0x5177a42, (0x6675 bytes) 2024-09-11T05:22:46.193 INFO:teuthology.orchestra.run.smithi012.stdout:4142 write 0x3bcb947 thru 0x3bcf6c8 (0x3d82 bytes) 2024-09-11T05:22:46.197 INFO:teuthology.orchestra.run.smithi012.stdout:4144 punch from 0x64c2dc to 0x651267, (0x4f8b bytes) 2024-09-11T05:22:46.197 INFO:teuthology.orchestra.run.smithi012.stdout:4145 write 0x251a42e thru 0x2528f20 (0xeaf3 bytes) 2024-09-11T05:22:46.202 INFO:teuthology.orchestra.run.smithi012.stdout:4147 punch from 0x45509d7 to 0x455fb6a, (0xf193 bytes) 2024-09-11T05:22:46.202 INFO:teuthology.orchestra.run.smithi012.stdout:4148 read 0x9f95723 thru 0x9fa1792 (0xc070 bytes) 2024-09-11T05:22:46.202 INFO:teuthology.orchestra.run.smithi012.stdout:4149 write 0x88bde49 thru 0x88c41c3 (0x637b bytes) 2024-09-11T05:22:46.208 INFO:teuthology.orchestra.run.smithi012.stdout:4151 write 0x6b8a1e0 thru 0x6b8ac0e (0xa2f bytes) 2024-09-11T05:22:46.211 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.211 INFO:teuthology.orchestra.run.smithi012.stdout:4153 read 0xa75f0e1 thru 0xa761a53 (0x2973 bytes) 2024-09-11T05:22:46.211 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.211 INFO:teuthology.orchestra.run.smithi012.stdout:4155 read 0x6df99d1 thru 0x6e081a9 (0xe7d9 bytes) 2024-09-11T05:22:46.212 INFO:teuthology.orchestra.run.smithi012.stdout:4157 write 0x8e34fbf thru 0x8e35cb5 (0xcf7 bytes) 2024-09-11T05:22:46.214 INFO:teuthology.orchestra.run.smithi012.stdout:4159 punch from 0xa00b1ce to 0xa01258a, (0x73bc bytes) 2024-09-11T05:22:46.214 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.214 INFO:teuthology.orchestra.run.smithi012.stdout:4164 writesame 0x826dc29 thru 0x8273503 data_size 0x17(0x58db bytes) 2024-09-11T05:22:46.224 INFO:teuthology.orchestra.run.smithi012.stdout:4166 write 0xd17b83a thru 0xd17e842 (0x3009 bytes) 2024-09-11T05:22:46.227 INFO:teuthology.orchestra.run.smithi012.stdout:4168 write 0xad1f237 thru 0xad23254 (0x401e bytes) 2024-09-11T05:22:46.229 INFO:teuthology.orchestra.run.smithi012.stdout:4170 write 0xce6c1d0 thru 0xce7a399 (0xe1ca bytes) 2024-09-11T05:22:46.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:46.243+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:46.248 INFO:teuthology.orchestra.run.smithi012.stdout:4171 trunc from 0xd17e843 to 0xda6468 2024-09-11T05:22:46.274 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.677199944000002, 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.275 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:46.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:46.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.676972448000001, 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:46.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.676717633999999, 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.285 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:46.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.676348738999998, 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.290 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:46.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.676187192999997, 2024-09-11T05:22:46.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:46.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.675744457999997, 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:46.299 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.673597565000001, 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:46.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.671567013000001, 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:46.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:46.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:46.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:46.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.671546628000002, 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:46.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.454362822999997, 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:46.318 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:46.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.454341798999998, 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:46.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:46.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.327 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.454317543999998, 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.328 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:46.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:46.332 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.452638460000003, 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:46.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.452619114000001, 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:46.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.341 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.452598342000002, 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.342 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:46.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.452578932000002, 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.346 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:46.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.452558463000003, 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.351 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:46.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.452539573000003, 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.443201780000003, 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.366 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.443190954000002, 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:46.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:46.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:46.371 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:46.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:46.374 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:46.372+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4173 writesame 0xbea6ffc thru 0xbea9ebe data_size 0x1(0x2ec3 bytes) 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4174 write 0x211cb76 thru 0x2121ede (0x5369 bytes) 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4176 read 0xae341d3 thru 0xae38267 (0x4095 bytes) 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4177 read 0xbaf3e24 thru 0xbafe18b (0xa368 bytes) 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4179 write 0x8e821a7 thru 0x8e8c4a6 (0xa300 bytes) 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4181 write 0x9df6acc thru 0x9df7361 (0x896 bytes) 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4182 write 0xdab0291 thru 0xdab28de (0x264e bytes) 2024-09-11T05:22:46.375 INFO:teuthology.orchestra.run.smithi012.stdout:4183 trunc from 0xdab28df to 0x7cecf11 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:4184 write 0xdf54d78 thru 0xdf5a179 (0x5402 bytes) 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:4188 trunc from 0xdf5a17a to 0x3f016b3 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:4190 write 0xbe18221 thru 0xbe1fee3 (0x7cc3 bytes) 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:4191 write 0x6458c30 thru 0x64628e2 (0x9cb3 bytes) 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:4192 writesame 0x6836b37 thru 0x6838eb8 data_size 0x2d(0x2382 bytes) 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:4193 read 0x12d8b06 thru 0x12e16eb (0x8be6 bytes) 2024-09-11T05:22:46.376 INFO:teuthology.orchestra.run.smithi012.stdout:4194 write 0xac11933 thru 0xac16475 (0x4b43 bytes) 2024-09-11T05:22:46.379 INFO:teuthology.orchestra.run.smithi012.stdout:4195 punch from 0x8b0ecc3 to 0x8b16bef, (0x7f2c bytes) 2024-09-11T05:22:46.379 INFO:teuthology.orchestra.run.smithi012.stdout:4196 writesame 0x8b409e8 thru 0x8b50958 data_size 0x1(0xff71 bytes) 2024-09-11T05:22:46.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:46.421 INFO:teuthology.orchestra.run.smithi012.stdout:4197 write 0xd7af4c5 thru 0xd7b0513 (0x104f bytes) 2024-09-11T05:22:46.424 INFO:teuthology.orchestra.run.smithi012.stdout:4198 read 0x88cf6cb thru 0x88df42f (0xfd65 bytes) 2024-09-11T05:22:46.424 INFO:teuthology.orchestra.run.smithi012.stdout:4200 punch from 0xc6a6033 to 0xc6ab662, (0x562f bytes) 2024-09-11T05:22:46.424 INFO:teuthology.orchestra.run.smithi012.stdout:4201 write 0x2e589b3 thru 0x2e688e3 (0xff31 bytes) 2024-09-11T05:22:46.427 INFO:teuthology.orchestra.run.smithi012.stdout:4202 write 0xcf8943f thru 0xcf8dec5 (0x4a87 bytes) 2024-09-11T05:22:46.430 INFO:teuthology.orchestra.run.smithi012.stdout:4203 writesame 0x6f1fdf5 thru 0x6f27619 data_size 0x1(0x7825 bytes) 2024-09-11T05:22:46.445 INFO:teuthology.orchestra.run.smithi012.stdout:4208 writesame 0x52eabb0 thru 0x52f2072 data_size 0x1(0x74c3 bytes) 2024-09-11T05:22:46.457 INFO:teuthology.orchestra.run.smithi012.stdout:4210 read 0x743febf thru 0x74451a8 (0x52ea bytes) 2024-09-11T05:22:46.457 INFO:teuthology.orchestra.run.smithi012.stdout:4211 write 0xfcf5af thru 0xfd20fe (0x2b50 bytes) 2024-09-11T05:22:46.460 INFO:teuthology.orchestra.run.smithi012.stdout:4213 write 0xd59feb5 thru 0xd5a94f0 (0x963c bytes) 2024-09-11T05:22:46.463 INFO:teuthology.orchestra.run.smithi012.stdout:4214 write 0x2ce5fd0 thru 0x2cec8d8 (0x6909 bytes) 2024-09-11T05:22:46.466 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.467 INFO:teuthology.orchestra.run.smithi012.stdout:4216 write 0x45c09fb thru 0x45c1f07 (0x150d bytes) 2024-09-11T05:22:46.469 INFO:teuthology.orchestra.run.smithi012.stdout:4217 write 0x7749eb7 thru 0x774d968 (0x3ab2 bytes) 2024-09-11T05:22:46.471 INFO:teuthology.orchestra.run.smithi012.stdout:4218 write 0xf319bf thru 0xf3db06 (0xc148 bytes) 2024-09-11T05:22:46.473 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:46.473+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:46.474 INFO:teuthology.orchestra.run.smithi012.stdout:4220 writesame 0xb4a540a thru 0xb4b2207 data_size 0x8d(0xcdfe bytes) 2024-09-11T05:22:46.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:22:46.477 INFO:teuthology.orchestra.run.smithi012.stdout:4225 write 0xd013d3a thru 0xd019e4c (0x6113 bytes) 2024-09-11T05:22:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:4227 read 0xa971a1e thru 0xa97952b (0x7b0e bytes) 2024-09-11T05:22:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:4228 read 0x3031a60 thru 0x30350bc (0x365d bytes) 2024-09-11T05:22:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:4230 read 0x71443b2 thru 0x71452e0 (0xf2f bytes) 2024-09-11T05:22:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:4231 write 0xaa59e4a thru 0xaa60282 (0x6439 bytes) 2024-09-11T05:22:46.483 INFO:teuthology.orchestra.run.smithi012.stdout:4232 punch from 0x1c2ca34 to 0x1c30497, (0x3a63 bytes) 2024-09-11T05:22:46.491 INFO:teuthology.orchestra.run.smithi012.stdout:4233 trunc from 0xd7b0514 to 0x7cbe6a0 2024-09-11T05:22:46.507 INFO:teuthology.orchestra.run.smithi012.stdout:4235 writesame 0x49a8e9c thru 0x49ac176 data_size 0x1(0x32db bytes) 2024-09-11T05:22:46.515 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:46.515 INFO:teuthology.orchestra.run.smithi012.stdout:4239 writesame 0x38772fd thru 0x3881b2f data_size 0x1f(0xa833 bytes) 2024-09-11T05:22:46.520 INFO:teuthology.orchestra.run.smithi012.stdout:4240 punch from 0x6b77029 to 0x6b7e58c, (0x7563 bytes) 2024-09-11T05:22:46.520 INFO:teuthology.orchestra.run.smithi012.stdout:4242 writesame 0x22b2a3 thru 0x22e613 data_size 0x1(0x3371 bytes) 2024-09-11T05:22:46.526 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:46.526 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:46.526 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:46.526 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:46.527 INFO:teuthology.orchestra.run.smithi012.stdout:4243 read 0x7bcefa6 thru 0x7bd84bd (0x9518 bytes) 2024-09-11T05:22:46.533 INFO:teuthology.orchestra.run.smithi012.stdout:4245 trunc from 0x7cbe6a0 to 0x2a788a6 2024-09-11T05:22:46.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:46.551 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:46.555 INFO:teuthology.orchestra.run.smithi012.stdout:4248 clone 35 order 20 su 4096 sc 2 2024-09-11T05:22:46.569 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:46.569 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:46.569 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T05:22:46.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:46.574+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:46.586 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:46.586 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:46.603 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:46.604 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:46.620 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:46.620 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:46.637 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:46.637 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:46.653 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:46.654 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:46.657 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:22:46.657 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:22:46.675 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:46.675+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:46.680 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:46.681 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:46.689 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:46.776 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:46.776+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:46.833 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:46.833 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:46.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:46.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:46.877+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:46.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:46.978+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:46.985 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:46.985 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:46.993 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:47.080 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:47.080+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:47.097 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:47.097 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:47.106 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:47.189 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:47.189+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:47.249 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:47.250 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:47.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:47.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:47.302+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:47.371 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:47.371 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:47.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:47.384 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:47.384+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:47.465 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:22:47.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:47.484+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:47.537 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:47.537 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:47.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:47.577 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-11T05:22:47.620 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:47.619+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:47.687 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:47.687+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:47.693 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:47.693 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:47.703 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:47.723 INFO:teuthology.orchestra.run.smithi012.stdout:4249 read 0x21552b8 thru 0x215fc34 (0xa97d bytes) 2024-09-11T05:22:47.724 INFO:teuthology.orchestra.run.smithi012.stdout:4250 write 0x22fea30 thru 0x22fff56 (0x1527 bytes) 2024-09-11T05:22:47.732 INFO:teuthology.orchestra.run.smithi012.stdout:4252 clone 36 order 18 su 1024 sc 8 2024-09-11T05:22:47.788 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:47.787+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:47.831 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:47.831 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:47.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:47.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:47.923+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:47.987 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:47.987 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:47.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:47.989+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:47.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:48.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:48.090+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:48.143 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:48.143 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:48.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:48.192 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:48.191+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:48.293 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:48.293+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:48.300 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:48.300 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:48.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:48.394 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:48.393+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:48.415 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:48.415 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:48.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:48.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:48.494+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:48.539 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:48.539 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:48.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:48.596 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:48.596+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:48.657 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:48.657 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:48.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:48.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:48.706 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:48.706+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:48.747 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone35 from 0x2a788a6 (overlap 0x2a788a6) to 0x153c453 2024-09-11T05:22:48.798 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:48.798 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:48.798+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:48.820 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:48.820 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:48.820 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T05:22:48.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:48.837 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-11T05:22:48.841 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:48.841 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:48.861 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:48.878 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:48.889 INFO:teuthology.orchestra.run.smithi012.stdout:4253 punch from 0x9fd0a8 to 0xa0227e, (0x51d6 bytes) 2024-09-11T05:22:48.893 INFO:teuthology.orchestra.run.smithi012.stdout:4254 punch from 0x123d8d5 to 0x124c48f, (0xebba bytes) 2024-09-11T05:22:48.893 INFO:teuthology.orchestra.run.smithi012.stdout:4255 punch from 0x1a0b950 to 0x1a0bd79, (0x429 bytes) 2024-09-11T05:22:48.895 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:48.896 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:48.903 INFO:teuthology.orchestra.run.smithi012.stdout:4260 writesame 0x73c5e93 thru 0x73c6c2c data_size 0x1(0xd9a bytes) 2024-09-11T05:22:48.904 INFO:teuthology.orchestra.run.smithi012.stdout:4261 write 0x12db59d thru 0x12e65c7 (0xb02b bytes) 2024-09-11T05:22:48.913 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:48.913+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:48.920 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:48.924 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:22:48.924 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:22:48.965 INFO:teuthology.orchestra.run.smithi012.stdout:4264 write 0x6ec56a7 thru 0x6ed53a5 (0xfcff bytes) 2024-09-11T05:22:48.975 INFO:teuthology.orchestra.run.smithi012.stdout:4265 clone 37 order 19 su 4096 sc 3 2024-09-11T05:22:48.982 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:48.982 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:48.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.347747460000001, 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:48.983 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:48.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:48.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:48.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:48.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:48.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:48.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:48.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.345605939000002, 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:48.989 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:48.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:48.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:48.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.345584375000001, 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:48.994 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:48.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:48.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:48.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.345570363999997, 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:48.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:49.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:49.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343745063, 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.004 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343730460000003, 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.009 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:49.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.013 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.014 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.014 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343713155000003, 2024-09-11T05:22:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.015 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:49.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.019 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.020 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.020 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:49.020 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343689046000001, 2024-09-11T05:22:49.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:49.021 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.021 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.021 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:49.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:49.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:49.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343660970000002, 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:49.027 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:49.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:49.032 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343633978, 2024-09-11T05:22:49.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:49.033 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.033 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.033 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.033 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.035 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:49.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:49.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:49.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:49.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:49.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:49.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:49.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:49.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:49.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:49.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:49.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:49.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:49.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:49.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:49.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:49.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:49.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.043 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.044 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.044 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:49.044 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343593419000001, 2024-09-11T05:22:49.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:49.045 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.045 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.045 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.046 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:49.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:49.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:49.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:49.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:49.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:49.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:49.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:49.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:49.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:49.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:49.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:49.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:49.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:49.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:49.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:49.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:49.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.054 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.055 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.055 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:49.055 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.343570032000002, 2024-09-11T05:22:49.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:49.056 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.056 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.056 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.056 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.056 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.057 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:49.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:49.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:49.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:49.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:49.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:49.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:49.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:49.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:49.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:49.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:49.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:49.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:49.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:49.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:49.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:49.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:49.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.065 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.065 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.065 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.065 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:49.065 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.247584924999998, 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:49.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:49.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.247565365, 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.070 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:49.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.247546149999998, 2024-09-11T05:22:49.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:49.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:49.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:49.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.247525349999997, 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.079 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:49.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.363424835, 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:22:49.084 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:49.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:22:49.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:22:49.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.360435027000001, 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.092 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:22:49.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:22:49.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:22:49.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:22:49.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.895838134999998, 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:22:49.100 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:22:49.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:22:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:22:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:22:49.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.361254247000002, 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:22:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:49.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:49.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:49.115 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:49.115 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:49.114+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:49.215 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:49.215+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:49.260 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:49.260 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:49.260 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:49.260 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:49.268 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:49.353 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:49.353+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:49.413 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:49.413 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:49.413 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:49.413 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:49.413 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:49.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:49.416+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:49.421 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:49.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:22:49.518 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:49.517+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:49.566 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone36 from 0x73c6c2d (overlap 0x2a788a6) to 0x10fd042 2024-09-11T05:22:49.574 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:49.574 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:49.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:49.574 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:49.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.574 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.976589390000001, 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:49.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.976361894, 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.579 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:49.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:49.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.976107079999998, 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.584 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.975738184999997, 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.588 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.975576639000003, 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.593 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:49.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.597 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.975133904000003, 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:49.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.972987011000001, 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.606 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.970956459, 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:49.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.970936074000001, 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:49.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.753752269000003, 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:49.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:49.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.753731244999997, 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:49.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:49.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.753706989999998, 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:49.624 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:49.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.752027906000002, 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.629 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:49.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:49.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.75200856, 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.634 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:49.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.751987788000001, 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.638 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.751968378000001, 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.642 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:49.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.646 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.751947909000002, 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.751929019000002, 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.655 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.742591226000002, 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.656 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:49.660 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.742580400000001, 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:49.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:49.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:49.665 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:49.665 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:49.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:49.666 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:49.666+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:49.767 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:49.767+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:49.813 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:49.813 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:49.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:49.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:49.868+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:49.969 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:49.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:49.968+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:49.978 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:50.058 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6] out_osds: [7, 4] dead_osds: [2] live_osds: [0, 1, 3, 4, 5, 6, 7] 2024-09-11T05:22:50.058 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:22:50.058 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-11T05:22:50.059 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T05:22:50.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T05:22:50.061 INFO:tasks.ceph.osd.2:Started 2024-09-11T05:22:50.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46512525599999999, 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.099 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.100 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.100 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.100 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:22:50.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.100 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46511539000000002, 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.104 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:22:50.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46509097399999999, 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.109 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:22:50.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:22:50.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:22:50.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:22:50.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46507968599999999, 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.114 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:22:50.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:22:50.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:22:50.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:22:50.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46507016699999998, 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.119 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:22:50.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:22:50.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46506080900000002, 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:22:50.124 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:22:50.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.465046927, 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.129 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:22:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:22:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:22:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:22:50.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:22:50.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:22:50.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.136 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.136 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.137 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:50.137 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46503736000000001, 2024-09-11T05:22:50.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:22:50.138 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.138 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:22:50.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46502153000000002, 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:22:50.142 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.146 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46499577199999997, 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:22:50.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:22:50.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46496711499999999, 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.155 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46494228199999998, 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.156 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46492473000000001, 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.160 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:22:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:22:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46491475999999998, 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:22:50.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46490457200000002, 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:22:50.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:22:50.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:22:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:22:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46489523300000002, 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:22:50.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.178 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46488607300000001, 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.179 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:22:50.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46487487900000002, 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.184 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:22:50.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:22:50.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.46485093799999999, 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:22:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:50.193 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.464839322, 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.194 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.198 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:50.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:50.105+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:50.201 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:50.201 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:no valid command found; 10 closest matches: 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:0 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:1 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:abort 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:assert 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:config diff 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:config diff get 2024-09-11T05:22:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:config get 2024-09-11T05:22:50.203 INFO:teuthology.orchestra.run.smithi012.stderr:config help [] 2024-09-11T05:22:50.203 INFO:teuthology.orchestra.run.smithi012.stderr:config set ... 2024-09-11T05:22:50.203 INFO:teuthology.orchestra.run.smithi012.stderr:admin_socket: invalid command 2024-09-11T05:22:50.203 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-11T05:22:50.203 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-11T05:22:50.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:50.199+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:50.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:50.300+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:50.304 INFO:teuthology.orchestra.run.smithi012.stdout:4266 writesame 0xb02343c thru 0xb023f62 data_size 0x1(0xb27 bytes) 2024-09-11T05:22:50.305 INFO:teuthology.orchestra.run.smithi012.stdout:4267 clone 38 order 20 su 65536 sc 14 2024-09-11T05:22:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:50.309 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:50.310 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:50.310 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:50.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:50.402 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:50.401+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:50.422 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:50.422 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:50.422 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:50.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:50.503 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:22:50.503 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:50.502+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:50.575 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone37 from 0xb023f63 (overlap 0x73c6c2d) to 0x5c9f024 2024-09-11T05:22:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:50.581 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 81.829954213999997, 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:50.582 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:50.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:50.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:50.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826875651999998, 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.589 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826858352000002, 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.593 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:50.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:50.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826832316999997, 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.598 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:50.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826816090999998, 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.603 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:50.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826793635000001, 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.607 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:50.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:50.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.611 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.612 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.612 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:50.612 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826759555999999, 2024-09-11T05:22:50.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:50.612 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:50.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826721935000002, 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.617 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:50.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826157094999999, 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.622 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:50.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:50.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.826107997000001, 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:50.626 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:50.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.541452919000001, 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:50.631 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:50.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:50.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.541433300999998, 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.636 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:50.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.538843247000003, 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:50.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:50.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.538413104999997, 2024-09-11T05:22:50.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:50.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.538378684999998, 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:50.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:50.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 56.487288370999998, 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.416836754000002, 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.659 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:50.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63898 3.11 3:89620d31:::rbd_data.117960679f52.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.459766823000002, 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709826999999999, 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63898 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.664 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120804+0000", 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120808+0000", 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120817+0000", 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120821+0000", 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120858+0000", 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6863999999999998e-05 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120951+0000", 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2541999999999996e-05 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.124305+0000", 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00335389 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140413+0000", 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016108245 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140444+0000", 2024-09-11T05:22:50.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1578000000000002e-05 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140482+0000", 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140513+0000", 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1477999999999999e-05 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:70954 3.14 e57/22 3:2fcfd35d:::rbd_data.1179db619f31.0000000000000009:head v 57'288, mlcod=56'286)", 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.615001602, 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023605603999999999, 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:50.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965570+0000", 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7630000000000001e-06 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971434+0000", 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058634300000000002 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971457+0000", 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3436999999999999e-05 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971471+0000", 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3776e-05 2024-09-11T05:22:50.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971538+0000", 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7074000000000002e-05 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971565+0000", 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6914e-05 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989115+0000", 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017549754000000001 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989174+0000", 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9456000000000001e-05 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.674 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71938 3.f 3:f110c0b8:::rbd_data.1179db619f31.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.080823150000001, 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027012653000000001, 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71938 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499748+0000", 2024-09-11T05:22:50.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499752+0000", 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499762+0000", 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7610000000000002e-06 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499767+0000", 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.118e-06 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499813+0000", 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6168999999999998e-05 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499871+0000", 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8394999999999999e-05 2024-09-11T05:22:50.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.503877+0000", 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040059290000000001 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526608+0000", 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022730899999999998 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526628+0000", 2024-09-11T05:22:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9556e-05 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526686+0000", 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7839e-05 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526760+0000", 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4146000000000005e-05 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.680 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:50.681 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:50.681 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:50.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:50.683 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:50.681+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:50.783 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:50.782+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:50.804 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:50.804 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:50.804 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:50.804 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:50.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:50.837 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-11T05:22:50.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:50.883+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:50.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:50.980 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:50.980 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:50.980 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:50.980 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:50.980 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:50.985 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:50.984+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:50.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:51.006 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:51.005+0000 7fd41e0d6640 -1 Falling back to public interface 2024-09-11T05:22:51.086 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:51.085+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:51.107 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:51.107 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:51.109 INFO:teuthology.orchestra.run.smithi012.stdout:4268 write 0x25361dc thru 0x253871c (0x2541 bytes) 2024-09-11T05:22:51.134 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:51.134 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:51.134 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.135 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T05:22:51.137 INFO:teuthology.orchestra.run.smithi012.stdout:4270 trunc from 0xb023f63 to 0xdf093a4 2024-09-11T05:22:51.143 INFO:teuthology.orchestra.run.smithi012.stdout:4274 punch from 0x512d1eb to 0x5133b17, (0x692c bytes) 2024-09-11T05:22:51.143 INFO:teuthology.orchestra.run.smithi012.stdout:4275 punch from 0xbd875d to 0xbe725f, (0xeb02 bytes) 2024-09-11T05:22:51.149 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:51.149 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:51.152 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:51.158 INFO:teuthology.orchestra.run.smithi012.stdout:4276 trunc from 0xdf093a4 to 0x3c1f0a 2024-09-11T05:22:51.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:51.171 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:51.187 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:51.186+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:51.194 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:51.224 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:51.224 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:51.258 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:51.265 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:22:51.266 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:22:51.288 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:51.288+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:51.330 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:51.330 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:51.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:51.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:51.388+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:51.414 INFO:teuthology.orchestra.run.smithi012.stdout:4277 write 0x377cd60 thru 0x378088b (0x3b2c bytes) 2024-09-11T05:22:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:4279 trunc from 0x378088c to 0x8a84ee 2024-09-11T05:22:51.434 INFO:teuthology.orchestra.run.smithi012.stdout:4280 punch from 0x4647ce to 0x46e244, (0x9a76 bytes) 2024-09-11T05:22:51.445 INFO:teuthology.orchestra.run.smithi012.stdout:4281 writesame 0x6bf3558 thru 0x6bf366a data_size 0x5(0x113 bytes) 2024-09-11T05:22:51.456 INFO:teuthology.orchestra.run.smithi012.stdout:4283 writesame 0xb19507e thru 0xb199bf0 data_size 0x1(0x4b73 bytes) 2024-09-11T05:22:51.456 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.456 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.458 INFO:teuthology.orchestra.run.smithi012.stdout:4287 trunc from 0xb199bf1 to 0x8d1eeea 2024-09-11T05:22:51.467 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:51.468 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:51.471 INFO:teuthology.orchestra.run.smithi012.stdout:4288 write 0xae04621 thru 0xae0636a (0x1d4a bytes) 2024-09-11T05:22:51.473 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:4291 read 0x39cb198 thru 0x39d767d (0xc4e6 bytes) 2024-09-11T05:22:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:4293 write 0x13f1b7d thru 0x13f1ea1 (0x325 bytes) 2024-09-11T05:22:51.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:51.478 INFO:teuthology.orchestra.run.smithi012.stdout:4295 trunc from 0xae0636b to 0x99288a4 2024-09-11T05:22:51.487 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.488 INFO:teuthology.orchestra.run.smithi012.stdout:4297 read 0x4f996ce thru 0x4fa4018 (0xa94b bytes) 2024-09-11T05:22:51.488 INFO:teuthology.orchestra.run.smithi012.stdout:4298 read 0x45e2390 thru 0x45e5c28 (0x3899 bytes) 2024-09-11T05:22:51.488 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.488 INFO:teuthology.orchestra.run.smithi012.stdout:4300 write 0x1a8afa6 thru 0x1a9110b (0x6166 bytes) 2024-09-11T05:22:51.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:51.489+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:51.491 INFO:teuthology.orchestra.run.smithi012.stdout:4303 read 0x48ca1b9 thru 0x48cb394 (0x11dc bytes) 2024-09-11T05:22:51.492 INFO:teuthology.orchestra.run.smithi012.stdout:4304 read 0x2a7bed9 thru 0x2a88302 (0xc42a bytes) 2024-09-11T05:22:51.492 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.492 INFO:teuthology.orchestra.run.smithi012.stdout:4307 read 0x3c6b219 thru 0x3c76f39 (0xbd21 bytes) 2024-09-11T05:22:51.492 INFO:teuthology.orchestra.run.smithi012.stdout:4308 write 0x20dddeb thru 0x20e57ce (0x79e4 bytes) 2024-09-11T05:22:51.504 INFO:teuthology.orchestra.run.smithi012.stdout:4309 trunc from 0x99288a4 to 0x19eee43 2024-09-11T05:22:51.515 INFO:teuthology.orchestra.run.smithi012.stdout:4312 read 0x1270dce thru 0x1275051 (0x4284 bytes) 2024-09-11T05:22:51.529 INFO:teuthology.orchestra.run.smithi012.stdout:4313 trunc from 0x19eee43 to 0xe4e80fc 2024-09-11T05:22:51.535 INFO:teuthology.orchestra.run.smithi012.stdout:4314 read 0x8162075 thru 0x8171bdc (0xfb68 bytes) 2024-09-11T05:22:51.536 INFO:teuthology.orchestra.run.smithi012.stdout:4315 read 0xd0b8421 thru 0xd0bb233 (0x2e13 bytes) 2024-09-11T05:22:51.536 INFO:teuthology.orchestra.run.smithi012.stdout:4316 write 0x8a0b6e2 thru 0x8a179ff (0xc31e bytes) 2024-09-11T05:22:51.540 INFO:teuthology.orchestra.run.smithi012.stdout:4319 trunc from 0xe4e80fc to 0xc0c5f21 2024-09-11T05:22:51.546 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.546 INFO:teuthology.orchestra.run.smithi012.stdout:4322 write 0x9a2f0f8 thru 0x9a33702 (0x460b bytes) 2024-09-11T05:22:51.549 INFO:teuthology.orchestra.run.smithi012.stdout:4323 write 0x50c965a thru 0x50d3d87 (0xa72e bytes) 2024-09-11T05:22:51.553 INFO:teuthology.orchestra.run.smithi012.stdout:4324 write 0x3a0936 thru 0x3aba59 (0xb124 bytes) 2024-09-11T05:22:51.554 INFO:teuthology.orchestra.run.smithi012.stdout:4326 read 0x93d7337 thru 0x93e48aa (0xd574 bytes) 2024-09-11T05:22:51.565 INFO:teuthology.orchestra.run.smithi012.stdout:4327 trunc from 0xc0c5f21 to 0x2db3d1d 2024-09-11T05:22:51.590 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:51.590+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:51.594 INFO:teuthology.orchestra.run.smithi012.stdout:4328 write 0xdfd3274 thru 0xdfdabe4 (0x7971 bytes) 2024-09-11T05:22:51.597 INFO:teuthology.orchestra.run.smithi012.stdout:4330 read 0xdcdc43e thru 0xdce9c4d (0xd810 bytes) 2024-09-11T05:22:51.597 INFO:teuthology.orchestra.run.smithi012.stdout:4331 writesame 0x7cb04bc thru 0x7cb94b6 data_size 0x1f(0x8ffb bytes) 2024-09-11T05:22:51.600 INFO:teuthology.orchestra.run.smithi012.stdout:4332 writesame 0xab9a892 thru 0xaba3ac7 data_size 0x5f(0x9236 bytes) 2024-09-11T05:22:51.603 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:51.604 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:51.604 INFO:teuthology.orchestra.run.smithi012.stdout:4334 writesame 0x18ffeee thru 0x190c47a data_size 0x1(0xc58d bytes) 2024-09-11T05:22:51.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:51.632 INFO:teuthology.orchestra.run.smithi012.stdout:4336 punch from 0x88b5a5f to 0x88c51a5, (0xf746 bytes) 2024-09-11T05:22:51.632 INFO:teuthology.orchestra.run.smithi012.stdout:4339 punch from 0xa395cd6 to 0xa39f049, (0x9373 bytes) 2024-09-11T05:22:51.640 INFO:teuthology.orchestra.run.smithi012.stdout:4341 trunc from 0xdfdabe5 to 0x5eceace 2024-09-11T05:22:51.650 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.661 INFO:teuthology.orchestra.run.smithi012.stdout:4344 write 0x9922959 thru 0x9930bb2 (0xe25a bytes) 2024-09-11T05:22:51.674 INFO:teuthology.orchestra.run.smithi012.stdout:4345 writesame 0xcec897d thru 0xceccadd data_size 0x7(0x4161 bytes) 2024-09-11T05:22:51.674 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.674 INFO:teuthology.orchestra.run.smithi012.stdout:4347 read 0x313e86d thru 0x313f9c9 (0x115d bytes) 2024-09-11T05:22:51.674 INFO:teuthology.orchestra.run.smithi012.stdout:4348 write 0xa26aaa3 thru 0xa279796 (0xecf4 bytes) 2024-09-11T05:22:51.678 INFO:teuthology.orchestra.run.smithi012.stdout:4349 write 0x40bbb0a thru 0x40cb4a5 (0xf99c bytes) 2024-09-11T05:22:51.681 INFO:teuthology.orchestra.run.smithi012.stdout:4350 read 0x1eada03 thru 0x1eb1601 (0x3bff bytes) 2024-09-11T05:22:51.681 INFO:teuthology.orchestra.run.smithi012.stdout:4352 read 0x61f8676 thru 0x61fcc83 (0x460e bytes) 2024-09-11T05:22:51.682 INFO:teuthology.orchestra.run.smithi012.stdout:4353 read 0x55bea8a thru 0x55ce91c (0xfe93 bytes) 2024-09-11T05:22:51.682 INFO:teuthology.orchestra.run.smithi012.stdout:4354 write 0x32eef06 thru 0x32f18d2 (0x29cd bytes) 2024-09-11T05:22:51.685 INFO:teuthology.orchestra.run.smithi012.stdout:4355 punch from 0x677a7e5 to 0x678491d, (0xa138 bytes) 2024-09-11T05:22:51.685 INFO:teuthology.orchestra.run.smithi012.stdout:4356 read 0x62b915d thru 0x62be823 (0x56c7 bytes) 2024-09-11T05:22:51.685 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.685 INFO:teuthology.orchestra.run.smithi012.stdout:4359 punch from 0x75a0ce0 to 0x75a9aae, (0x8dce bytes) 2024-09-11T05:22:51.685 INFO:teuthology.orchestra.run.smithi012.stdout:4360 write 0x8776e60 thru 0x87813d1 (0xa572 bytes) 2024-09-11T05:22:51.688 INFO:teuthology.orchestra.run.smithi012.stdout:4363 writesame 0xae695d7 thru 0xae76b40 data_size 0x2(0xd56a bytes) 2024-09-11T05:22:51.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:51.690+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:51.700 INFO:teuthology.orchestra.run.smithi012.stdout:4365 read 0xce86aaa thru 0xce88141 (0x1698 bytes) 2024-09-11T05:22:51.700 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:51.700 INFO:teuthology.orchestra.run.smithi012.stdout:4367 writesame 0x3af9806 thru 0x3b02454 data_size 0x27(0x8c4f bytes) 2024-09-11T05:22:51.708 INFO:teuthology.orchestra.run.smithi012.stdout:4368 trunc from 0xceccade to 0x902a701 2024-09-11T05:22:51.719 INFO:teuthology.orchestra.run.smithi012.stdout:4369 write 0x53e01f0 thru 0x53e22e9 (0x20fa bytes) 2024-09-11T05:22:51.729 INFO:teuthology.orchestra.run.smithi012.stdout:4370 trunc from 0x902a701 to 0x4db52f6 2024-09-11T05:22:51.742 INFO:teuthology.orchestra.run.smithi012.stdout:4372 read 0x29a7172 thru 0x29a8c19 (0x1aa8 bytes) 2024-09-11T05:22:51.742 INFO:teuthology.orchestra.run.smithi012.stdout:4373 punch from 0x27af763 to 0x27b9eae, (0xa74b bytes) 2024-09-11T05:22:51.743 INFO:teuthology.orchestra.run.smithi012.stdout:4374 punch from 0x1562592 to 0x1565acd, (0x353b bytes) 2024-09-11T05:22:51.752 INFO:teuthology.orchestra.run.smithi012.stdout:4375 writesame 0x7b1b147 thru 0x7b1fa02 data_size 0x13(0x48bc bytes) 2024-09-11T05:22:51.757 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:51.757 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:51.759 INFO:teuthology.orchestra.run.smithi012.stdout:4376 trunc from 0x7b1fa03 to 0x1a572e3 2024-09-11T05:22:51.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:51.771 INFO:teuthology.orchestra.run.smithi012.stdout:4377 punch from 0x5dc243 to 0x5e0da1, (0x4b5e bytes) 2024-09-11T05:22:51.771 INFO:teuthology.orchestra.run.smithi012.stdout:4378 read 0x17d207e thru 0x17dd0db (0xb05e bytes) 2024-09-11T05:22:51.771 INFO:teuthology.orchestra.run.smithi012.stdout:4380 write 0x72b1d1 thru 0x731baa (0x69da bytes) 2024-09-11T05:22:51.773 INFO:teuthology.orchestra.run.smithi012.stdout:4381 write 0x14c17e3 thru 0x14caa2a (0x9248 bytes) 2024-09-11T05:22:51.775 INFO:teuthology.orchestra.run.smithi012.stdout:4383 clone 39 order 20 su 262144 sc 9 2024-09-11T05:22:51.793 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:51.792+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:51.878 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:51.878 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:51.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:51.928 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:51.927+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:51.994 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:51.993+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:52.034 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:52.034 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:52.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:52.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:52.094+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:52.149 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:52.149 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:52.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:52.201 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:52.201+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:52.260 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:52.260 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:52.268 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:52.310 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:52.309+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:52.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:52.397+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:52.413 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:52.414 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:52.423 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:52.499 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:52.499+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:52.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:22:52.531 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:52.531 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:52.542 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:52.600 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone38 from 0x1a572e3 (overlap 0x3c1f0a) to 0x1e0f85 2024-09-11T05:22:52.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:52.599+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:52.690 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:52.690 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:52.699 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:52.701 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:52.700+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:52.715 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-11T05:22:52.801 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:52.801+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:52.835 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:52.835 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:52.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:52.930 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:52.930+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:53.001 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:53.001 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:53.003 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:53.003+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:53.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:53.104 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:53.103+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:53.183 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:53.184 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:53.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:53.239 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:53.239+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:53.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:53.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:53.310+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:53.337 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:53.337 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:53.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:53.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:53.405+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:53.438 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:53.438 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:53.470 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:53.470 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:53.470 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T05:22:53.491 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:53.491 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:53.492 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:53.492 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:53.500 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:53.509 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:53.510 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:53.520 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:22:53.529 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:53.544 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:53.544+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:53.546 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:53.564 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:53.565 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:53.568 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:22:53.568 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:22:53.606 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:53.606 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:53.606 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:53.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:53.609+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:53.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:53.625 INFO:teuthology.orchestra.run.smithi012.stdout:4384 read 0x14cdf2a thru 0x14dad0c (0xcde3 bytes) 2024-09-11T05:22:53.637 INFO:teuthology.orchestra.run.smithi012.stdout:4385 write 0x253fe83 thru 0x2542f17 (0x3095 bytes) 2024-09-11T05:22:53.641 INFO:teuthology.orchestra.run.smithi012.stdout:4386 read 0x9b84fb thru 0x9c1e0e (0x9914 bytes) 2024-09-11T05:22:53.655 INFO:teuthology.orchestra.run.smithi012.stdout:4389 trunc from 0x2542f18 to 0xcb92e31 2024-09-11T05:22:53.660 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.660 INFO:teuthology.orchestra.run.smithi012.stdout:4391 read 0x339bd79 thru 0x33a9605 (0xd88d bytes) 2024-09-11T05:22:53.660 INFO:teuthology.orchestra.run.smithi012.stdout:4392 read 0xbb3ae6e thru 0xbb413ed (0x6580 bytes) 2024-09-11T05:22:53.668 INFO:teuthology.orchestra.run.smithi012.stdout:4393 trunc from 0xcb92e31 to 0x5ba4306 2024-09-11T05:22:53.674 INFO:teuthology.orchestra.run.smithi012.stdout:4394 punch from 0x1d22b02 to 0x1d28a33, (0x5f31 bytes) 2024-09-11T05:22:53.674 INFO:teuthology.orchestra.run.smithi012.stdout:4396 writesame 0x496e3c5 thru 0x497cd03 data_size 0x1d(0xe93f bytes) 2024-09-11T05:22:53.691 INFO:teuthology.orchestra.run.smithi012.stdout:4397 writesame 0xbd37d45 thru 0xbd41c57 data_size 0x1(0x9f13 bytes) 2024-09-11T05:22:53.692 INFO:teuthology.orchestra.run.smithi012.stdout:4398 punch from 0x1fb7dfa to 0x1fc3b90, (0xbd96 bytes) 2024-09-11T05:22:53.692 INFO:teuthology.orchestra.run.smithi012.stdout:4399 flatten 2024-09-11T05:22:53.709 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:53.707+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:53.729 INFO:teuthology.orchestra.run.smithi012.stdout:4400 read 0x69e5ae9 thru 0x69e75fa (0x1b12 bytes) 2024-09-11T05:22:53.729 INFO:teuthology.orchestra.run.smithi012.stdout:4401 punch from 0xb60cc18 to 0xb6122f8, (0x56e0 bytes) 2024-09-11T05:22:53.729 INFO:teuthology.orchestra.run.smithi012.stdout:4403 write 0x6a20e15 thru 0x6a26db7 (0x5fa3 bytes) 2024-09-11T05:22:53.731 INFO:teuthology.orchestra.run.smithi012.stdout:4405 write 0xb164930 thru 0xb170b73 (0xc244 bytes) 2024-09-11T05:22:53.734 INFO:teuthology.orchestra.run.smithi012.stdout:4406 read 0x47c332c thru 0x47ca083 (0x6d58 bytes) 2024-09-11T05:22:53.734 INFO:teuthology.orchestra.run.smithi012.stdout:4408 punch from 0x9177f67 to 0x9183a7e, (0xbb17 bytes) 2024-09-11T05:22:53.734 INFO:teuthology.orchestra.run.smithi012.stdout:4410 punch from 0x8ade845 to 0x8ae06bb, (0x1e76 bytes) 2024-09-11T05:22:53.734 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.735 INFO:teuthology.orchestra.run.smithi012.stdout:4412 read 0x514d3bb thru 0x515c9c6 (0xf60c bytes) 2024-09-11T05:22:53.735 INFO:teuthology.orchestra.run.smithi012.stdout:4413 write 0x696adac thru 0x69777bb (0xca10 bytes) 2024-09-11T05:22:53.738 INFO:teuthology.orchestra.run.smithi012.stdout:4414 trunc from 0xbd41c58 to 0xcfd9ff9 2024-09-11T05:22:53.744 INFO:teuthology.orchestra.run.smithi012.stdout:4415 read 0x75db066 thru 0x75e5803 (0xa79e bytes) 2024-09-11T05:22:53.744 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.744 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.744 INFO:teuthology.orchestra.run.smithi012.stdout:4419 read 0x40f3752 thru 0x4102ba1 (0xf450 bytes) 2024-09-11T05:22:53.744 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.744 INFO:teuthology.orchestra.run.smithi012.stdout:4422 write 0x22d5db1 thru 0x22dccbd (0x6f0d bytes) 2024-09-11T05:22:53.747 INFO:teuthology.orchestra.run.smithi012.stdout:4423 trunc from 0xcfd9ff9 to 0xdc34010 2024-09-11T05:22:53.753 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.753 INFO:teuthology.orchestra.run.smithi012.stdout:4426 write 0xc64ed23 thru 0xc655b1c (0x6dfa bytes) 2024-09-11T05:22:53.756 INFO:teuthology.orchestra.run.smithi012.stdout:4430 write 0x4dfad26 thru 0x4e046fc (0x99d7 bytes) 2024-09-11T05:22:53.760 INFO:teuthology.orchestra.run.smithi012.stdout:4431 write 0x5263bfd thru 0x52664eb (0x28ef bytes) 2024-09-11T05:22:53.762 INFO:teuthology.orchestra.run.smithi012.stdout:4432 write 0x68bfd74 thru 0x68cfb01 (0xfd8e bytes) 2024-09-11T05:22:53.765 INFO:teuthology.orchestra.run.smithi012.stdout:4434 write 0x9ee6775 thru 0x9ef5f2b (0xf7b7 bytes) 2024-09-11T05:22:53.768 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:53.768 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:53.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.016583679999997, 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.769 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:22:53.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:22:53.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:22:53.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:22:53.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.013505117999998, 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.778 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:22:53.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.013487818000002, 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.783 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.787 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.013461782999997, 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:22:53.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:22:53.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.013445556999997, 2024-09-11T05:22:53.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:22:53.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:22:53.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.013423101000001, 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:22:53.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:22:53.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.013389021999998, 2024-09-11T05:22:53.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:22:53.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.013351401000001, 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:22:53.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:22:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.012786560999999, 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:22:53.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.012737463000001, 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:22:53.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.821 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.728082385, 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.822 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:22:53.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:22:53.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:53.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.728062766999997, 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.725472713000002, 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.831 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:22:53.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.725042571000003, 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.836 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:22:53.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.725008150999997, 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:22:53.840 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:53.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:22:53.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.673917836999998, 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:22:53.845 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:22:53.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:22:53.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.603466220000001, 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63898 3.11 3:89620d31:::rbd_data.117960679f52.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.646396289000002, 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709826999999999, 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63898 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.855 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120804+0000", 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120808+0000", 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120817+0000", 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120821+0000", 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120858+0000", 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6863999999999998e-05 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120951+0000", 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2541999999999996e-05 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.124305+0000", 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00335389 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:53.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140413+0000", 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016108245 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140444+0000", 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1578000000000002e-05 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140482+0000", 2024-09-11T05:22:53.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140513+0000", 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1477999999999999e-05 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:70954 3.14 e57/22 3:2fcfd35d:::rbd_data.1179db619f31.0000000000000009:head v 57'288, mlcod=56'286)", 2024-09-11T05:22:53.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.801631067999999, 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023605603999999999, 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965570+0000", 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7630000000000001e-06 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971434+0000", 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058634300000000002 2024-09-11T05:22:53.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971457+0000", 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3436999999999999e-05 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971471+0000", 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3776e-05 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971538+0000", 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7074000000000002e-05 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971565+0000", 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6914e-05 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989115+0000", 2024-09-11T05:22:53.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017549754000000001 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989174+0000", 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9456000000000001e-05 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.866 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71938 3.f 3:f110c0b8:::rbd_data.1179db619f31.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.267452616, 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027012653000000001, 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71938 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499748+0000", 2024-09-11T05:22:53.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499752+0000", 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499762+0000", 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7610000000000002e-06 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:53.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499767+0000", 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.118e-06 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499813+0000", 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6168999999999998e-05 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499871+0000", 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8394999999999999e-05 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:22:53.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.503877+0000", 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040059290000000001 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526608+0000", 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022730899999999998 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526628+0000", 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9556e-05 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526686+0000", 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7839e-05 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526760+0000", 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4146000000000005e-05 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:53.875 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:53.873+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:53.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4435 write 0xa00b37e thru 0xa0154b8 (0xa13b bytes) 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4438 trunc from 0xdc34010 to 0x786d283 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4439 writesame 0xa105b99 thru 0xa1106d4 data_size 0x4e(0xab3c bytes) 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4440 read 0x7ac0835 thru 0x7ac0bd3 (0x39f bytes) 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4441 write 0x57e52e0 thru 0x57ec929 (0x764a bytes) 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4442 writesame 0x80ba7a8 thru 0x80bb0bc data_size 0x5(0x915 bytes) 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4443 write 0x4b7e732 thru 0x4b87e4c (0x971b bytes) 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4444 read 0x6ea00a9 thru 0x6ea5b4f (0x5aa7 bytes) 2024-09-11T05:22:53.877 INFO:teuthology.orchestra.run.smithi012.stdout:4446 punch from 0x4f9ecfd to 0x4faad42, (0xc045 bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4447 read 0x9a86da thru 0x9b5cc8 (0xd5ef bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4448 writesame 0xe21abc thru 0xe2ca37 data_size 0x16(0xaf7c bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4449 read 0x5bdf925 thru 0x5bee8df (0xefbb bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4452 write 0xb1e9c25 thru 0xb1f5853 (0xbc2f bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4453 read 0x6c4bda6 thru 0x6c5a13a (0xe395 bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4454 read 0x6e1e6e7 thru 0x6e2406b (0x5985 bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4455 trunc from 0xb1f5854 to 0x6a8b8b9 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4456 punch from 0x2ff7500 to 0x2ff951d, (0x201d bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4457 write 0xb576752 thru 0xb5787f6 (0x20a5 bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4463 read 0x1332902 thru 0x1337e3b (0x553a bytes) 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4466 trunc from 0xb5787f7 to 0x8b9fcaa 2024-09-11T05:22:53.878 INFO:teuthology.orchestra.run.smithi012.stdout:4467 read 0x64e5dda thru 0x64f5c2b (0xfe52 bytes) 2024-09-11T05:22:53.880 INFO:teuthology.orchestra.run.smithi012.stdout:4468 write 0x97a2dae thru 0x97a3bae (0xe01 bytes) 2024-09-11T05:22:53.883 INFO:teuthology.orchestra.run.smithi012.stdout:4470 read 0x73e8f5d thru 0x73ebd55 (0x2df9 bytes) 2024-09-11T05:22:53.883 INFO:teuthology.orchestra.run.smithi012.stdout:4471 read 0x3731f24 thru 0x37347cc (0x28a9 bytes) 2024-09-11T05:22:53.884 INFO:teuthology.orchestra.run.smithi012.stdout:4472 trunc from 0x97a3baf to 0x818b5a6 2024-09-11T05:22:53.896 INFO:teuthology.orchestra.run.smithi012.stdout:4473 write 0x59e83c2 thru 0x59f1507 (0x9146 bytes) 2024-09-11T05:22:53.911 INFO:teuthology.orchestra.run.smithi012.stdout:4474 write 0xd7dfbbf thru 0xd7ea2b1 (0xa6f3 bytes) 2024-09-11T05:22:53.914 INFO:teuthology.orchestra.run.smithi012.stdout:4475 punch from 0x4a3da23 to 0x4a45578, (0x7b55 bytes) 2024-09-11T05:22:53.915 INFO:teuthology.orchestra.run.smithi012.stdout:4476 write 0x4f91663 thru 0x4f9f641 (0xdfdf bytes) 2024-09-11T05:22:53.918 INFO:teuthology.orchestra.run.smithi012.stdout:4477 writesame 0x10898e8 thru 0x108cd2c data_size 0x1(0x3445 bytes) 2024-09-11T05:22:53.925 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:53.925 INFO:teuthology.orchestra.run.smithi012.stdout:4479 punch from 0x68cbce0 to 0x68db92f, (0xfc4f bytes) 2024-09-11T05:22:53.926 INFO:teuthology.orchestra.run.smithi012.stdout:4484 read 0xa0547fc thru 0xa063cb2 (0xf4b7 bytes) 2024-09-11T05:22:53.926 INFO:teuthology.orchestra.run.smithi012.stdout:4486 clone 40 order 19 su 8192 sc 3 2024-09-11T05:22:53.975 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:53.974+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:53.991 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:53.991 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:53.992 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:54.000 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:54.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:54.084+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:54.148 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:54.148 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:54.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:54.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:54.197+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:54.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:54.277+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87567 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 961536~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855423+0000", 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4590991449999997, 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053338561, 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87567 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855423+0000", 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855423+0000", 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855424+0000", 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.11e-07 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855425+0000", 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1400000000000001e-06 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855428+0000", 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9720000000000001e-06 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855430+0000", 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.503e-06 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908475+0000", 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053044306999999999 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908656+0000", 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000181509 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908762+0000", 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105919 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87568 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 965632~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4590894959999998, 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053522581999999999, 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87568 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855434+0000", 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.052e-06 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855437+0000", 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.847e-06 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855440+0000", 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6089999999999999e-06 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908792+0000", 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053352175000000002 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908883+0000", 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1005e-05 2024-09-11T05:22:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908956+0000", 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2582000000000004e-05 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87569 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 969728~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4590797030000004, 2024-09-11T05:22:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054409762, 2024-09-11T05:22:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87569 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855444+0000", 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0920000000000001e-06 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855447+0000", 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0460000000000001e-06 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855450+0000", 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4719999999999998e-06 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909576+0000", 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054126062000000003 2024-09-11T05:22:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909737+0000", 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016113600000000001 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909853+0000", 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000115753 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87570 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 973824~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4590699689999997, 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054576539, 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87570 2024-09-11T05:22:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855454+0000", 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0690000000000001e-06 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855457+0000", 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8540000000000001e-06 2024-09-11T05:22:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855459+0000", 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5840000000000002e-06 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909924+0000", 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054464789999999999 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909974+0000", 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9761e-05 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910029+0000", 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5274e-05 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87571 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 977920~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:22:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4590597230000002, 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054738976000000002, 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87571 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856482+0000", 2024-09-11T05:22:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010191530000000001 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856487+0000", 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4889999999999997e-06 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856497+0000", 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0922e-05 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856505+0000", 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9310000000000008e-06 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910066+0000", 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053560732999999999 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910138+0000", 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1897999999999995e-05 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910202+0000", 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3849999999999993e-05 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87572 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 982016~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4580050670000002, 2024-09-11T05:22:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053903670000000001, 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87572 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856520+0000", 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3700000000000002e-06 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856528+0000", 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5560000000000002e-06 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856535+0000", 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000002e-06 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910254+0000", 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053718984999999997 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910332+0000", 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8529000000000007e-05 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910421+0000", 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8881000000000005e-05 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87573 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 986112~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:22:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4579651409999999, 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054081785, 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87573 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856558+0000", 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2799999999999996e-07 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856560+0000", 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856569+0000", 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1650000000000006e-06 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856574+0000", 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.66e-06 2024-09-11T05:22:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910464+0000", 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053890170000000001 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910564+0000", 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9239000000000003e-05 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910639+0000", 2024-09-11T05:22:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5642000000000005e-05 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87574 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 990208~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4579402769999996, 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054248939000000003, 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87574 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856583+0000", 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856585+0000", 2024-09-11T05:22:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2979999999999999e-06 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856592+0000", 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8419999999999999e-06 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856598+0000", 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7679999999999997e-06 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910671+0000", 2024-09-11T05:22:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054073259999999998 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910762+0000", 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0661999999999994e-05 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910831+0000", 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9614000000000001e-05 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87575 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 994304~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4579177420000002, 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054432912, 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87575 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:22:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856608+0000", 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856614+0000", 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.754e-06 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856619+0000", 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8600000000000001e-06 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910864+0000", 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054244522000000003 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910966+0000", 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010207100000000001 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911038+0000", 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2026000000000005e-05 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87576 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 998400~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4578961809999997, 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054624032000000003, 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87576 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856627+0000", 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856633+0000", 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6309999999999997e-06 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856641+0000", 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3590000000000002e-06 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856646+0000", 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6450000000000002e-06 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911076+0000", 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054429098000000002 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911174+0000", 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8098999999999997e-05 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911250+0000", 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6779000000000005e-05 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87577 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1002496~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4578675419999998, 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054805804999999999, 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87577 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858484+0000", 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001829156 2024-09-11T05:22:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858489+0000", 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5430000000000004e-06 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858506+0000", 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7221999999999999e-05 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858513+0000", 2024-09-11T05:22:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1189999999999999e-06 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911306+0000", 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.052792736999999999 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911393+0000", 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6996000000000005e-05 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911461+0000", 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8032000000000002e-05 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87580 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1014784~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4559366770000004, 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053501471000000002, 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87580 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858588+0000", 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.041e-06 2024-09-11T05:22:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858594+0000", 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1419999999999998e-06 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858599+0000", 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911921+0000", 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053321674999999999 2024-09-11T05:22:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912006+0000", 2024-09-11T05:22:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5346000000000006e-05 2024-09-11T05:22:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912087+0000", 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0968000000000001e-05 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87581 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1018880~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4559164920000001, 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053676728999999999, 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87581 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858608+0000", 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:22:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858615+0000", 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858619+0000", 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6029999999999998e-06 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912116+0000", 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053497057000000001 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912202+0000", 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5968000000000001e-05 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912283+0000", 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0483999999999997e-05 2024-09-11T05:22:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87582 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1022976~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4558963970000001, 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053904077000000002, 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87582 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858627+0000", 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858629+0000", 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5170000000000002e-06 2024-09-11T05:22:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858637+0000", 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0949999999999996e-06 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858643+0000", 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4820000000000002e-06 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912312+0000", 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053669728999999999 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912426+0000", 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011409 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912530+0000", 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010378300000000001 2024-09-11T05:22:54.383 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87583 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1027072~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4558525329999998, 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054053339999999998, 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.384 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87583 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858671+0000", 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858673+0000", 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5129999999999999e-06 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858680+0000", 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.306e-06 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858686+0000", 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2619999999999998e-06 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912560+0000", 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053874440000000003 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912644+0000", 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4141999999999995e-05 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912723+0000", 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9129999999999996e-05 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87584 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1031168~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4558281040000001, 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054250643000000001, 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87584 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858695+0000", 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.15e-07 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858697+0000", 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7540000000000001e-06 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858701+0000", 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0419999999999996e-06 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858703+0000", 2024-09-11T05:22:54.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6769999999999999e-06 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912759+0000", 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054055976999999998 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912848+0000", 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8962999999999995e-05 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912945+0000", 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6815000000000001e-05 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87585 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1035264~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4558155939999997, 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054449115999999999, 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87585 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1799999999999999e-07 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858708+0000", 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.22e-06 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858711+0000", 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0259999999999999e-06 2024-09-11T05:22:54.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858714+0000", 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5040000000000001e-06 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912983+0000", 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054268782000000002 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913070+0000", 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7428000000000004e-05 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913156+0000", 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5938000000000003e-05 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87586 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1039360~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4558055740000002, 2024-09-11T05:22:54.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.055576961000000001, 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87586 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:22:54.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858718+0000", 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1459999999999999e-06 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858721+0000", 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.982e-06 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858724+0000", 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913571+0000", 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054847185 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914218+0000", 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064685000000000003 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914294+0000", 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6118000000000005e-05 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87587 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1043456~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4557956980000002, 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.055819203999999997, 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.402 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87587 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860496+0000", 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001768875 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860501+0000", 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860513+0000", 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1972e-05 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860520+0000", 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2830000000000004e-06 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914342+0000", 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053821890999999997 2024-09-11T05:22:54.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914440+0000", 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8579000000000006e-05 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914546+0000", 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105703 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87588 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1047552~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.4539710430000001, 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054198646000000003, 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87588 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.407 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860559+0000", 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.357e-06 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860568+0000", 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7020000000000007e-06 2024-09-11T05:22:54.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860574+0000", 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.28e-06 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914590+0000", 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054015781999999998 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914680+0000", 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0050999999999996e-05 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914750+0000", 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9887000000000004e-05 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.411 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:54.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:54.413 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:54.412+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:54.514 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:54.513+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:54.566 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:54.567 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:54.567 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:54.567 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:54.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:54.614 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:54.614+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:54.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:54.714+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:54.728 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:54.728 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:54.728 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:54.728 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:54.728 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:54.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:54.741 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-11T05:22:54.748 INFO:teuthology.orchestra.run.smithi012.stdout:4487 writesame 0xb0da6de thru 0xb0df298 data_size 0x1(0x4bbb bytes) 2024-09-11T05:22:54.767 INFO:teuthology.orchestra.run.smithi012.stdout:4488 write 0xc31d87a thru 0xc320239 (0x29c0 bytes) 2024-09-11T05:22:54.772 INFO:teuthology.orchestra.run.smithi012.stdout:4489 read 0xd3aa5af thru 0xd3ac309 (0x1d5b bytes) 2024-09-11T05:22:54.772 INFO:teuthology.orchestra.run.smithi012.stdout:4491 write 0xcd8e259 thru 0xcd916a6 (0x344e bytes) 2024-09-11T05:22:54.777 INFO:teuthology.orchestra.run.smithi012.stdout:4494 punch from 0xa5502ab to 0xa55e2a2, (0xdff7 bytes) 2024-09-11T05:22:54.777 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:54.782 INFO:teuthology.orchestra.run.smithi012.stdout:4497 trunc from 0xd7ea2b2 to 0x8d97704 2024-09-11T05:22:54.797 INFO:teuthology.orchestra.run.smithi012.stdout:4498 punch from 0x8d46359 to 0x8d529cb, (0xc672 bytes) 2024-09-11T05:22:54.797 INFO:teuthology.orchestra.run.smithi012.stdout:4500 write 0x51d34bd thru 0x51d7a95 (0x45d9 bytes) 2024-09-11T05:22:54.807 INFO:teuthology.orchestra.run.smithi012.stdout:4502 punch from 0x8c987e1 to 0x8ca038d, (0x7bac bytes) 2024-09-11T05:22:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:4503 trunc from 0x8d97704 to 0x56fe767 2024-09-11T05:22:54.816 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:54.816+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:54.829 INFO:teuthology.orchestra.run.smithi012.stdout:4504 read 0x54e3036 thru 0x54f0ef7 (0xdec2 bytes) 2024-09-11T05:22:54.842 INFO:teuthology.orchestra.run.smithi012.stdout:4507 writesame 0xabb0016 thru 0xabbe453 data_size 0x5(0xe43e bytes) 2024-09-11T05:22:54.842 INFO:teuthology.orchestra.run.smithi012.stdout:4508 writesame 0x80ed6a4 thru 0x80fb727 data_size 0x2(0xe084 bytes) 2024-09-11T05:22:54.853 INFO:teuthology.orchestra.run.smithi012.stdout:4510 write 0x9bc0d07 thru 0x9bd0584 (0xf87e bytes) 2024-09-11T05:22:54.866 INFO:teuthology.orchestra.run.smithi012.stdout:4512 trunc from 0xabbe454 to 0x551ce39 2024-09-11T05:22:54.867 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:54.867 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:54.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.976889935, 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.868 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:22:54.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:22:54.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:22:54.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:22:54.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9768694360000003, 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.874 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:22:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.878 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9768464940000001, 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:22:54.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:22:54.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9766383349999996, 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.883 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:22:54.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:22:54.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:22:54.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9764958010000004, 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.888 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:22:54.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.892 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9764289000000002, 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:22:54.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:22:54.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:22:54.896 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9760925650000001, 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:22:54.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9759575720000004, 2024-09-11T05:22:54.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:22:54.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9759226309999995, 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:22:54.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9759009609999998, 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:22:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9758029070000003, 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:22:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:22:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:22:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9756819119999998, 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:22:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:22:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9755463459999998, 2024-09-11T05:22:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:22:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.975337841, 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:22:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9751514459999999, 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:22:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9750506009999995, 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:22:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:22:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9748714039999999, 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:22:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:22:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9746003710000002, 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:22:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9745505120000004, 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:22:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9743971380000005, 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:22:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:54.959 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:54.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:54.961 INFO:teuthology.orchestra.run.smithi012.stdout:4514 read 0x27c6d69 thru 0x27cd271 (0x6509 bytes) 2024-09-11T05:22:54.961 INFO:teuthology.orchestra.run.smithi012.stdout:4515 write 0xe1a41d thru 0xe2021c (0x5e00 bytes) 2024-09-11T05:22:54.962 INFO:teuthology.orchestra.run.smithi012.stdout:4516 trunc from 0x551ce39 to 0x7374b84 2024-09-11T05:22:54.962 INFO:teuthology.orchestra.run.smithi012.stdout:4518 writesame 0x18f9360 thru 0x18fa291 data_size 0x1(0xf32 bytes) 2024-09-11T05:22:54.962 INFO:teuthology.orchestra.run.smithi012.stdout:4519 write 0x2de254e thru 0x2de3dd1 (0x1884 bytes) 2024-09-11T05:22:54.962 INFO:teuthology.orchestra.run.smithi012.stdout:4520 flatten 2024-09-11T05:22:54.962 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:54.959+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:55.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:55.060+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:55.077 INFO:teuthology.orchestra.run.smithi012.stdout:4521 trunc from 0x7374b84 to 0x41abb3c 2024-09-11T05:22:55.107 INFO:teuthology.orchestra.run.smithi012.stdout:4522 write 0xdc19e44 thru 0xdc1c437 (0x25f4 bytes) 2024-09-11T05:22:55.111 INFO:teuthology.orchestra.run.smithi012.stdout:4523 writesame 0x7de9a38 thru 0x7de9db0 data_size 0x1(0x379 bytes) 2024-09-11T05:22:55.114 INFO:teuthology.orchestra.run.smithi012.stdout:4526 read 0x406ba83 thru 0x4079f9c (0xe51a bytes) 2024-09-11T05:22:55.115 INFO:teuthology.orchestra.run.smithi012.stdout:4527 writesame 0x663cba0 thru 0x6646531 data_size 0xb(0x9992 bytes) 2024-09-11T05:22:55.120 INFO:teuthology.orchestra.run.smithi012.stdout:4529 write 0x9a0e8c4 thru 0x9a1c9e9 (0xe126 bytes) 2024-09-11T05:22:55.126 INFO:teuthology.orchestra.run.smithi012.stdout:4530 read 0x2bc5059 thru 0x2bcabe2 (0x5b8a bytes) 2024-09-11T05:22:55.128 INFO:teuthology.orchestra.run.smithi012.stdout:4531 trunc from 0xdc1c438 to 0xc0b83dd 2024-09-11T05:22:55.140 INFO:teuthology.orchestra.run.smithi012.stdout:4532 punch from 0x67b75c9 to 0x67bed2c, (0x7763 bytes) 2024-09-11T05:22:55.140 INFO:teuthology.orchestra.run.smithi012.stdout:4534 writesame 0x7c3898e thru 0x7c468c5 data_size 0xc(0xdf38 bytes) 2024-09-11T05:22:55.145 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:55.146 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:55.150 INFO:teuthology.orchestra.run.smithi012.stdout:4535 write 0x9aca3ad thru 0x9ad3561 (0x91b5 bytes) 2024-09-11T05:22:55.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:55.159 INFO:teuthology.orchestra.run.smithi012.stdout:4537 punch from 0xa5fcf58 to 0xa60af7d, (0xe025 bytes) 2024-09-11T05:22:55.159 INFO:teuthology.orchestra.run.smithi012.stdout:4538 write 0x27b46a7 thru 0x27b96be (0x5018 bytes) 2024-09-11T05:22:55.161 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:55.161+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:55.173 INFO:teuthology.orchestra.run.smithi012.stdout:4539 trunc from 0xc0b83dd to 0x7253741 2024-09-11T05:22:55.188 INFO:teuthology.orchestra.run.smithi012.stdout:4540 punch from 0x335133c to 0x335850b, (0x71cf bytes) 2024-09-11T05:22:55.188 INFO:teuthology.orchestra.run.smithi012.stdout:4542 punch from 0x58a6338 to 0x58a7c5b, (0x1923 bytes) 2024-09-11T05:22:55.188 INFO:teuthology.orchestra.run.smithi012.stdout:4543 write 0x28cc332 thru 0x28ceaa7 (0x2776 bytes) 2024-09-11T05:22:55.196 INFO:teuthology.orchestra.run.smithi012.stdout:4544 writesame 0x2d65a95 thru 0x2d6c220 data_size 0x2f(0x678c bytes) 2024-09-11T05:22:55.198 INFO:teuthology.orchestra.run.smithi012.stdout:4545 punch from 0x4e7cc03 to 0x4e8651a, (0x9917 bytes) 2024-09-11T05:22:55.199 INFO:teuthology.orchestra.run.smithi012.stdout:4546 read 0x5ceaa57 thru 0x5cf3926 (0x8ed0 bytes) 2024-09-11T05:22:55.199 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:55.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:22:55.208 INFO:teuthology.orchestra.run.smithi012.stdout:4548 write 0xb11a7ac thru 0xb11c555 (0x1daa bytes) 2024-09-11T05:22:55.212 INFO:teuthology.orchestra.run.smithi012.stdout:4549 read 0x374063e thru 0x374cb38 (0xc4fb bytes) 2024-09-11T05:22:55.212 INFO:teuthology.orchestra.run.smithi012.stdout:4550 write 0x5526db2 thru 0x552d049 (0x6298 bytes) 2024-09-11T05:22:55.217 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:55.217 INFO:teuthology.orchestra.run.smithi012.stdout:4553 write 0x4631bcb thru 0x463edad (0xd1e3 bytes) 2024-09-11T05:22:55.232 INFO:teuthology.orchestra.run.smithi012.stdout:4554 trunc from 0xb11c556 to 0x473618c 2024-09-11T05:22:55.253 INFO:teuthology.orchestra.run.smithi012.stdout:4556 trunc from 0x473618c to 0xcb1cb33 2024-09-11T05:22:55.260 INFO:teuthology.orchestra.run.smithi012.stdout:4558 writesame 0x5170465 thru 0x51797ea data_size 0x17(0x9386 bytes) 2024-09-11T05:22:55.262 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:55.261+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:55.265 INFO:teuthology.orchestra.run.smithi012.stdout:4559 read 0x897b05 thru 0x8a4d34 (0xd230 bytes) 2024-09-11T05:22:55.265 INFO:teuthology.orchestra.run.smithi012.stdout:4560 write 0x26797cb thru 0x267c1c7 (0x29fd bytes) 2024-09-11T05:22:55.278 INFO:teuthology.orchestra.run.smithi012.stdout:4561 write 0xea421d9 thru 0xea4d200 (0xb028 bytes) 2024-09-11T05:22:55.284 INFO:teuthology.orchestra.run.smithi012.stdout:4562 read 0x7676d7e thru 0x767e7f2 (0x7a75 bytes) 2024-09-11T05:22:55.284 INFO:teuthology.orchestra.run.smithi012.stdout:4563 punch from 0xd2b48f7 to 0xd2c00e3, (0xb7ec bytes) 2024-09-11T05:22:55.284 INFO:teuthology.orchestra.run.smithi012.stdout:4564 writesame 0x7d2ddfb thru 0x7d37904 data_size 0x93(0x9b0a bytes) 2024-09-11T05:22:55.288 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:55.288 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:55.292 INFO:teuthology.orchestra.run.smithi012.stdout:4566 read 0x8c0a7d3 thru 0x8c18257 (0xda85 bytes) 2024-09-11T05:22:55.292 INFO:teuthology.orchestra.run.smithi012.stdout:4568 write 0x88b76e2 thru 0x88c368d (0xbfac bytes) 2024-09-11T05:22:55.299 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:55.300 INFO:teuthology.orchestra.run.smithi012.stdout:4572 punch from 0x4acd7ad to 0x4ad939f, (0xbbf2 bytes) 2024-09-11T05:22:55.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:55.309 INFO:teuthology.orchestra.run.smithi012.stdout:4574 trunc from 0xea4d201 to 0x6488168 2024-09-11T05:22:55.335 INFO:teuthology.orchestra.run.smithi012.stdout:4575 write 0x9e33d44 thru 0x9e3b37b (0x7638 bytes) 2024-09-11T05:22:55.336 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:55.335+0000 7fd41e0d6640 -1 osd.2 70 log_to_monitors true 2024-09-11T05:22:55.340 INFO:teuthology.orchestra.run.smithi012.stdout:4577 write 0x70400f7 thru 0x704a6c1 (0xa5cb bytes) 2024-09-11T05:22:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:no valid command found; 10 closest matches: 2024-09-11T05:22:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:0 2024-09-11T05:22:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:1 2024-09-11T05:22:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2 2024-09-11T05:22:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:abort 2024-09-11T05:22:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:assert 2024-09-11T05:22:55.342 INFO:teuthology.orchestra.run.smithi012.stderr:bluefs debug_inject_read_zeros 2024-09-11T05:22:55.342 INFO:teuthology.orchestra.run.smithi012.stderr:bluefs files list 2024-09-11T05:22:55.342 INFO:teuthology.orchestra.run.smithi012.stderr:bluefs stats 2024-09-11T05:22:55.342 INFO:teuthology.orchestra.run.smithi012.stderr:bluestore allocator dump block 2024-09-11T05:22:55.342 INFO:teuthology.orchestra.run.smithi012.stderr:bluestore allocator fragmentation block 2024-09-11T05:22:55.342 INFO:teuthology.orchestra.run.smithi012.stderr:admin_socket: invalid command 2024-09-11T05:22:55.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T05:22:55.344 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-11T05:22:55.346 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:55.346 INFO:teuthology.orchestra.run.smithi012.stdout:4579 read 0x58efae8 thru 0x58f6492 (0x69ab bytes) 2024-09-11T05:22:55.346 INFO:teuthology.orchestra.run.smithi012.stdout:4580 writesame 0x281e860 thru 0x2826831 data_size 0x1(0x7fd2 bytes) 2024-09-11T05:22:55.358 INFO:teuthology.orchestra.run.smithi012.stdout:4582 write 0x9e44425 thru 0x9e4ab9f (0x677b bytes) 2024-09-11T05:22:55.360 INFO:teuthology.orchestra.run.smithi012.stdout:4583 clone 41 order 19 su 65536 sc 4 2024-09-11T05:22:55.363 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:55.362+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:55.427 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.682948838000002, 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.682936949999998, 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.682899730000003, 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.682884948999998, 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.682873612999998, 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.681722811999997, 2024-09-11T05:22:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.681708356999998, 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.681697876999998, 2024-09-11T05:22:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.681687410000002, 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.681669049999996, 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.678959978000002, 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.678936978000003, 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.678915615000001, 2024-09-11T05:22:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.678894096000001, 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.678873168999999, 2024-09-11T05:22:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.677039745000002, 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.677029431999998, 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.677019059000003, 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.677004029999999, 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.676994022000002, 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:55.519 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:55.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:55.521 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:55.520+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:55.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:22:55.542 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:22:55.541+0000 7fd411e85640 -1 osd.2 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:22:55.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:22:55.628 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:55.628 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:55.628 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:55.628 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:55.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:55.627+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:55.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:55.698 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-11T05:22:55.717 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:55.717 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:55.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:55.722+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:55.736 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:55.737 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:55.737 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T05:22:55.740 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:55.741 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:55.741 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:55.741 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:55.741 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:55.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:55.759 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:55.759 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:55.777 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:55.794 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:55.811 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:55.812 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:55.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:55.823+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:55.829 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:55.829 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:55.832 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:22:55.832 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:22:55.856 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:55.856 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:55.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:55.925 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:55.925+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:55.943 INFO:teuthology.orchestra.run.smithi012.stdout:4585 trunc from 0x9e4aba0 to 0xe74257e 2024-09-11T05:22:55.968 INFO:teuthology.orchestra.run.smithi012.stdout:4586 trunc from 0xe74257e to 0xa2f3f 2024-09-11T05:22:55.969 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:55.969 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:55.978 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:55.995 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:55.995 INFO:teuthology.orchestra.run.smithi012.stdout:4588 flatten 2024-09-11T05:22:56.001 INFO:teuthology.orchestra.run.smithi012.stdout:4589 punch from 0x3cded to 0x4b10f, (0xe322 bytes) 2024-09-11T05:22:56.001 INFO:teuthology.orchestra.run.smithi012.stdout:4591 punch from 0x5b384 to 0x62e19, (0x7a95 bytes) 2024-09-11T05:22:56.001 INFO:teuthology.orchestra.run.smithi012.stdout:4593 read 0x971ac thru 0xa2f3e (0xbd93 bytes) 2024-09-11T05:22:56.001 INFO:teuthology.orchestra.run.smithi012.stdout:4594 read 0x6fef thru 0xc010 (0x5022 bytes) 2024-09-11T05:22:56.002 INFO:teuthology.orchestra.run.smithi012.stdout:4595 read 0x1220e thru 0x1f488 (0xd27b bytes) 2024-09-11T05:22:56.008 INFO:teuthology.orchestra.run.smithi012.stdout:4597 write 0x39d9be thru 0x39db57 (0x19a bytes) 2024-09-11T05:22:56.012 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.018 INFO:teuthology.orchestra.run.smithi012.stdout:4601 trunc from 0x39db58 to 0x55c56af 2024-09-11T05:22:56.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:56.025+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:56.030 INFO:teuthology.orchestra.run.smithi012.stdout:4602 write 0x71b8df6 thru 0x71bb1da (0x23e5 bytes) 2024-09-11T05:22:56.035 INFO:teuthology.orchestra.run.smithi012.stdout:4604 trunc from 0x71bb1db to 0x8b9ae4d 2024-09-11T05:22:56.041 INFO:teuthology.orchestra.run.smithi012.stdout:4605 read 0x79bd90c thru 0x79c46fc (0x6df1 bytes) 2024-09-11T05:22:56.041 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.041 INFO:teuthology.orchestra.run.smithi012.stdout:4607 read 0x6204ba7 thru 0x6207895 (0x2cef bytes) 2024-09-11T05:22:56.048 INFO:teuthology.orchestra.run.smithi012.stdout:4608 trunc from 0x8b9ae4d to 0x2a343b0 2024-09-11T05:22:56.057 INFO:teuthology.orchestra.run.smithi012.stdout:4609 read 0x26ce122 thru 0x26cfb56 (0x1a35 bytes) 2024-09-11T05:22:56.069 INFO:teuthology.orchestra.run.smithi012.stdout:4611 write 0x9008d9e thru 0x900f21f (0x6482 bytes) 2024-09-11T05:22:56.073 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.073 INFO:teuthology.orchestra.run.smithi012.stdout:4615 write 0x8827227 thru 0x8827442 (0x21c bytes) 2024-09-11T05:22:56.087 INFO:teuthology.orchestra.run.smithi012.stdout:4619 writesame 0xdc1b2a4 thru 0xdc21bd6 data_size 0x3(0x6933 bytes) 2024-09-11T05:22:56.087 INFO:teuthology.orchestra.run.smithi012.stdout:4621 write 0xa280716 thru 0xa285fbd (0x58a8 bytes) 2024-09-11T05:22:56.090 INFO:teuthology.orchestra.run.smithi012.stdout:4623 writesame 0xa46b1df thru 0xa4793d2 data_size 0x2(0xe1f4 bytes) 2024-09-11T05:22:56.103 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.103 INFO:teuthology.orchestra.run.smithi012.stdout:4627 write 0x5f80a18 thru 0x5f8c9ed (0xbfd6 bytes) 2024-09-11T05:22:56.106 INFO:teuthology.orchestra.run.smithi012.stdout:4629 read 0xb44eb38 thru 0xb44f52d (0x9f6 bytes) 2024-09-11T05:22:56.106 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.113 INFO:teuthology.orchestra.run.smithi012.stdout:4634 trunc from 0xdc21bd7 to 0x7a2464c 2024-09-11T05:22:56.124 INFO:teuthology.orchestra.run.smithi012.stdout:4635 writesame 0x5a8636f thru 0x5a91e1b data_size 0x1(0xbaad bytes) 2024-09-11T05:22:56.126 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:56.126 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:56.127 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:56.126+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:56.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:56.147 INFO:teuthology.orchestra.run.smithi012.stdout:4636 read 0x4efba64 thru 0x4f05bed (0xa18a bytes) 2024-09-11T05:22:56.147 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.147 INFO:teuthology.orchestra.run.smithi012.stdout:4638 read 0x1d72878 thru 0x1d7d1e2 (0xa96b bytes) 2024-09-11T05:22:56.147 INFO:teuthology.orchestra.run.smithi012.stdout:4639 read 0x714aadc thru 0x7150cb1 (0x61d6 bytes) 2024-09-11T05:22:56.148 INFO:teuthology.orchestra.run.smithi012.stdout:4640 read 0x2773a73 thru 0x2775de8 (0x2376 bytes) 2024-09-11T05:22:56.148 INFO:teuthology.orchestra.run.smithi012.stdout:4642 punch from 0x10fdcf4 to 0x110c541, (0xe84d bytes) 2024-09-11T05:22:56.148 INFO:teuthology.orchestra.run.smithi012.stdout:4643 read 0x4f6b8d thru 0x5019e1 (0xae55 bytes) 2024-09-11T05:22:56.154 INFO:teuthology.orchestra.run.smithi012.stdout:4645 trunc from 0x7a2464c to 0xfbafe8 2024-09-11T05:22:56.180 INFO:teuthology.orchestra.run.smithi012.stdout:4646 write 0x9f2c5ad thru 0x9f35320 (0x8d74 bytes) 2024-09-11T05:22:56.185 INFO:teuthology.orchestra.run.smithi012.stdout:4647 read 0x4685205 thru 0x469399a (0xe796 bytes) 2024-09-11T05:22:56.191 INFO:teuthology.orchestra.run.smithi012.stdout:4648 writesame 0xabf9c68 thru 0xabfa558 data_size 0x7(0x8f1 bytes) 2024-09-11T05:22:56.191 INFO:teuthology.orchestra.run.smithi012.stdout:4649 writesame 0x1cc6e59 thru 0x1cc7762 data_size 0xd(0x90a bytes) 2024-09-11T05:22:56.195 INFO:teuthology.orchestra.run.smithi012.stdout:4650 trunc from 0xabfa559 to 0xba1808a 2024-09-11T05:22:56.200 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.202 INFO:teuthology.orchestra.run.smithi012.stdout:4652 trunc from 0xba1808a to 0x981a2f7 2024-09-11T05:22:56.212 INFO:teuthology.orchestra.run.smithi012.stdout:4653 trunc from 0x981a2f7 to 0x8ff5195 2024-09-11T05:22:56.217 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.226 INFO:teuthology.orchestra.run.smithi012.stdout:4655 write 0xbd2c673 thru 0xbd311a1 (0x4b2f bytes) 2024-09-11T05:22:56.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:56.227+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:56.229 INFO:teuthology.orchestra.run.smithi012.stdout:4656 read 0xa889355 thru 0xa89249d (0x9149 bytes) 2024-09-11T05:22:56.229 INFO:teuthology.orchestra.run.smithi012.stdout:4657 read 0x5f6bd92 thru 0x5f70934 (0x4ba3 bytes) 2024-09-11T05:22:56.229 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.229 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:56.229 INFO:teuthology.orchestra.run.smithi012.stdout:4660 write 0x5a3f95a thru 0x5a3ff0b (0x5b2 bytes) 2024-09-11T05:22:56.232 INFO:teuthology.orchestra.run.smithi012.stdout:4661 punch from 0x14cb164 to 0x14ceded, (0x3c89 bytes) 2024-09-11T05:22:56.232 INFO:teuthology.orchestra.run.smithi012.stdout:4662 write 0xc1ea6a thru 0xc2206c (0x3603 bytes) 2024-09-11T05:22:56.235 INFO:teuthology.orchestra.run.smithi012.stdout:4664 read 0x3435c3 thru 0x34d5ea (0xa028 bytes) 2024-09-11T05:22:56.243 INFO:teuthology.orchestra.run.smithi012.stdout:4665 trunc from 0xbd311a2 to 0x4620614 2024-09-11T05:22:56.253 INFO:teuthology.orchestra.run.smithi012.stdout:4666 clone 42 order 24 su 262144 sc 12 2024-09-11T05:22:56.280 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:56.280 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:56.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:56.332 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:56.332+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:56.393 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:56.393 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:56.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:56.443 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:56.443+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:56.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:56.530+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:56.534 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:22:56.548 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:56.548 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:56.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:56.632 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:56.631+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:56.661 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:56.661 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:56.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:56.754 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:56.754+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:56.815 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:56.815 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:56.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:22:56.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:56.832+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:56.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:56.933+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:56.968 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:56.968 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:56.977 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:22:57.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:57.035+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:57.080 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:57.080 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:57.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:22:57.136 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:57.135+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:57.209 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:57.209 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:57.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:22:57.263 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:22:57.262+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:22:57.326 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:57.326 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:57.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:22:57.337 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:57.337+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:57.438 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:57.437+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:57.497 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:57.497 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:57.507 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:22:57.539 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:57.539+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:57.625 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:57.625 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:57.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:22:57.639 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:57.639+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:57.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:57.739+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:57.741 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:57.741 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:57.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:22:57.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:22:57.841 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:57.841+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:57.901 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:22:57.901 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:22:57.910 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:22:57.942 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:57.942+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:57.960 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:22:57.960 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:22:57.977 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:22:57.978 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:22:57.994 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:22:57.994 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-11T05:22:58.011 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:22:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:22:58.019 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:58.019 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:22:58.019 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:58.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:22:58.029 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:22:58.029 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:22:58.045 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:22:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:22:58.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:58.045+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:58.064 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:22:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:22:58.080 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:22:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:22:58.136 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:58.137 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:22:58.137 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:22:58.137 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:22:58.137 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:58.144 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:58.144+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:58.145 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:22:58.245 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:58.244+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:58.253 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.508784384999998, 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:22:58.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:22:58.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.258 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.508772497000002, 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:22:58.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.508735277, 2024-09-11T05:22:58.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:22:58.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:22:58.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:22:58.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:22:58.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:22:58.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.508720496000002, 2024-09-11T05:22:58.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:22:58.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:58.274 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.508709160000002, 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.507558359000001, 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:22:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.507543904000002, 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:22:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:22:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:22:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.507533424000002, 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:22:58.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:22:58.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.507522956999999, 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:22:58.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:22:58.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.507504597000001, 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:22:58.297 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:22:58.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:22:58.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.504795524999999, 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:22:58.303 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:22:58.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.307 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.504772525, 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.308 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:22:58.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:22:58.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:58.312 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.504751161999998, 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.313 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:22:58.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:22:58.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.504729642999997, 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:22:58.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:58.321 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.504708716000003, 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:58.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:22:58.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38003 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2266112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.502875291999999, 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062924200999999999, 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38003 2024-09-11T05:22:58.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749581+0000", 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749582+0000", 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749583+0000", 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2640000000000001e-06 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749586+0000", 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1319999999999998e-06 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749589+0000", 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6290000000000002e-06 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812317+0000", 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062728556000000005 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812397+0000", 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9735999999999997e-05 2024-09-11T05:22:58.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812506+0000", 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108645 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.502864979000002, 2024-09-11T05:22:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:58.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:22:58.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:22:58.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.502854606, 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.335 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.502839577000003, 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:22:58.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:58.343 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.502829568999999, 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:58.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:22:58.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:22:58.346 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:22:58.347 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:22:58.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:22:58.349 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:58.348+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:58.450 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:22:58.449+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:22:58.459 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:58.459 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:58.460 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:58.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:22:58.529 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-11T05:22:58.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:22:58.553 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:58.553+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:58.618 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:58.618 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:58.618 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:58.618 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:58.618 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:58.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:22:58.669 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:58.668+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:58.729 INFO:teuthology.orchestra.run.smithi012.stdout:4667 writesame 0x5545d7e thru 0x5552511 data_size 0x4(0xc794 bytes) 2024-09-11T05:22:58.732 INFO:teuthology.orchestra.run.smithi012.stdout:4668 writesame 0x1755f15 thru 0x176111c data_size 0x48(0xb208 bytes) 2024-09-11T05:22:58.737 INFO:teuthology.orchestra.run.smithi012.stdout:4669 writesame 0x501738a thru 0x5022ca9 data_size 0x10(0xb920 bytes) 2024-09-11T05:22:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:4670 read 0x14c895f thru 0x14d733e (0xe9e0 bytes) 2024-09-11T05:22:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:4673 read 0x5264076 thru 0x526d90c (0x9897 bytes) 2024-09-11T05:22:58.752 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:58.752+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:58.758 INFO:teuthology.orchestra.run.smithi012.stdout:4674 writesame 0xd288fcd thru 0xd28d3bd data_size 0x1(0x43f1 bytes) 2024-09-11T05:22:58.758 INFO:teuthology.orchestra.run.smithi012.stdout:4677 writesame 0xc8b47b2 thru 0xc8bcbbf data_size 0x1(0x840e bytes) 2024-09-11T05:22:58.780 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:58.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.145801390000003, 2024-09-11T05:22:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:22:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:22:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:22:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:22:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.789 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.143659868999997, 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.790 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:22:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:22:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:22:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:22:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.143638305000003, 2024-09-11T05:22:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:22:58.796 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:22:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:58.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:22:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:22:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:22:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:22:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:22:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:22:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:22:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:22:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:22:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:22:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:22:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:22:58.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:22:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:22:58.805 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.806 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.143624293999999, 2024-09-11T05:22:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:22:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.807 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:22:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:22:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:22:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:22:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:22:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:22:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:22:58.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:22:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:22:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:22:58.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:22:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:22:58.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:22:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:22:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:22:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:22:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141798993000002, 2024-09-11T05:22:58.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:22:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.818 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:22:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:22:58.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141784389999998, 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.827 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141767084999998, 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:22:58.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141742976000003, 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:22:58.832 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.836 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141714899999997, 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.837 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:22:58.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:22:58.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141687908000002, 2024-09-11T05:22:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:22:58.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141647349000003, 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.846 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:22:58.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:22:58.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.141623961999997, 2024-09-11T05:22:58.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.854 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.045638855, 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:22:58.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:22:58.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.045619295000002, 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:22:58.859 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:22:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:22:58.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.04560008, 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:22:58.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:58.868 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.045579279999998, 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:22:58.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.161478764999998, 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:22:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:22:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:22:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:58.881 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.158488957000003, 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:58.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:22:58.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:22:58.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:22:58.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.693892065, 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:22:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:22:58.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:22:58.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:22:58.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.159308177, 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:22:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:58.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:58.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:22:58.905 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:58.903+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:58.906 INFO:teuthology.orchestra.run.smithi012.stdout:4678 trunc from 0xd28d3be to 0x4b31c19 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4681 read 0x44ded73 thru 0x44dfa82 (0xd10 bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4685 writesame 0xbccc715 thru 0xbcdb157 data_size 0x1(0xea43 bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4686 read 0xb322b34 thru 0xb32ffe8 (0xd4b5 bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4687 read 0x30b6cbe thru 0x30c0ccb (0xa00e bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4689 punch from 0x192eb50 to 0x193828e, (0x973e bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4690 write 0xc6ee4d4 thru 0xc6f8a4f (0xa57c bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4691 trunc from 0xc6f8a50 to 0x23b73c9 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4694 read 0x12b0a57 thru 0x12b381d (0x2dc7 bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4696 read 0x1b18874 thru 0x1b231da (0xa967 bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4697 punch from 0x167801a to 0x167d590, (0x5576 bytes) 2024-09-11T05:22:58.907 INFO:teuthology.orchestra.run.smithi012.stdout:4699 punch from 0x1e859a5 to 0x1e946a5, (0xed00 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4700 writesame 0x79d2ac5 thru 0x79ddf49 data_size 0x1(0xb485 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4701 write 0x6419824 thru 0x641a1b5 (0x992 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4702 write 0xc69c92e thru 0xc6a21de (0x58b1 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4703 write 0xb81a7de thru 0xb81ad2f (0x552 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4705 read 0x949be04 thru 0x94a7cf7 (0xbef4 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4706 write 0xcbde61d thru 0xcbeaaa5 (0xc489 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4710 read 0x77888ab thru 0x778ed0f (0x6465 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4711 writesame 0x7408329 thru 0x7413b2d data_size 0x29(0xb805 bytes) 2024-09-11T05:22:58.908 INFO:teuthology.orchestra.run.smithi012.stdout:4713 writesame 0x37aecc6 thru 0x37ba9bd data_size 0x4(0xbcf8 bytes) 2024-09-11T05:22:58.922 INFO:teuthology.orchestra.run.smithi012.stdout:4716 trunc from 0xcbeaaa6 to 0x16a21d6 2024-09-11T05:22:58.938 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:58.938 INFO:teuthology.orchestra.run.smithi012.stdout:4719 writesame 0x3a231c thru 0x3af0a4 data_size 0x1(0xcd89 bytes) 2024-09-11T05:22:58.963 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:58.964 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:58.971 INFO:teuthology.orchestra.run.smithi012.stdout:4722 write 0x3f66840 thru 0x3f73fdf (0xd7a0 bytes) 2024-09-11T05:22:58.981 INFO:teuthology.orchestra.run.smithi012.stdout:4723 trunc from 0x3f73fe0 to 0xad89a9f 2024-09-11T05:22:58.986 INFO:teuthology.orchestra.run.smithi012.stdout:4724 read 0x75e7c04 thru 0x75f2182 (0xa57f bytes) 2024-09-11T05:22:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:4727 trunc from 0xad89a9f to 0x4150047 2024-09-11T05:22:59.004 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:59.004+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:59.021 INFO:teuthology.orchestra.run.smithi012.stdout:4728 write 0xe072ef7 thru 0xe073dd5 (0xedf bytes) 2024-09-11T05:22:59.026 INFO:teuthology.orchestra.run.smithi012.stdout:4730 trunc from 0xe073dd6 to 0xbb2acfa 2024-09-11T05:22:59.040 INFO:teuthology.orchestra.run.smithi012.stdout:4731 punch from 0x625556a to 0x625fb25, (0xa5bb bytes) 2024-09-11T05:22:59.040 INFO:teuthology.orchestra.run.smithi012.stdout:4733 read 0x6b79409 thru 0x6b811ba (0x7db2 bytes) 2024-09-11T05:22:59.040 INFO:teuthology.orchestra.run.smithi012.stdout:4734 read 0x69693a1 thru 0x6971748 (0x83a8 bytes) 2024-09-11T05:22:59.040 INFO:teuthology.orchestra.run.smithi012.stdout:4737 punch from 0x213c34e to 0x213d842, (0x14f4 bytes) 2024-09-11T05:22:59.041 INFO:teuthology.orchestra.run.smithi012.stdout:4738 write 0x19eab00 thru 0x19f4a05 (0x9f06 bytes) 2024-09-11T05:22:59.041 INFO:teuthology.orchestra.run.smithi012.stdout:4741 read 0x5f9a85a thru 0x5f9f524 (0x4ccb bytes) 2024-09-11T05:22:59.041 INFO:teuthology.orchestra.run.smithi012.stdout:4742 punch from 0x54977ad to 0x54a5943, (0xe196 bytes) 2024-09-11T05:22:59.047 INFO:teuthology.orchestra.run.smithi012.stdout:4743 trunc from 0xbb2acfa to 0x6aedb71 2024-09-11T05:22:59.052 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:59.052 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:59.053 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:59.056 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.056 INFO:teuthology.orchestra.run.smithi012.stdout:4745 punch from 0x58cac58 to 0x58d4112, (0x94ba bytes) 2024-09-11T05:22:59.056 INFO:teuthology.orchestra.run.smithi012.stdout:4746 read 0x3fd953b thru 0x3fe8737 (0xf1fd bytes) 2024-09-11T05:22:59.059 INFO:teuthology.orchestra.run.smithi012.stdout:4747 trunc from 0x6aedb71 to 0x9bbd633 2024-09-11T05:22:59.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:22:59.066 INFO:teuthology.orchestra.run.smithi012.stdout:4748 write 0x54de352 thru 0x54e8057 (0x9d06 bytes) 2024-09-11T05:22:59.074 INFO:teuthology.orchestra.run.smithi012.stdout:4750 write 0xab96593 thru 0xaba62c5 (0xfd33 bytes) 2024-09-11T05:22:59.075 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.079 INFO:teuthology.orchestra.run.smithi012.stdout:4752 trunc from 0xaba62c6 to 0x72f1721 2024-09-11T05:22:59.087 INFO:teuthology.orchestra.run.smithi012.stdout:4753 write 0x5c9df47 thru 0x5ca4f86 (0x7040 bytes) 2024-09-11T05:22:59.088 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.089 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.092 INFO:teuthology.orchestra.run.smithi012.stdout:4758 trunc from 0x72f1721 to 0xa276bd3 2024-09-11T05:22:59.097 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.097 INFO:teuthology.orchestra.run.smithi012.stdout:4761 read 0x5a7fb35 thru 0x5a8eb1c (0xefe8 bytes) 2024-09-11T05:22:59.097 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.097 INFO:teuthology.orchestra.run.smithi012.stdout:4767 read 0x56ab2df thru 0x56adbcc (0x28ee bytes) 2024-09-11T05:22:59.098 INFO:teuthology.orchestra.run.smithi012.stdout:4768 writesame 0x9c72ce2 thru 0x9c7e78b data_size 0x1(0xbaaa bytes) 2024-09-11T05:22:59.122 INFO:teuthology.orchestra.run.smithi012.stdout:4771 write 0x15a69aa thru 0x15b3cb0 (0xd307 bytes) 2024-09-11T05:22:59.123 INFO:teuthology.orchestra.run.smithi012.stdout:4772 punch from 0x3ceea7b to 0x3cefb3a, (0x10bf bytes) 2024-09-11T05:22:59.123 INFO:teuthology.orchestra.run.smithi012.stdout:4773 read 0x658f1b8 thru 0x659d746 (0xe58f bytes) 2024-09-11T05:22:59.124 INFO:teuthology.orchestra.run.smithi012.stdout:4774 writesame 0x1a5d954 thru 0x1a62b0a data_size 0x13(0x51b7 bytes) 2024-09-11T05:22:59.125 INFO:teuthology.orchestra.run.smithi012.stdout:4775 read 0x3239446 thru 0x3241cd1 (0x888c bytes) 2024-09-11T05:22:59.126 INFO:teuthology.orchestra.run.smithi012.stdout:4777 punch from 0x650b784 to 0x65169a2, (0xb21e bytes) 2024-09-11T05:22:59.126 INFO:teuthology.orchestra.run.smithi012.stdout:4779 write 0x814ea3f thru 0x8150e9b (0x245d bytes) 2024-09-11T05:22:59.127 INFO:teuthology.orchestra.run.smithi012.stdout:4780 writesame 0x746fb06 thru 0x7477c16 data_size 0x1(0x8111 bytes) 2024-09-11T05:22:59.144 INFO:teuthology.orchestra.run.smithi012.stdout:4781 writesame 0x9c7792c thru 0x9c86e94 data_size 0x23(0xf569 bytes) 2024-09-11T05:22:59.145 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:22:59.145+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:22:59.146 INFO:teuthology.orchestra.run.smithi012.stdout:4782 write 0x216949c thru 0x216d33c (0x3ea1 bytes) 2024-09-11T05:22:59.147 INFO:teuthology.orchestra.run.smithi012.stdout:4786 read 0xe5782f thru 0xe6633d (0xeb0f bytes) 2024-09-11T05:22:59.147 INFO:teuthology.orchestra.run.smithi012.stdout:4788 read 0x7855eaa thru 0x785c997 (0x6aee bytes) 2024-09-11T05:22:59.148 INFO:teuthology.orchestra.run.smithi012.stdout:4789 trunc from 0xa276bd3 to 0xa53266f 2024-09-11T05:22:59.161 INFO:teuthology.orchestra.run.smithi012.stdout:4790 trunc from 0xa53266f to 0x3b9637d 2024-09-11T05:22:59.169 INFO:teuthology.orchestra.run.smithi012.stdout:4792 read 0x30f150e thru 0x30f793c (0x642f bytes) 2024-09-11T05:22:59.186 INFO:teuthology.orchestra.run.smithi012.stdout:4796 write 0xe361616 thru 0xe36e77a (0xd165 bytes) 2024-09-11T05:22:59.189 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.189 INFO:teuthology.orchestra.run.smithi012.stdout:4800 read 0xbec2da5 thru 0xbecbfbe (0x921a bytes) 2024-09-11T05:22:59.189 INFO:teuthology.orchestra.run.smithi012.stdout:4803 write 0x573d76d thru 0x573d983 (0x217 bytes) 2024-09-11T05:22:59.190 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.190 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.190 INFO:teuthology.orchestra.run.smithi012.stdout:4806 read 0x6f5ca00 thru 0x6f6b11f (0xe720 bytes) 2024-09-11T05:22:59.191 INFO:teuthology.orchestra.run.smithi012.stdout:4810 punch from 0x2847158 to 0x28534ac, (0xc354 bytes) 2024-09-11T05:22:59.191 INFO:teuthology.orchestra.run.smithi012.stdout:4811 write 0x58cf4b7 thru 0x58d93b2 (0x9efc bytes) 2024-09-11T05:22:59.192 INFO:teuthology.orchestra.run.smithi012.stdout:4812 read 0x6239b6e thru 0x623c833 (0x2cc6 bytes) 2024-09-11T05:22:59.192 INFO:teuthology.orchestra.run.smithi012.stdout:4813 read 0x33f2070 thru 0x33fe8da (0xc86b bytes) 2024-09-11T05:22:59.193 INFO:teuthology.orchestra.run.smithi012.stdout:4814 read 0x9097f7c thru 0x909accf (0x2d54 bytes) 2024-09-11T05:22:59.205 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:59.204+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:59.206 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:59.206 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:59.206 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:59.207 INFO:teuthology.orchestra.run.smithi012.stdout:4815 trunc from 0xe36e77b to 0x21df510 2024-09-11T05:22:59.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:22:59.218 INFO:teuthology.orchestra.run.smithi012.stdout:4816 read 0x1abd645 thru 0x1acc5f1 (0xefad bytes) 2024-09-11T05:22:59.219 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.219 INFO:teuthology.orchestra.run.smithi012.stdout:4818 writesame 0x14382fa thru 0x1439eb0 data_size 0x2b(0x1bb7 bytes) 2024-09-11T05:22:59.220 INFO:teuthology.orchestra.run.smithi012.stdout:4819 write 0xbb3b81 thru 0xbb4726 (0xba6 bytes) 2024-09-11T05:22:59.235 INFO:teuthology.orchestra.run.smithi012.stdout:4820 write 0xa0c3803 thru 0xa0c4c83 (0x1481 bytes) 2024-09-11T05:22:59.237 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.237 INFO:teuthology.orchestra.run.smithi012.stdout:4824 read 0x79a9216 thru 0x79b162c (0x8417 bytes) 2024-09-11T05:22:59.237 INFO:teuthology.orchestra.run.smithi012.stdout:4826 punch from 0x3357060 to 0x3366906, (0xf8a6 bytes) 2024-09-11T05:22:59.237 INFO:teuthology.orchestra.run.smithi012.stdout:4830 read 0x3eb1998 thru 0x3eb51b5 (0x381e bytes) 2024-09-11T05:22:59.238 INFO:teuthology.orchestra.run.smithi012.stdout:4831 writesame 0x670429c thru 0x670c382 data_size 0x1(0x80e7 bytes) 2024-09-11T05:22:59.254 INFO:teuthology.orchestra.run.smithi012.stdout:4832 punch from 0x9423aff to 0x942ec81, (0xb182 bytes) 2024-09-11T05:22:59.265 INFO:teuthology.orchestra.run.smithi012.stdout:4833 trunc from 0xa0c4c84 to 0x67f068 2024-09-11T05:22:59.273 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.294 INFO:teuthology.orchestra.run.smithi012.stdout:4836 writesame 0xdefad00 thru 0xdf02cad data_size 0x3b(0x7fae bytes) 2024-09-11T05:22:59.302 INFO:teuthology.orchestra.run.smithi012.stdout:4837 trunc from 0xdf02cae to 0x6522137 2024-09-11T05:22:59.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:59.305+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:59.311 INFO:teuthology.orchestra.run.smithi012.stdout:4841 read 0x4106444 thru 0x410c36d (0x5f2a bytes) 2024-09-11T05:22:59.311 INFO:teuthology.orchestra.run.smithi012.stdout:4843 read 0x580d682 thru 0x58192cf (0xbc4e bytes) 2024-09-11T05:22:59.317 INFO:teuthology.orchestra.run.smithi012.stdout:4844 trunc from 0x6522137 to 0xb2bf5ad 2024-09-11T05:22:59.322 INFO:teuthology.orchestra.run.smithi012.stdout:4847 write 0x43bc74f thru 0x43c44de (0x7d90 bytes) 2024-09-11T05:22:59.324 INFO:teuthology.orchestra.run.smithi012.stdout:4849 write 0xaac0c8e thru 0xaacf851 (0xebc4 bytes) 2024-09-11T05:22:59.326 INFO:teuthology.orchestra.run.smithi012.stdout:4850 read 0x8a78a8e thru 0x8a81f33 (0x94a6 bytes) 2024-09-11T05:22:59.326 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.326 INFO:teuthology.orchestra.run.smithi012.stdout:4852 punch from 0x68f835 to 0x6907d1, (0xf9c bytes) 2024-09-11T05:22:59.326 INFO:teuthology.orchestra.run.smithi012.stdout:4853 punch from 0x16663b3 to 0x166d280, (0x6ecd bytes) 2024-09-11T05:22:59.332 INFO:teuthology.orchestra.run.smithi012.stdout:4854 trunc from 0xb2bf5ad to 0x5af25b1 2024-09-11T05:22:59.342 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.347 INFO:teuthology.orchestra.run.smithi012.stdout:4856 writesame 0x63b54fd thru 0x63bb295 data_size 0x31(0x5d99 bytes) 2024-09-11T05:22:59.348 INFO:teuthology.orchestra.run.smithi012.stdout:4857 read 0x9a64d2 thru 0x9ab3ba (0x4ee9 bytes) 2024-09-11T05:22:59.348 INFO:teuthology.orchestra.run.smithi012.stdout:4858 punch from 0x37159fd to 0x371848b, (0x2a8e bytes) 2024-09-11T05:22:59.352 INFO:teuthology.orchestra.run.smithi012.stdout:4859 trunc from 0x63bb296 to 0x3085c0d 2024-09-11T05:22:59.360 INFO:teuthology.orchestra.run.smithi012.stdout:4860 read 0x9eef00 thru 0x9f7bb3 (0x8cb4 bytes) 2024-09-11T05:22:59.360 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.361 INFO:teuthology.orchestra.run.smithi012.stdout:4862 trunc from 0x3085c0d to 0x2425d23 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.770316137999998, 2024-09-11T05:22:59.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:59.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:22:59.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.770088641999997, 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.373 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:22:59.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:22:59.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.769833828000003, 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.382 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.769464933000002, 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:22:59.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:22:59.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.769303387000001, 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.387 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:22:59.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:22:59.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.768860652000001, 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:22:59.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.396 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.766713758999998, 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:22:59.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.764683206999997, 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:22:59.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:59.405 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.764662821999998, 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:22:59.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.547479017000001, 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:59.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:22:59.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.547457993000002, 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:59.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:22:59.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.547433738000002, 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:22:59.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.545754654, 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:22:59.423 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:22:59.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.545735307999998, 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.428 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:22:59.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:22:59.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.545714535999998, 2024-09-11T05:22:59.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:59.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:22:59.436 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.545695125999998, 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.437 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:22:59.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.545674656999999, 2024-09-11T05:22:59.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:59.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:22:59.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.545655767, 2024-09-11T05:22:59.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:59.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:22:59.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.536317973999999, 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.451 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:22:59.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.455 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 60.536307147999999, 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:22:59.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.460 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:59.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:22:59.462 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:59.461+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:4863 read 0x33de88 thru 0x3408ca (0x2a43 bytes) 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:4864 writesame 0x80aae61 thru 0x80b7c97 data_size 0x1(0xce37 bytes) 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:4865 trunc from 0x80b7c98 to 0xb013a43 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:4866 read 0x3bf42ae thru 0x3bf85ba (0x430d bytes) 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:4868 read 0x60ac3a6 thru 0x60b8eb4 (0xcb0f bytes) 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:4870 write 0x77015af thru 0x7709174 (0x7bc6 bytes) 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:4871 trunc from 0xb013a43 to 0x2182a67 2024-09-11T05:22:59.463 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:22:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:4874 write 0xc5653 thru 0xd26eb (0xd099 bytes) 2024-09-11T05:22:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:4877 read 0x3cecd2 thru 0x3d1104 (0x2433 bytes) 2024-09-11T05:22:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:4879 trunc from 0x2182a67 to 0x6afcd2a 2024-09-11T05:22:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:4886 write 0xb43dc48 thru 0xb440087 (0x2440 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4887 punch from 0x61377d2 to 0x613f706, (0x7f34 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4888 write 0x3a5d95d thru 0x3a64466 (0x6b0a bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4889 read 0x7c5c59d thru 0x7c67bf2 (0xb656 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4890 write 0x75fc33b thru 0x75feb89 (0x284f bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4891 write 0x3739d75 thru 0x3749cc7 (0xff53 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4892 read 0xfb307d thru 0xfbe91d (0xb8a1 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4893 writesame 0x415ff7f thru 0x416e5a6 data_size 0x3c(0xe628 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4894 read 0x57fd53e thru 0x58069ae (0x9471 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4895 read 0x4834e02 thru 0x483e904 (0x9b03 bytes) 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:22:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:4897 read 0x475687e thru 0x476399b (0xd11e bytes) 2024-09-11T05:22:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:4898 write 0x3545f47 thru 0x3554e35 (0xeeef bytes) 2024-09-11T05:22:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:4899 writesame 0x1b2919c thru 0x1b2fd64 data_size 0x1(0x6bc9 bytes) 2024-09-11T05:22:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:4900 write 0xc250ae2 thru 0xc260095 (0xf5b4 bytes) 2024-09-11T05:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:4901 write 0xe33b8fc thru 0xe33bf57 (0x65c bytes) 2024-09-11T05:22:59.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:22:59.562+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:22:59.607 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:59.608 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:22:59.608 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:59.617 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:22:59.663 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:22:59.662+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:22:59.719 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:59.719 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:22:59.719 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:22:59.719 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:22:59.719 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:59.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:22:59.771 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:22:59.771+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:22:59.832 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199443477000001, 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.833 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:59.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:22:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199433611, 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199409194999999, 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:22:59.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199397907, 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:22:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:22:59.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199388387999999, 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:22:59.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:22:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199379029999999, 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:22:59.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199365148, 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.862 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.866 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199355581000001, 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:22:59.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:22:59.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.871 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199339751, 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199313993000001, 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.876 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:22:59.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199285336000001, 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.881 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:59.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:22:59.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:59.885 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199260503, 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:59.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199242951, 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:22:59.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199232981, 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.894 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199222793000001, 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:22:59.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199213454000001, 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.903 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:22:59.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:22:59.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199204293999999, 2024-09-11T05:22:59.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:22:59.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:22:59.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.1991931, 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:22:59.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:22:59.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:22:59.917 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199169159, 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:22:59.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.199157543, 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:22:59.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:22:59.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:22:59.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:22:59.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:22:59.926 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:22:59.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:22:59.928 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:22:59.927+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:00.028 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:00.027+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:00.074 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:00.074 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:00.074 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:00.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:00.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:00.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:00.136+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:00.226 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:00.226 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:00.227 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:00.227 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:00.227 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:00.227 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:00.227 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:00.230 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:00.230+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:00.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:00.243 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:00.243 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:00.259 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:00.259 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:00.275 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:00.275 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:00.292 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:00.310 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:00.326 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:00.326 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:00.330 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:00.330+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:00.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:00.344 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:00.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:00.381 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:00.381 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:00.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:00.414 INFO:teuthology.orchestra.run.smithi012.stdout:4902 punch from 0x4a369b5 to 0x4a40f14, (0xa55f bytes) 2024-09-11T05:23:00.414 INFO:teuthology.orchestra.run.smithi012.stdout:4904 writesame 0x8fdb834 thru 0x8fe7404 data_size 0x21(0xbbd1 bytes) 2024-09-11T05:23:00.418 INFO:teuthology.orchestra.run.smithi012.stdout:4907 writesame 0x33d92b3 thru 0x33e2794 data_size 0x3b(0x94e2 bytes) 2024-09-11T05:23:00.420 INFO:teuthology.orchestra.run.smithi012.stdout:4909 write 0xb3f1798 thru 0xb3fc6a5 (0xaf0e bytes) 2024-09-11T05:23:00.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:00.430+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:00.435 INFO:teuthology.orchestra.run.smithi012.stdout:4911 trunc from 0xe33bf58 to 0x2a44201 2024-09-11T05:23:00.460 INFO:teuthology.orchestra.run.smithi012.stdout:4912 write 0x5ac8121 thru 0x5ace4f0 (0x63d0 bytes) 2024-09-11T05:23:00.464 INFO:teuthology.orchestra.run.smithi012.stdout:4913 trunc from 0x5ace4f1 to 0x818ae70 2024-09-11T05:23:00.467 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:00.467 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:00.469 INFO:teuthology.orchestra.run.smithi012.stdout:4914 write 0x12bf6dc thru 0x12ca482 (0xada7 bytes) 2024-09-11T05:23:00.471 INFO:teuthology.orchestra.run.smithi012.stdout:4915 write 0x7702ccd thru 0x770a00f (0x7343 bytes) 2024-09-11T05:23:00.482 INFO:teuthology.orchestra.run.smithi012.stdout:4916 write 0xbf1ec1b thru 0xbf20484 (0x186a bytes) 2024-09-11T05:23:00.488 INFO:teuthology.orchestra.run.smithi012.stdout:4917 trunc from 0xbf20485 to 0x8241bb6 2024-09-11T05:23:00.497 INFO:teuthology.orchestra.run.smithi012.stdout:4921 read 0x3a8615e thru 0x3a8f816 (0x96b9 bytes) 2024-09-11T05:23:00.502 INFO:teuthology.orchestra.run.smithi012.stdout:4923 writesame 0x83d361f thru 0x83d6697 data_size 0x1(0x3079 bytes) 2024-09-11T05:23:00.503 INFO:teuthology.orchestra.run.smithi012.stdout:4924 read 0x6d26969 thru 0x6d32d75 (0xc40d bytes) 2024-09-11T05:23:00.504 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.513 INFO:teuthology.orchestra.run.smithi012.stdout:4926 write 0xb2c515b thru 0xb2cb300 (0x61a6 bytes) 2024-09-11T05:23:00.514 INFO:teuthology.orchestra.run.smithi012.stdout:4927 punch from 0x6427f44 to 0x642c2be, (0x437a bytes) 2024-09-11T05:23:00.515 INFO:teuthology.orchestra.run.smithi012.stdout:truncating to largest ever: 0xee2f2c6 2024-09-11T05:23:00.519 INFO:teuthology.orchestra.run.smithi012.stdout:4928 trunc from 0xb2cb301 to 0xee2f2c6 2024-09-11T05:23:00.524 INFO:teuthology.orchestra.run.smithi012.stdout:4929 write 0xc553c28 thru 0xc55bee4 (0x82bd bytes) 2024-09-11T05:23:00.527 INFO:teuthology.orchestra.run.smithi012.stdout:4930 write 0x13ec3f9 thru 0x13f6382 (0x9f8a bytes) 2024-09-11T05:23:00.528 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:00.528 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:00.528 INFO:teuthology.orchestra.run.smithi012.stdout:4931 write 0x9413111 thru 0x9413240 (0x130 bytes) 2024-09-11T05:23:00.530 INFO:teuthology.orchestra.run.smithi012.stdout:4932 writesame 0x68c5a89 thru 0x68cd249 data_size 0xb(0x77c1 bytes) 2024-09-11T05:23:00.532 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:00.531+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:00.532 INFO:teuthology.orchestra.run.smithi012.stdout:4935 read 0x762893 thru 0x7681f2 (0x5960 bytes) 2024-09-11T05:23:00.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:00.544 INFO:teuthology.orchestra.run.smithi012.stdout:4936 trunc from 0xee2f2c6 to 0x5418d4a 2024-09-11T05:23:00.562 INFO:teuthology.orchestra.run.smithi012.stdout:4937 punch from 0xfd8f90 to 0xfde088, (0x50f8 bytes) 2024-09-11T05:23:00.562 INFO:teuthology.orchestra.run.smithi012.stdout:4938 write 0x270e63a thru 0x27150f1 (0x6ab8 bytes) 2024-09-11T05:23:00.563 INFO:teuthology.orchestra.run.smithi012.stdout:4939 read 0x3ebd401 thru 0x3ec9fd8 (0xcbd8 bytes) 2024-09-11T05:23:00.578 INFO:teuthology.orchestra.run.smithi012.stdout:4941 write 0xa73778b thru 0xa73a0af (0x2925 bytes) 2024-09-11T05:23:00.582 INFO:teuthology.orchestra.run.smithi012.stdout:4942 trunc from 0xa73a0b0 to 0x801ebb7 2024-09-11T05:23:00.595 INFO:teuthology.orchestra.run.smithi012.stdout:4943 trunc from 0x801ebb7 to 0x46a0021 2024-09-11T05:23:00.605 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.605 INFO:teuthology.orchestra.run.smithi012.stdout:4947 read 0x5a6419 thru 0x5a6cdc (0x8c4 bytes) 2024-09-11T05:23:00.608 INFO:teuthology.orchestra.run.smithi012.stdout:4949 write 0x1a698a2 thru 0x1a78cdb (0xf43a bytes) 2024-09-11T05:23:00.608 INFO:teuthology.orchestra.run.smithi012.stdout:4950 read 0x225a027 thru 0x225eac2 (0x4a9c bytes) 2024-09-11T05:23:00.608 INFO:teuthology.orchestra.run.smithi012.stdout:4951 read 0xc616b1 thru 0xc6ebd8 (0xd528 bytes) 2024-09-11T05:23:00.608 INFO:teuthology.orchestra.run.smithi012.stdout:4954 read 0x815ea5 thru 0x816915 (0xa71 bytes) 2024-09-11T05:23:00.609 INFO:teuthology.orchestra.run.smithi012.stdout:4955 punch from 0xa0f99a to 0xa19692, (0x9cf8 bytes) 2024-09-11T05:23:00.620 INFO:teuthology.orchestra.run.smithi012.stdout:4956 writesame 0xa2b52cb thru 0xa2bdefb data_size 0x7(0x8c31 bytes) 2024-09-11T05:23:00.631 INFO:teuthology.orchestra.run.smithi012.stdout:4959 write 0xdeb0ca1 thru 0xdeb601e (0x537e bytes) 2024-09-11T05:23:00.633 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:00.633+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:00.635 INFO:teuthology.orchestra.run.smithi012.stdout:4960 write 0x5ecb3e6 thru 0x5ed893c (0xd557 bytes) 2024-09-11T05:23:00.636 INFO:teuthology.orchestra.run.smithi012.stdout:4961 punch from 0x782c6d1 to 0x78335e4, (0x6f13 bytes) 2024-09-11T05:23:00.637 INFO:teuthology.orchestra.run.smithi012.stdout:4962 write 0x5e4e84d thru 0x5e56dc1 (0x8575 bytes) 2024-09-11T05:23:00.638 INFO:teuthology.orchestra.run.smithi012.stdout:4963 write 0xaf30074 thru 0xaf38c11 (0x8b9e bytes) 2024-09-11T05:23:00.639 INFO:teuthology.orchestra.run.smithi012.stdout:4967 write 0x5847581 thru 0x584aad4 (0x3554 bytes) 2024-09-11T05:23:00.641 INFO:teuthology.orchestra.run.smithi012.stdout:4968 read 0xd208090 thru 0xd211118 (0x9089 bytes) 2024-09-11T05:23:00.641 INFO:teuthology.orchestra.run.smithi012.stdout:4969 read 0xdd0c176 thru 0xdd1b58c (0xf417 bytes) 2024-09-11T05:23:00.641 INFO:teuthology.orchestra.run.smithi012.stdout:4970 write 0xa5bde9c thru 0xa5c5574 (0x76d9 bytes) 2024-09-11T05:23:00.642 INFO:teuthology.orchestra.run.smithi012.stdout:4971 writesame 0xbbe0d45 thru 0xbbe41fe data_size 0x11(0x34ba bytes) 2024-09-11T05:23:00.644 INFO:teuthology.orchestra.run.smithi012.stdout:4974 punch from 0x6e3b933 to 0x6e433ab, (0x7a78 bytes) 2024-09-11T05:23:00.644 INFO:teuthology.orchestra.run.smithi012.stdout:4976 read 0x2ed396 thru 0x2f730e (0x9f79 bytes) 2024-09-11T05:23:00.644 INFO:teuthology.orchestra.run.smithi012.stdout:4982 read 0xa94a318 thru 0xa956b9d (0xc886 bytes) 2024-09-11T05:23:00.645 INFO:teuthology.orchestra.run.smithi012.stdout:4983 read 0x597e54a thru 0x59803f1 (0x1ea8 bytes) 2024-09-11T05:23:00.645 INFO:teuthology.orchestra.run.smithi012.stdout:4984 trunc from 0xdeb601f to 0xe41a2f5 2024-09-11T05:23:00.650 INFO:teuthology.orchestra.run.smithi012.stdout:4985 writesame 0x2c44cba thru 0x2c5423f data_size 0xb(0xf586 bytes) 2024-09-11T05:23:00.654 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.654 INFO:teuthology.orchestra.run.smithi012.stdout:4987 write 0x18ace46 thru 0x18b7f0e (0xb0c9 bytes) 2024-09-11T05:23:00.655 INFO:teuthology.orchestra.run.smithi012.stdout:4988 writesame 0xe3f2ddc thru 0xe3f481f data_size 0x4(0x1a44 bytes) 2024-09-11T05:23:00.658 INFO:teuthology.orchestra.run.smithi012.stdout:4989 writesame 0x7ac82a0 thru 0x7acb961 data_size 0x2b(0x36c2 bytes) 2024-09-11T05:23:00.660 INFO:teuthology.orchestra.run.smithi012.stdout:4991 writesame 0x6562e97 thru 0x656d0a9 data_size 0x1(0xa213 bytes) 2024-09-11T05:23:00.675 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:00.675 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:00.684 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.684 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.684 INFO:teuthology.orchestra.run.smithi012.stdout:5000 writesame 0x71baa57 thru 0x71bc800 data_size 0x1(0x1daa bytes) 2024-09-11T05:23:00.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:00.688 INFO:teuthology.orchestra.run.smithi012.stdout:5001 read 0x2c747cd thru 0x2c7b993 (0x71c7 bytes) 2024-09-11T05:23:00.689 INFO:teuthology.orchestra.run.smithi012.stdout:5002 write 0x88b35cb thru 0x88bafd1 (0x7a07 bytes) 2024-09-11T05:23:00.690 INFO:teuthology.orchestra.run.smithi012.stdout:5003 writesame 0x542b880 thru 0x5430ed6 data_size 0x17(0x5657 bytes) 2024-09-11T05:23:00.692 INFO:teuthology.orchestra.run.smithi012.stdout:5007 write 0xa9227df thru 0xa92f4cc (0xccee bytes) 2024-09-11T05:23:00.693 INFO:teuthology.orchestra.run.smithi012.stdout:5008 write 0x6f845d5 thru 0x6f8d9ff (0x942b bytes) 2024-09-11T05:23:00.695 INFO:teuthology.orchestra.run.smithi012.stdout:5009 writesame 0x3ee4589 thru 0x3eef594 data_size 0x26(0xb00c bytes) 2024-09-11T05:23:00.697 INFO:teuthology.orchestra.run.smithi012.stdout:5011 write 0x92c91b2 thru 0x92c9ced (0xb3c bytes) 2024-09-11T05:23:00.698 INFO:teuthology.orchestra.run.smithi012.stdout:5012 read 0x3471168 thru 0x3476198 (0x5031 bytes) 2024-09-11T05:23:00.711 INFO:teuthology.orchestra.run.smithi012.stdout:5013 trunc from 0xe41a2f5 to 0x3024c71 2024-09-11T05:23:00.726 INFO:teuthology.orchestra.run.smithi012.stdout:5014 trunc from 0x3024c71 to 0x1bd6495 2024-09-11T05:23:00.734 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:00.733+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:00.749 INFO:teuthology.orchestra.run.smithi012.stdout:5015 writesame 0x8c70490 thru 0x8c7cd38 data_size 0x1(0xc8a9 bytes) 2024-09-11T05:23:00.750 INFO:teuthology.orchestra.run.smithi012.stdout:5017 read 0x163a8ed thru 0x164a1f0 (0xf904 bytes) 2024-09-11T05:23:00.756 INFO:teuthology.orchestra.run.smithi012.stdout:5018 write 0x91aaaf6 thru 0x91b1073 (0x657e bytes) 2024-09-11T05:23:00.757 INFO:teuthology.orchestra.run.smithi012.stdout:5019 read 0x432ec8c thru 0x4335224 (0x6599 bytes) 2024-09-11T05:23:00.758 INFO:teuthology.orchestra.run.smithi012.stdout:5022 write 0x58f3e96 thru 0x58ff71f (0xb88a bytes) 2024-09-11T05:23:00.759 INFO:teuthology.orchestra.run.smithi012.stdout:5023 trunc from 0x91b1074 to 0x9431f84 2024-09-11T05:23:00.773 INFO:teuthology.orchestra.run.smithi012.stdout:5024 write 0xa9e044f thru 0xa9e5251 (0x4e03 bytes) 2024-09-11T05:23:00.774 INFO:teuthology.orchestra.run.smithi012.stdout:5026 punch from 0x8f67a9c to 0x8f67ad3, (0x37 bytes) 2024-09-11T05:23:00.774 INFO:teuthology.orchestra.run.smithi012.stdout:5027 punch from 0x450d0ff to 0x451c9f3, (0xf8f4 bytes) 2024-09-11T05:23:00.775 INFO:teuthology.orchestra.run.smithi012.stdout:5028 punch from 0x595625b to 0x5963a97, (0xd83c bytes) 2024-09-11T05:23:00.784 INFO:teuthology.orchestra.run.smithi012.stdout:5030 write 0xe73aa8d thru 0xe745a9a (0xb00e bytes) 2024-09-11T05:23:00.789 INFO:teuthology.orchestra.run.smithi012.stdout:5031 read 0x73b9f6b thru 0x73c443f (0xa4d5 bytes) 2024-09-11T05:23:00.790 INFO:teuthology.orchestra.run.smithi012.stdout:5032 read 0x749af73 thru 0x74a9a69 (0xeaf7 bytes) 2024-09-11T05:23:00.790 INFO:teuthology.orchestra.run.smithi012.stdout:5034 punch from 0xaf50730 to 0xaf5a15f, (0x9a2f bytes) 2024-09-11T05:23:00.791 INFO:teuthology.orchestra.run.smithi012.stdout:5035 punch from 0xd316d09 to 0xd322e42, (0xc139 bytes) 2024-09-11T05:23:00.791 INFO:teuthology.orchestra.run.smithi012.stdout:5037 writesame 0x819d7ec thru 0x81a0246 data_size 0x1(0x2a5b bytes) 2024-09-11T05:23:00.796 INFO:teuthology.orchestra.run.smithi012.stdout:5038 write 0xc53f0e4 thru 0xc544237 (0x5154 bytes) 2024-09-11T05:23:00.804 INFO:teuthology.orchestra.run.smithi012.stdout:5039 writesame 0xe413eff thru 0xe417c58 data_size 0x1(0x3d5a bytes) 2024-09-11T05:23:00.811 INFO:teuthology.orchestra.run.smithi012.stdout:5042 read 0x20c3647 thru 0x20cd036 (0x99f0 bytes) 2024-09-11T05:23:00.812 INFO:teuthology.orchestra.run.smithi012.stdout:5044 punch from 0x75a9838 to 0x75b385c, (0xa024 bytes) 2024-09-11T05:23:00.812 INFO:teuthology.orchestra.run.smithi012.stdout:5045 write 0x6852d24 thru 0x68607fb (0xdad8 bytes) 2024-09-11T05:23:00.813 INFO:teuthology.orchestra.run.smithi012.stdout:5046 punch from 0x29d4c42 to 0x29df0fa, (0xa4b8 bytes) 2024-09-11T05:23:00.813 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:00.814 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:00.818 INFO:teuthology.orchestra.run.smithi012.stdout:5049 write 0xebc85e4 thru 0xebd0176 (0x7b93 bytes) 2024-09-11T05:23:00.821 INFO:teuthology.orchestra.run.smithi012.stdout:5052 read 0xe8060d thru 0xe8b30b (0xacff bytes) 2024-09-11T05:23:00.822 INFO:teuthology.orchestra.run.smithi012.stdout:5054 read 0xbb16081 thru 0xbb19da0 (0x3d20 bytes) 2024-09-11T05:23:00.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:00.832 INFO:teuthology.orchestra.run.smithi012.stdout:5055 trunc from 0xebd0177 to 0x61af530 2024-09-11T05:23:00.834 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:00.834+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:00.847 INFO:teuthology.orchestra.run.smithi012.stdout:5056 read 0x343fb97 thru 0x3449c8f (0xa0f9 bytes) 2024-09-11T05:23:00.848 INFO:teuthology.orchestra.run.smithi012.stdout:5062 write 0xa4ef09 thru 0xa5b321 (0xc419 bytes) 2024-09-11T05:23:00.849 INFO:teuthology.orchestra.run.smithi012.stdout:5063 read 0x33196f4 thru 0x331e80b (0x5118 bytes) 2024-09-11T05:23:00.856 INFO:teuthology.orchestra.run.smithi012.stdout:5064 writesame 0x6d83c79 thru 0x6d8570f data_size 0x1(0x1a97 bytes) 2024-09-11T05:23:00.858 INFO:teuthology.orchestra.run.smithi012.stdout:5065 write 0x41539c1 thru 0x415f2e9 (0xb929 bytes) 2024-09-11T05:23:00.863 INFO:teuthology.orchestra.run.smithi012.stdout:5066 trunc from 0x6d85710 to 0x9ef59e0 2024-09-11T05:23:00.868 INFO:teuthology.orchestra.run.smithi012.stdout:5067 writesame 0x71e109 thru 0x723125 data_size 0x1(0x501d bytes) 2024-09-11T05:23:00.877 INFO:teuthology.orchestra.run.smithi012.stdout:5071 punch from 0x26b90e3 to 0x26c29a5, (0x98c2 bytes) 2024-09-11T05:23:00.877 INFO:teuthology.orchestra.run.smithi012.stdout:5072 read 0x828ca8f thru 0x828e25c (0x17ce bytes) 2024-09-11T05:23:00.878 INFO:teuthology.orchestra.run.smithi012.stdout:5075 write 0x2b3890a thru 0x2b45275 (0xc96c bytes) 2024-09-11T05:23:00.880 INFO:teuthology.orchestra.run.smithi012.stdout:5076 punch from 0x607e71a to 0x60867ab, (0x8091 bytes) 2024-09-11T05:23:00.880 INFO:teuthology.orchestra.run.smithi012.stdout:5077 read 0x8ff6f25 thru 0x8ff720c (0x2e8 bytes) 2024-09-11T05:23:00.880 INFO:teuthology.orchestra.run.smithi012.stdout:5078 read 0x84f4b85 thru 0x84faa59 (0x5ed5 bytes) 2024-09-11T05:23:00.881 INFO:teuthology.orchestra.run.smithi012.stdout:5079 writesame 0x4d59b1b thru 0x4d66019 data_size 0x25(0xc4ff bytes) 2024-09-11T05:23:00.882 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.882 INFO:teuthology.orchestra.run.smithi012.stdout:5082 read 0x62424eb thru 0x6244efb (0x2a11 bytes) 2024-09-11T05:23:00.882 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.883 INFO:teuthology.orchestra.run.smithi012.stdout:5085 punch from 0x4d7d332 to 0x4d89715, (0xc3e3 bytes) 2024-09-11T05:23:00.883 INFO:teuthology.orchestra.run.smithi012.stdout:5087 writesame 0x548d0ff thru 0x549463d data_size 0x57(0x753f bytes) 2024-09-11T05:23:00.884 INFO:teuthology.orchestra.run.smithi012.stdout:5089 read 0x5e5797e thru 0x5e5e03d (0x66c0 bytes) 2024-09-11T05:23:00.892 INFO:teuthology.orchestra.run.smithi012.stdout:5090 trunc from 0x9ef59e0 to 0x319421f 2024-09-11T05:23:00.915 INFO:teuthology.orchestra.run.smithi012.stdout:5092 write 0xa2659e0 thru 0xa272dca (0xd3eb bytes) 2024-09-11T05:23:00.923 INFO:teuthology.orchestra.run.smithi012.stdout:5093 write 0xb540897 thru 0xb5424dc (0x1c46 bytes) 2024-09-11T05:23:00.925 INFO:teuthology.orchestra.run.smithi012.stdout:5094 write 0x4b344ac thru 0x4b3a664 (0x61b9 bytes) 2024-09-11T05:23:00.932 INFO:teuthology.orchestra.run.smithi012.stdout:5095 write 0xbb67266 thru 0xbb71cc0 (0xaa5b bytes) 2024-09-11T05:23:00.933 INFO:teuthology.orchestra.run.smithi012.stdout:5096 read 0x117413f thru 0x11743ef (0x2b1 bytes) 2024-09-11T05:23:00.934 INFO:teuthology.orchestra.run.smithi012.stdout:5097 write 0x46e0ff3 thru 0x46e6f3e (0x5f4c bytes) 2024-09-11T05:23:00.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:00.934+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:00.944 INFO:teuthology.orchestra.run.smithi012.stdout:5098 write 0xe555d37 thru 0xe559ca1 (0x3f6b bytes) 2024-09-11T05:23:00.947 INFO:teuthology.orchestra.run.smithi012.stdout:5099 read 0x3b42da1 thru 0x3b4f3dc (0xc63c bytes) 2024-09-11T05:23:00.947 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.947 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.948 INFO:teuthology.orchestra.run.smithi012.stdout:5102 read 0x53cb3af thru 0x53d4128 (0x8d7a bytes) 2024-09-11T05:23:00.948 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.948 INFO:teuthology.orchestra.run.smithi012.stdout:5104 write 0x49a016a thru 0x49ad857 (0xd6ee bytes) 2024-09-11T05:23:00.949 INFO:teuthology.orchestra.run.smithi012.stdout:5105 read 0xb561b7d thru 0xb56db1d (0xbfa1 bytes) 2024-09-11T05:23:00.950 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:00.950 INFO:teuthology.orchestra.run.smithi012.stdout:5109 read 0xb9acbc3 thru 0xb9b5d5c (0x919a bytes) 2024-09-11T05:23:00.950 INFO:teuthology.orchestra.run.smithi012.stdout:5113 read 0x914680f thru 0x914f795 (0x8f87 bytes) 2024-09-11T05:23:00.955 INFO:teuthology.orchestra.run.smithi012.stdout:5114 trunc from 0xe559ca2 to 0xaf6c317 2024-09-11T05:23:00.958 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:00.958 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:00.969 INFO:teuthology.orchestra.run.smithi012.stdout:5115 punch from 0xa756b26 to 0xa7624e8, (0xb9c2 bytes) 2024-09-11T05:23:00.970 INFO:teuthology.orchestra.run.smithi012.stdout:5116 read 0x6272210 thru 0x62798ee (0x76df bytes) 2024-09-11T05:23:00.970 INFO:teuthology.orchestra.run.smithi012.stdout:5117 read 0x75da3a1 thru 0x75df3d6 (0x5036 bytes) 2024-09-11T05:23:00.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:00.971 INFO:teuthology.orchestra.run.smithi012.stdout:5118 write 0x22d003 thru 0x234962 (0x7960 bytes) 2024-09-11T05:23:00.972 INFO:teuthology.orchestra.run.smithi012.stdout:5119 write 0xa60f18c thru 0xa61ee91 (0xfd06 bytes) 2024-09-11T05:23:00.974 INFO:teuthology.orchestra.run.smithi012.stdout:5120 read 0x72df5c1 thru 0x72eb9a5 (0xc3e5 bytes) 2024-09-11T05:23:00.974 INFO:teuthology.orchestra.run.smithi012.stdout:5121 read 0x742693a thru 0x7427dc2 (0x1489 bytes) 2024-09-11T05:23:00.974 INFO:teuthology.orchestra.run.smithi012.stdout:5124 punch from 0x6e05139 to 0x6e0f755, (0xa61c bytes) 2024-09-11T05:23:00.974 INFO:teuthology.orchestra.run.smithi012.stdout:5125 clone 43 order 19 su 8192 sc 8 2024-09-11T05:23:01.036 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:01.035+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:01.078 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:01.078 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:01.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:01.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:01.136+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:01.194 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:01.195 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:01.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:01.237 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:01.237+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:01.339 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:01.338+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:01.350 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:01.350 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:01.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:01.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:01.438+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:01.466 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:23:01.467 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:01.467 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:01.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:01.540 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:01.540+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:01.618 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone42 from 0xaf6c317 (overlap 0x67f068) to 0x0 2024-09-11T05:23:01.639 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:01.639 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:01.641 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:01.640+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:01.650 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:01.670 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-11T05:23:01.742 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:01.742+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:01.756 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:01.756 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:01.762 INFO:teuthology.orchestra.run.smithi012.stdout:5127 writesame 0xafc9dea thru 0xafd0c11 data_size 0x8d(0x6e28 bytes) 2024-09-11T05:23:01.767 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:01.779 INFO:teuthology.orchestra.run.smithi012.stdout:5128 read 0x717639f thru 0x717d4c4 (0x7126 bytes) 2024-09-11T05:23:01.789 INFO:teuthology.orchestra.run.smithi012.stdout:5130 write 0xdb8a024 thru 0xdb99e80 (0xfe5d bytes) 2024-09-11T05:23:01.802 INFO:teuthology.orchestra.run.smithi012.stdout:5131 write 0xe908f66 thru 0xe9096eb (0x786 bytes) 2024-09-11T05:23:01.805 INFO:teuthology.orchestra.run.smithi012.stdout:5133 write 0xbe3fd48 thru 0xbe478b4 (0x7b6d bytes) 2024-09-11T05:23:01.811 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:01.811 INFO:teuthology.orchestra.run.smithi012.stdout:5135 punch from 0x3cf3764 to 0x3cfbc66, (0x8502 bytes) 2024-09-11T05:23:01.811 INFO:teuthology.orchestra.run.smithi012.stdout:5136 punch from 0xe36a327 to 0xe36ff0d, (0x5be6 bytes) 2024-09-11T05:23:01.811 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:01.816 INFO:teuthology.orchestra.run.smithi012.stdout:5138 trunc from 0xe9096ec to 0x9c8a4b1 2024-09-11T05:23:01.844 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:01.842+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:01.859 INFO:teuthology.orchestra.run.smithi012.stdout:5139 read 0x5d08eb5 thru 0x5d12c58 (0x9da4 bytes) 2024-09-11T05:23:01.870 INFO:teuthology.orchestra.run.smithi012.stdout:5140 write 0xe52a414 thru 0xe52dfcf (0x3bbc bytes) 2024-09-11T05:23:01.874 INFO:teuthology.orchestra.run.smithi012.stdout:5141 writesame 0xcbad717 thru 0xcbb18ae data_size 0x4(0x4198 bytes) 2024-09-11T05:23:01.878 INFO:teuthology.orchestra.run.smithi012.stdout:5142 write 0x32f2151 thru 0x32f3091 (0xf41 bytes) 2024-09-11T05:23:01.885 INFO:teuthology.orchestra.run.smithi012.stdout:5143 write 0x88d7905 thru 0x88e1395 (0x9a91 bytes) 2024-09-11T05:23:01.905 INFO:teuthology.orchestra.run.smithi012.stdout:5144 punch from 0x9d62b9d to 0x9d6b5b1, (0x8a14 bytes) 2024-09-11T05:23:01.919 INFO:teuthology.orchestra.run.smithi012.stdout:5145 trunc from 0xe52dfd0 to 0x2624001 2024-09-11T05:23:01.925 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:01.925 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:01.936 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:01.962 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:01.975 INFO:teuthology.orchestra.run.smithi012.stdout:5147 trunc from 0x2624001 to 0xdb7f9cf 2024-09-11T05:23:01.979 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:01.979+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:01.981 INFO:teuthology.orchestra.run.smithi012.stdout:5148 writesame 0xc903050 thru 0xc906686 data_size 0x1(0x3637 bytes) 2024-09-11T05:23:01.989 INFO:teuthology.orchestra.run.smithi012.stdout:5150 write 0x5058d13 thru 0x5066ece (0xe1bc bytes) 2024-09-11T05:23:02.008 INFO:teuthology.orchestra.run.smithi012.stdout:5151 trunc from 0xdb7f9cf to 0x443c236 2024-09-11T05:23:02.023 INFO:teuthology.orchestra.run.smithi012.stdout:5152 trunc from 0x443c236 to 0x1a209c2 2024-09-11T05:23:02.045 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:02.045+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:02.053 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:02.053 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:02.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:02.082 INFO:teuthology.orchestra.run.smithi012.stdout:5153 writesame 0x8b43d7d thru 0x8b4cb0b data_size 0x1f(0x8d8f bytes) 2024-09-11T05:23:02.092 INFO:teuthology.orchestra.run.smithi012.stdout:5154 write 0xc42d299 thru 0xc437e70 (0xabd8 bytes) 2024-09-11T05:23:02.106 INFO:teuthology.orchestra.run.smithi012.stdout:5157 write 0xc7dba29 thru 0xc7e1c51 (0x6229 bytes) 2024-09-11T05:23:02.110 INFO:teuthology.orchestra.run.smithi012.stdout:5158 read 0x40c1bbe thru 0x40cadf2 (0x9235 bytes) 2024-09-11T05:23:02.110 INFO:teuthology.orchestra.run.smithi012.stdout:5160 write 0xbf7f184 thru 0xbf85dd4 (0x6c51 bytes) 2024-09-11T05:23:02.115 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.115 INFO:teuthology.orchestra.run.smithi012.stdout:5163 read 0xb5f7a33 thru 0xb6040da (0xc6a8 bytes) 2024-09-11T05:23:02.124 INFO:teuthology.orchestra.run.smithi012.stdout:5164 trunc from 0xc7e1c52 to 0x4752c54 2024-09-11T05:23:02.136 INFO:teuthology.orchestra.run.smithi012.stdout:5167 read 0x3dd67d6 thru 0x3dd941a (0x2c45 bytes) 2024-09-11T05:23:02.146 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:02.145+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:02.150 INFO:teuthology.orchestra.run.smithi012.stdout:5168 write 0xc72bf11 thru 0xc72d2cc (0x13bc bytes) 2024-09-11T05:23:02.154 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.154 INFO:teuthology.orchestra.run.smithi012.stdout:5171 read 0x1d06bbc thru 0x1d09712 (0x2b57 bytes) 2024-09-11T05:23:02.154 INFO:teuthology.orchestra.run.smithi012.stdout:5172 write 0x37838d1 thru 0x378fb38 (0xc268 bytes) 2024-09-11T05:23:02.161 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.161 INFO:teuthology.orchestra.run.smithi012.stdout:5175 read 0x1e0c4f8 thru 0x1e1c071 (0xfb7a bytes) 2024-09-11T05:23:02.161 INFO:teuthology.orchestra.run.smithi012.stdout:5177 trunc from 0xc72d2cd to 0xc21ddc8 2024-09-11T05:23:02.171 INFO:teuthology.orchestra.run.smithi012.stdout:5179 read 0xc046fb4 thru 0xc04fcee (0x8d3b bytes) 2024-09-11T05:23:02.171 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.179 INFO:teuthology.orchestra.run.smithi012.stdout:5181 trunc from 0xc21ddc8 to 0x4e59cfb 2024-09-11T05:23:02.185 INFO:teuthology.orchestra.run.smithi012.stdout:5182 read 0x3d5bbb5 thru 0x3d6b49c (0xf8e8 bytes) 2024-09-11T05:23:02.185 INFO:teuthology.orchestra.run.smithi012.stdout:5183 punch from 0x3255236 to 0x3264740, (0xf50a bytes) 2024-09-11T05:23:02.192 INFO:teuthology.orchestra.run.smithi012.stdout:5184 writesame 0x5d2e5f0 thru 0x5d2fbc4 data_size 0x1b(0x15d5 bytes) 2024-09-11T05:23:02.192 INFO:teuthology.orchestra.run.smithi012.stdout:5185 punch from 0x2b246cc to 0x2b270dc, (0x2a10 bytes) 2024-09-11T05:23:02.201 INFO:teuthology.orchestra.run.smithi012.stdout:5187 writesame 0x922c64a thru 0x9235db0 data_size 0x31(0x9767 bytes) 2024-09-11T05:23:02.202 INFO:teuthology.orchestra.run.smithi012.stdout:5190 read 0x40d4aff thru 0x40de180 (0x9682 bytes) 2024-09-11T05:23:02.202 INFO:teuthology.orchestra.run.smithi012.stdout:5191 writesame 0x64a4ab1 thru 0x64ade35 data_size 0x53(0x9385 bytes) 2024-09-11T05:23:02.209 INFO:teuthology.orchestra.run.smithi012.stdout:5192 write 0x13c5e8b thru 0x13d5136 (0xf2ac bytes) 2024-09-11T05:23:02.227 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:02.228 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:02.238 INFO:teuthology.orchestra.run.smithi012.stdout:5193 read 0x11c86f0 thru 0x11c9ee5 (0x17f6 bytes) 2024-09-11T05:23:02.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:02.245 INFO:teuthology.orchestra.run.smithi012.stdout:5194 write 0x953958d thru 0x9543cd0 (0xa744 bytes) 2024-09-11T05:23:02.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:02.246+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:02.252 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.252 INFO:teuthology.orchestra.run.smithi012.stdout:5196 write 0x6e96846 thru 0x6ea217a (0xb935 bytes) 2024-09-11T05:23:02.261 INFO:teuthology.orchestra.run.smithi012.stdout:5197 trunc from 0x9543cd1 to 0xa259d75 2024-09-11T05:23:02.267 INFO:teuthology.orchestra.run.smithi012.stdout:5198 write 0x15fad3d thru 0x15fb868 (0xb2c bytes) 2024-09-11T05:23:02.274 INFO:teuthology.orchestra.run.smithi012.stdout:5201 write 0x6379b7e thru 0x637aa8c (0xf0f bytes) 2024-09-11T05:23:02.277 INFO:teuthology.orchestra.run.smithi012.stdout:5203 punch from 0x7dcea44 to 0x7ddb986, (0xcf42 bytes) 2024-09-11T05:23:02.283 INFO:teuthology.orchestra.run.smithi012.stdout:5205 trunc from 0xa259d75 to 0x4c1978b 2024-09-11T05:23:02.298 INFO:teuthology.orchestra.run.smithi012.stdout:5207 read 0x462cda8 thru 0x463b7cf (0xea28 bytes) 2024-09-11T05:23:02.305 INFO:teuthology.orchestra.run.smithi012.stdout:5208 writesame 0x65d7d7a thru 0x65e1e56 data_size 0x6f(0xa0dd bytes) 2024-09-11T05:23:02.305 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.308 INFO:teuthology.orchestra.run.smithi012.stdout:5210 trunc from 0x65e1e57 to 0x38443ee 2024-09-11T05:23:02.315 INFO:teuthology.orchestra.run.smithi012.stdout:5211 read 0x1e1305 thru 0x1eaf3b (0x9c37 bytes) 2024-09-11T05:23:02.320 INFO:teuthology.orchestra.run.smithi012.stdout:5213 trunc from 0x38443ee to 0x2caa4a 2024-09-11T05:23:02.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:02.347+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:02.355 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:02.356 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:02.356 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:02.365 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:02.395 INFO:teuthology.orchestra.run.smithi012.stdout:5215 trunc from 0x2caa4a to 0xbbcce35 2024-09-11T05:23:02.401 INFO:teuthology.orchestra.run.smithi012.stdout:5217 write 0xac8a368 thru 0xac8fac1 (0x575a bytes) 2024-09-11T05:23:02.406 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.406 INFO:teuthology.orchestra.run.smithi012.stdout:5219 write 0x83f41ff thru 0x83fbbe7 (0x79e9 bytes) 2024-09-11T05:23:02.448 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:02.448+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:02.473 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:02.473 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:02.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:02.488 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:02.489 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:02.506 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:02.506 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:02.522 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:02.538 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:02.555 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:02.555 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:02.559 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:23:02.566 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:02.566+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:02.576 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:02.576 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:02.594 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:02.594 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:02.610 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:02.611 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:02.613 INFO:teuthology.orchestra.run.smithi012.stdout:5220 punch from 0x559676a to 0x5599918, (0x31ae bytes) 2024-09-11T05:23:02.613 INFO:teuthology.orchestra.run.smithi012.stdout:5222 write 0x6a122f7 thru 0x6a172e6 (0x4ff0 bytes) 2024-09-11T05:23:02.619 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.619 INFO:teuthology.orchestra.run.smithi012.stdout:5224 read 0x5263f3 thru 0x528c23 (0x2831 bytes) 2024-09-11T05:23:02.619 INFO:teuthology.orchestra.run.smithi012.stdout:5225 write 0x3f19682 thru 0x3f1c216 (0x2b95 bytes) 2024-09-11T05:23:02.624 INFO:teuthology.orchestra.run.smithi012.stdout:5226 write 0x3b98477 thru 0x3b98ecc (0xa56 bytes) 2024-09-11T05:23:02.634 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:02.634 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:02.634 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:02.634 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:02.634 INFO:teuthology.orchestra.run.smithi012.stdout:5227 write 0xcc2c947 thru 0xcc30bc5 (0x427f bytes) 2024-09-11T05:23:02.640 INFO:teuthology.orchestra.run.smithi012.stdout:5229 read 0x52166b5 thru 0x521bd76 (0x56c2 bytes) 2024-09-11T05:23:02.644 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:02.646 INFO:teuthology.orchestra.run.smithi012.stdout:5231 write 0xd7bfbaa thru 0xd7c7a5c (0x7eb3 bytes) 2024-09-11T05:23:02.649 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:02.648+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:02.652 INFO:teuthology.orchestra.run.smithi012.stdout:5232 write 0x7d4efca thru 0x7d5240a (0x3441 bytes) 2024-09-11T05:23:02.657 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.657 INFO:teuthology.orchestra.run.smithi012.stdout:5235 write 0x2bf7e9e thru 0x2bfe540 (0x66a3 bytes) 2024-09-11T05:23:02.662 INFO:teuthology.orchestra.run.smithi012.stdout:5236 writesame 0x13bd858 thru 0x13c3de7 data_size 0x7d(0x6590 bytes) 2024-09-11T05:23:02.667 INFO:teuthology.orchestra.run.smithi012.stdout:5237 write 0xb981ce1 thru 0xb988868 (0x6b88 bytes) 2024-09-11T05:23:02.675 INFO:teuthology.orchestra.run.smithi012.stdout:5238 write 0x88f7125 thru 0x890465d (0xd539 bytes) 2024-09-11T05:23:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:5239 read 0xa2fab27 thru 0xa300501 (0x59db bytes) 2024-09-11T05:23:02.691 INFO:teuthology.orchestra.run.smithi012.stdout:5240 trunc from 0xd7c7a5d to 0x6888e34 2024-09-11T05:23:02.709 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.709 INFO:teuthology.orchestra.run.smithi012.stdout:5243 read 0x645f9c0 thru 0x6467422 (0x7a63 bytes) 2024-09-11T05:23:02.715 INFO:teuthology.orchestra.run.smithi012.stdout:5244 writesame 0x713cd33 thru 0x7143293 data_size 0x29(0x6561 bytes) 2024-09-11T05:23:02.715 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:02.715 INFO:teuthology.orchestra.run.smithi012.stdout:5247 read 0x702d647 thru 0x70355af (0x7f69 bytes) 2024-09-11T05:23:02.726 INFO:teuthology.orchestra.run.smithi012.stdout:5248 write 0xb4e0c12 thru 0xb4eebb8 (0xdfa7 bytes) 2024-09-11T05:23:02.736 INFO:teuthology.orchestra.run.smithi012.stdout:5249 read 0x52add9e thru 0x52b59c6 (0x7c29 bytes) 2024-09-11T05:23:02.736 INFO:teuthology.orchestra.run.smithi012.stdout:5250 read 0x38e3998 thru 0x38f30f4 (0xf75d bytes) 2024-09-11T05:23:02.737 INFO:teuthology.orchestra.run.smithi012.stdout:5251 punch from 0x6f84934 to 0x6f8960e, (0x4cda bytes) 2024-09-11T05:23:02.737 INFO:teuthology.orchestra.run.smithi012.stdout:5252 write 0xad3ce7e thru 0xad4c259 (0xf3dc bytes) 2024-09-11T05:23:02.745 INFO:teuthology.orchestra.run.smithi012.stdout:5253 read 0x949122b thru 0x949bbe0 (0xa9b6 bytes) 2024-09-11T05:23:02.745 INFO:teuthology.orchestra.run.smithi012.stdout:5256 write 0x90eea7b thru 0x90fac23 (0xc1a9 bytes) 2024-09-11T05:23:02.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:02.749+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:02.753 INFO:teuthology.orchestra.run.smithi012.stdout:5258 punch from 0x8a28299 to 0x8a2e01e, (0x5d85 bytes) 2024-09-11T05:23:02.761 INFO:teuthology.orchestra.run.smithi012.stdout:5259 write 0xd63e1ab thru 0xd64df57 (0xfdad bytes) 2024-09-11T05:23:02.784 INFO:teuthology.orchestra.run.smithi012.stdout:5261 trunc from 0xd64df58 to 0x1030ab1 2024-09-11T05:23:02.802 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:02.803 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:02.803 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:02.803 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:02.803 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:02.805 INFO:teuthology.orchestra.run.smithi012.stdout:5262 read 0xead765 thru 0xeb4bb4 (0x7450 bytes) 2024-09-11T05:23:02.805 INFO:teuthology.orchestra.run.smithi012.stdout:5263 clone 44 order 23 su 524288 sc 14 2024-09-11T05:23:02.811 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:02.855 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:02.855+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:02.916 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:02.916 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283463943999999, 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.917 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:02.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:23:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283454078, 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.922 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:02.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283429662, 2024-09-11T05:23:02.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:02.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:23:02.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283418374, 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.931 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:23:02.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.935 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283408854999999, 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:23:02.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.940 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283399497, 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:23:02.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:23:02.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283385615, 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.945 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283376047999999, 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:23:02.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283360218, 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283334460000001, 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:23:02.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283305802999999, 2024-09-11T05:23:02.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:02.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:23:02.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.28328097, 2024-09-11T05:23:02.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:02.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:02.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:23:02.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283263418000001, 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:23:02.974 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:23:02.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283253448, 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.979 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:23:02.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:23:02.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283243260000001, 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.983 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:02.987 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283233921000001, 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:02.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:23:02.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:23:02.991 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283224761, 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:02.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:23:02.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283213567000001, 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:23:02.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:02.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:23:03.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.002 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.283189626, 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.003 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:23:03.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:03.007 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.28317801, 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.011 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.012 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.012 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:03.013 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:03.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:03.013+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:03.113 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:03.113+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:03.157 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:03.157 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:03.157 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:03.157 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:03.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:03.214 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:03.213+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:03.310 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:03.310 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:03.311 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:03.311 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:03.311 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:03.315 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:03.315+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:03.320 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:03.416 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:03.415+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:03.426 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:23:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 94.674471205000003, 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059009863000000003, 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4207", 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/3863171997", 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750616+0000", 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750618+0000", 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.787e-06 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750633+0000", 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5588999999999999e-05 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750644+0000", 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0584000000000001e-05 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750654+0000", 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9580000000000002e-06 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750720+0000", 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6635000000000002e-05 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.750729+0000", 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0439999999999996e-06 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808199+0000", 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057470649999999998 2024-09-11T05:23:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808349+0000", 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014970000000000001 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.808516+0000", 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016747800000000001 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809342+0000", 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00082582700000000001 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809556+0000", 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021390299999999999 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809593+0000", 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6578000000000001e-05 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:28.809626+0000", 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3130000000000003e-05 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13312 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.671392643000004, 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017059356000000001, 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13312 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753694+0000", 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753695+0000", 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1799999999999995e-07 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753697+0000", 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.654e-06 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753703+0000", 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8939999999999998e-06 2024-09-11T05:23:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753707+0000", 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4229999999999998e-06 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770580+0000", 2024-09-11T05:23:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016873259000000002 2024-09-11T05:23:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770656+0000", 2024-09-11T05:23:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5360999999999999e-05 2024-09-11T05:23:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770754+0000", 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8246999999999996e-05 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13324 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.671375342999994, 2024-09-11T05:23:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017247512, 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13324 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:23:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753712+0000", 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753722+0000", 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0013000000000001e-05 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753728+0000", 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753732+0000", 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770795+0000", 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017063206000000001 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770863+0000", 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7701999999999997e-05 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770959+0000", 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6157999999999997e-05 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13327 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:23:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.671349308000003, 2024-09-11T05:23:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198699000000001, 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13327 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:23:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:23:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753738+0000", 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753740+0000", 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6899999999999999e-06 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753746+0000", 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753750+0000", 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770780+0000", 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017030857 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770845+0000", 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4958999999999999e-05 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770937+0000", 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1089999999999997e-05 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13335 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.671333082000004, 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017392168, 2024-09-11T05:23:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13335 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753754+0000", 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8500000000000002e-07 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753756+0000", 2024-09-11T05:23:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5090000000000001e-06 2024-09-11T05:23:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753766+0000", 2024-09-11T05:23:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0283e-05 2024-09-11T05:23:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753771+0000", 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.51e-06 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770997+0000", 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017226215999999999 2024-09-11T05:23:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771062+0000", 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4999000000000006e-05 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771146+0000", 2024-09-11T05:23:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4365999999999998e-05 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13336 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.671310625999993, 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017341200000000001, 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13336 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753777+0000", 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753779+0000", 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-11T05:23:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753785+0000", 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753789+0000", 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1740000000000002e-06 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.770987+0000", 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017198602 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771053+0000", 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5945999999999995e-05 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771118+0000", 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4480000000000006e-05 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13337 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.671276547000005, 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017529158, 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13337 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753811+0000", 2024-09-11T05:23:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:23:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753813+0000", 2024-09-11T05:23:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9999999999999999e-06 2024-09-11T05:23:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753819+0000", 2024-09-11T05:23:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9989999999999997e-06 2024-09-11T05:23:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753841+0000", 2024-09-11T05:23:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1696999999999999e-05 2024-09-11T05:23:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771185+0000", 2024-09-11T05:23:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344025999999998 2024-09-11T05:23:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771251+0000", 2024-09-11T05:23:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6256999999999999e-05 2024-09-11T05:23:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771340+0000", 2024-09-11T05:23:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8635999999999996e-05 2024-09-11T05:23:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13338 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:23:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.671238926000001, 2024-09-11T05:23:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017457341000000001, 2024-09-11T05:23:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13338 2024-09-11T05:23:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:23:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753848+0000", 2024-09-11T05:23:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753849+0000", 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2699999999999999e-07 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753851+0000", 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3120000000000001e-06 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753859+0000", 2024-09-11T05:23:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9719999999999992e-06 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.753868+0000", 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2099999999999999e-06 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771175+0000", 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017306531 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771241+0000", 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6229000000000006e-05 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771306+0000", 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4560000000000005e-05 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13345 3.d 3:b53e9d50:::rbd_data.1179262aa3d7.000000000000000f:5 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.670674086000005, 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017124627, 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13345 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754413+0000", 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754414+0000", 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9100000000000003e-07 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754417+0000", 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5990000000000002e-06 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754429+0000", 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1837e-05 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754436+0000", 2024-09-11T05:23:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:23:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771379+0000", 2024-09-11T05:23:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016943459000000001 2024-09-11T05:23:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771445+0000", 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5520999999999998e-05 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771538+0000", 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2999999999999997e-05 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:13346 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.670624988, 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017037448, 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 13346 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754462+0000", 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754463+0000", 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754465+0000", 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754472+0000", 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3209999999999999e-06 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.754477+0000", 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999998e-06 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771367+0000", 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016890100000000002 2024-09-11T05:23:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771432+0000", 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4950000000000007e-05 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:53.771500+0000", 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7187999999999994e-05 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15828 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:23:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.38596991, 2024-09-11T05:23:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017256246999999999, 2024-09-11T05:23:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15828 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:23:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039117+0000", 2024-09-11T05:23:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039118+0000", 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039120+0000", 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:23:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039126+0000", 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039131+0000", 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9609999999999996e-06 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.055968+0000", 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016837477999999999 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056044+0000", 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5673999999999994e-05 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056373+0000", 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032946000000000001 2024-09-11T05:23:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:15829 3.15 3:ab4f19cb:::rbd_data.117977dc529b.000000000000000a:8 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.385950292000004, 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017657738999999999, 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 15829 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039137+0000", 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-07 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039139+0000", 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039145+0000", 2024-09-11T05:23:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:23:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.039150+0000", 2024-09-11T05:23:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0170000000000004e-06 2024-09-11T05:23:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056416+0000", 2024-09-11T05:23:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017266607999999999 2024-09-11T05:23:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056488+0000", 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1334000000000005e-05 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.056795+0000", 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030675500000000003 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16055 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 32768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.383360237999995, 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016903472999999999, 2024-09-11T05:23:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16055 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:23:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041727+0000", 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041730+0000", 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4509999999999999e-06 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041736+0000", 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.041740+0000", 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058288+0000", 2024-09-11T05:23:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016547651 2024-09-11T05:23:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058353+0000", 2024-09-11T05:23:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5203000000000006e-05 2024-09-11T05:23:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.058630+0000", 2024-09-11T05:23:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027703500000000002 2024-09-11T05:23:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16067 3.15 3:a96fc7e1:::rbd_data.1179262aa3d7.0000000000000011:5 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:23:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.382930095999996, 2024-09-11T05:23:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016949483000000001, 2024-09-11T05:23:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16067 2024-09-11T05:23:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:23:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:23:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042157+0000", 2024-09-11T05:23:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042164+0000", 2024-09-11T05:23:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.365e-06 2024-09-11T05:23:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042171+0000", 2024-09-11T05:23:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042176+0000", 2024-09-11T05:23:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5160000000000002e-06 2024-09-11T05:23:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059004+0000", 2024-09-11T05:23:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016827809999999999 2024-09-11T05:23:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059042+0000", 2024-09-11T05:23:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8383000000000002e-05 2024-09-11T05:23:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059107+0000", 2024-09-11T05:23:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4277999999999997e-05 2024-09-11T05:23:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:16068 3.15 3:a99ec39e:::rbd_data.1179262aa3d7.0000000000000013:5 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-11T05:23:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:23:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.382895676000004, 2024-09-11T05:23:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017100529, 2024-09-11T05:23:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 16068 2024-09-11T05:23:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:23:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042191+0000", 2024-09-11T05:23:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042192+0000", 2024-09-11T05:23:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:23:03.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042194+0000", 2024-09-11T05:23:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.458e-06 2024-09-11T05:23:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042201+0000", 2024-09-11T05:23:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5980000000000002e-06 2024-09-11T05:23:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.042206+0000", 2024-09-11T05:23:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4040000000000003e-06 2024-09-11T05:23:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059138+0000", 2024-09-11T05:23:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016931656999999999 2024-09-11T05:23:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059206+0000", 2024-09-11T05:23:03.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8219000000000005e-05 2024-09-11T05:23:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.059292+0000", 2024-09-11T05:23:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5768999999999998e-05 2024-09-11T05:23:03.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:16594 3.16 e32/22 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:head v 32'205, mlcod=32'203)", 2024-09-11T05:23:03.528 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:23:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.331805361999997, 2024-09-11T05:23:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027502064, 2024-09-11T05:23:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.529 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:23:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093282+0000", 2024-09-11T05:23:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.093283+0000", 2024-09-11T05:23:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5889999999999999e-06 2024-09-11T05:23:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096795+0000", 2024-09-11T05:23:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003511428 2024-09-11T05:23:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096828+0000", 2024-09-11T05:23:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2805999999999997e-05 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096841+0000", 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3682999999999999e-05 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096931+0000", 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.009e-05 2024-09-11T05:23:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.096958+0000", 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6754000000000002e-05 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120734+0000", 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023776241 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:54.120784+0000", 2024-09-11T05:23:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9472999999999999e-05 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:59623 3.16 e40/22 3:6c35ac6e:::rbd_data.117971c15f82.0000000000000003:head v 40'255, mlcod=40'253)", 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.261353745000001, 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019060482, 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163733+0000", 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.163735+0000", 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9250000000000002e-06 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166480+0000", 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027445690000000001 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166508+0000", 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7997999999999999e-05 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166539+0000", 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0825999999999999e-05 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166625+0000", 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5852000000000004e-05 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.166653+0000", 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8600999999999999e-05 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182745+0000", 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016091691000000002 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:04.182794+0000", 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9020000000000002e-05 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:63898 3.11 3:89620d31:::rbd_data.117960679f52.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.304283814000001, 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019709826999999999, 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 63898 2024-09-11T05:23:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120803+0000", 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120804+0000", 2024-09-11T05:23:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120808+0000", 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.89e-06 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120817+0000", 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120821+0000", 2024-09-11T05:23:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5619999999999997e-06 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120858+0000", 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6863999999999998e-05 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.120951+0000", 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2541999999999996e-05 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:23:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.124305+0000", 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00335389 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140413+0000", 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016108245 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140444+0000", 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1578000000000002e-05 2024-09-11T05:23:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140482+0000", 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:12.140513+0000", 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1477999999999999e-05 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4473.0:70954 3.14 e57/22 3:2fcfd35d:::rbd_data.1179db619f31.0000000000000009:head v 57'288, mlcod=56'286)", 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.459518592999999, 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023605603999999999, 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965569+0000", 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.965570+0000", 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7630000000000001e-06 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971434+0000", 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058634300000000002 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971457+0000", 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3436999999999999e-05 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971471+0000", 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3776e-05 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971538+0000", 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7074000000000002e-05 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.971565+0000", 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6914e-05 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989115+0000", 2024-09-11T05:23:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017549754000000001 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:21.989174+0000", 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9456000000000001e-05 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:71938 3.f 3:f110c0b8:::rbd_data.1179db619f31.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:23:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.925340141, 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027012653000000001, 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 71938 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:03.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499747+0000", 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499748+0000", 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499752+0000", 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499762+0000", 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7610000000000002e-06 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499767+0000", 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.118e-06 2024-09-11T05:23:03.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499813+0000", 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6168999999999998e-05 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.499871+0000", 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8394999999999999e-05 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 4", 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.503877+0000", 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040059290000000001 2024-09-11T05:23:03.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526608+0000", 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022730899999999998 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526628+0000", 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9556e-05 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:03.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526686+0000", 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7839e-05 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:22.526760+0000", 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4146000000000005e-05 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:03.557 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:03.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:03.559 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:03.558+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:03.642 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone43 from 0x1030ab1 (overlap 0x2caa4a) to 0x8eedb 2024-09-11T05:23:03.659 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:03.659+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:03.689 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:03.689 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:03.698 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:03.712 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-11T05:23:03.727 INFO:teuthology.orchestra.run.smithi012.stdout:5264 write 0x4486080 thru 0x448bb17 (0x5a98 bytes) 2024-09-11T05:23:03.731 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:03.731 INFO:teuthology.orchestra.run.smithi012.stdout:5266 read 0xb7f198 thru 0xb8cc4e (0xdab7 bytes) 2024-09-11T05:23:03.731 INFO:teuthology.orchestra.run.smithi012.stdout:5267 read 0x267ce74 thru 0x2686c4c (0x9dd9 bytes) 2024-09-11T05:23:03.732 INFO:teuthology.orchestra.run.smithi012.stdout:5269 read 0x346bab0 thru 0x346e12f (0x2680 bytes) 2024-09-11T05:23:03.735 INFO:teuthology.orchestra.run.smithi012.stdout:5270 trunc from 0x448bb18 to 0x2b9d7d 2024-09-11T05:23:03.760 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:03.759+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:03.767 INFO:teuthology.orchestra.run.smithi012.stdout:5271 trunc from 0x2b9d7d to 0x81d1a0d 2024-09-11T05:23:03.773 INFO:teuthology.orchestra.run.smithi012.stdout:5276 write 0x465d0a5 thru 0x465d271 (0x1cd bytes) 2024-09-11T05:23:03.781 INFO:teuthology.orchestra.run.smithi012.stdout:5278 write 0x9976b20 thru 0x9980d4e (0xa22f bytes) 2024-09-11T05:23:03.785 INFO:teuthology.orchestra.run.smithi012.stdout:5279 punch from 0x14e1011 to 0x14e9222, (0x8211 bytes) 2024-09-11T05:23:03.785 INFO:teuthology.orchestra.run.smithi012.stdout:5280 write 0x3663247 thru 0x366ad90 (0x7b4a bytes) 2024-09-11T05:23:03.795 INFO:teuthology.orchestra.run.smithi012.stdout:5281 writesame 0xbbdb101 thru 0xbbe94c9 data_size 0x1(0xe3c9 bytes) 2024-09-11T05:23:03.796 INFO:teuthology.orchestra.run.smithi012.stdout:5282 trunc from 0xbbe94ca to 0xb1cb838 2024-09-11T05:23:03.804 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:03.816 INFO:teuthology.orchestra.run.smithi012.stdout:5285 write 0xeda554a thru 0xedaa8e0 (0x5397 bytes) 2024-09-11T05:23:03.817 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:03.817 INFO:teuthology.orchestra.run.smithi012.stdout:5287 write 0x2dd004e thru 0x2dde61b (0xe5ce bytes) 2024-09-11T05:23:03.821 INFO:teuthology.orchestra.run.smithi012.stdout:5288 write 0xc68079 thru 0xc7562e (0xd5b6 bytes) 2024-09-11T05:23:03.823 INFO:teuthology.orchestra.run.smithi012.stdout:5289 punch from 0x8fd80f0 to 0x8fe0532, (0x8442 bytes) 2024-09-11T05:23:03.823 INFO:teuthology.orchestra.run.smithi012.stdout:5292 write 0x5c06a67 thru 0x5c0d0df (0x6679 bytes) 2024-09-11T05:23:03.825 INFO:teuthology.orchestra.run.smithi012.stdout:5294 read 0x515300a thru 0x51560d9 (0x30d0 bytes) 2024-09-11T05:23:03.825 INFO:teuthology.orchestra.run.smithi012.stdout:5296 read 0xc4f8125 thru 0xc506532 (0xe40e bytes) 2024-09-11T05:23:03.825 INFO:teuthology.orchestra.run.smithi012.stdout:5297 punch from 0x6eb5024 to 0x6ec2d2b, (0xdd07 bytes) 2024-09-11T05:23:03.825 INFO:teuthology.orchestra.run.smithi012.stdout:5298 write 0xdd1c56 thru 0xdd1fd4 (0x37f bytes) 2024-09-11T05:23:03.827 INFO:teuthology.orchestra.run.smithi012.stdout:5299 writesame 0x80fccf thru 0x81edac data_size 0x81(0xf0de bytes) 2024-09-11T05:23:03.828 INFO:teuthology.orchestra.run.smithi012.stdout:5301 punch from 0x9c241d6 to 0x9c2ff4f, (0xbd79 bytes) 2024-09-11T05:23:03.829 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:03.829 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:03.829 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:03.829 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:03.829 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:5303 trunc from 0xedaa8e1 to 0xbe8d2e9 2024-09-11T05:23:03.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:03.843 INFO:teuthology.orchestra.run.smithi012.stdout:5304 read 0x39f9b90 thru 0x39fdfbb (0x442c bytes) 2024-09-11T05:23:03.846 INFO:teuthology.orchestra.run.smithi012.stdout:5305 trunc from 0xbe8d2e9 to 0xb0c0066 2024-09-11T05:23:03.852 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:03.852 INFO:teuthology.orchestra.run.smithi012.stdout:5307 read 0x36960b7 thru 0x3698611 (0x255b bytes) 2024-09-11T05:23:03.852 INFO:teuthology.orchestra.run.smithi012.stdout:5308 writesame 0x3cb8820 thru 0x3cc4f72 data_size 0x49(0xc753 bytes) 2024-09-11T05:23:03.855 INFO:teuthology.orchestra.run.smithi012.stdout:5309 writesame 0x56ca7c0 thru 0x56d30e9 data_size 0x2(0x892a bytes) 2024-09-11T05:23:03.861 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:03.860+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:03.865 INFO:teuthology.orchestra.run.smithi012.stdout:5310 read 0x9b61644 thru 0x9b657f3 (0x41b0 bytes) 2024-09-11T05:23:03.866 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:03.866 INFO:teuthology.orchestra.run.smithi012.stdout:5312 write 0x4785d81 thru 0x478e1e7 (0x8467 bytes) 2024-09-11T05:23:03.867 INFO:teuthology.orchestra.run.smithi012.stdout:5313 write 0x13fd9d2 thru 0x14028a6 (0x4ed5 bytes) 2024-09-11T05:23:03.871 INFO:teuthology.orchestra.run.smithi012.stdout:5314 write 0x2c7da1f thru 0x2c823e8 (0x49ca bytes) 2024-09-11T05:23:03.880 INFO:teuthology.orchestra.run.smithi012.stdout:5319 writesame 0xca8fcd8 thru 0xca927e0 data_size 0x1(0x2b09 bytes) 2024-09-11T05:23:03.882 INFO:teuthology.orchestra.run.smithi012.stdout:5320 read 0x9f93909 thru 0x9f9c520 (0x8c18 bytes) 2024-09-11T05:23:03.882 INFO:teuthology.orchestra.run.smithi012.stdout:5321 write 0x11c2dd9 thru 0x11cd8aa (0xaad2 bytes) 2024-09-11T05:23:03.883 INFO:teuthology.orchestra.run.smithi012.stdout:5322 write 0xbdb789f thru 0xbdbd6d6 (0x5e38 bytes) 2024-09-11T05:23:03.886 INFO:teuthology.orchestra.run.smithi012.stdout:5323 read 0x48439cb thru 0x4847cd2 (0x4308 bytes) 2024-09-11T05:23:03.891 INFO:teuthology.orchestra.run.smithi012.stdout:5325 trunc from 0xca927e1 to 0x913692c 2024-09-11T05:23:03.909 INFO:teuthology.orchestra.run.smithi012.stdout:5328 write 0xe7d716f thru 0xe7e152c (0xa3be bytes) 2024-09-11T05:23:03.912 INFO:teuthology.orchestra.run.smithi012.stdout:5330 read 0xd8b1acc thru 0xd8c0b41 (0xf076 bytes) 2024-09-11T05:23:03.912 INFO:teuthology.orchestra.run.smithi012.stdout:5331 read 0x2f4e1f5 thru 0x2f5ce56 (0xec62 bytes) 2024-09-11T05:23:03.913 INFO:teuthology.orchestra.run.smithi012.stdout:5332 punch from 0x1d7d173 to 0x1d8bee4, (0xed71 bytes) 2024-09-11T05:23:03.913 INFO:teuthology.orchestra.run.smithi012.stdout:5333 write 0x8ef990e thru 0x8efa86c (0xf5f bytes) 2024-09-11T05:23:03.916 INFO:teuthology.orchestra.run.smithi012.stdout:5336 write 0x77e06b0 thru 0x77eb3e2 (0xad33 bytes) 2024-09-11T05:23:03.917 INFO:teuthology.orchestra.run.smithi012.stdout:5337 write 0xacd5b9 thru 0xad826d (0xacb5 bytes) 2024-09-11T05:23:03.919 INFO:teuthology.orchestra.run.smithi012.stdout:5341 writesame 0xb744790 thru 0xb74a637 data_size 0x34(0x5ea8 bytes) 2024-09-11T05:23:03.922 INFO:teuthology.orchestra.run.smithi012.stdout:5342 punch from 0xdee4f91 to 0xdef27b2, (0xd821 bytes) 2024-09-11T05:23:03.922 INFO:teuthology.orchestra.run.smithi012.stdout:5343 read 0x43d6bce thru 0x43dda70 (0x6ea3 bytes) 2024-09-11T05:23:03.922 INFO:teuthology.orchestra.run.smithi012.stdout:5344 read 0x1c8d786 thru 0x1c9b374 (0xdbef bytes) 2024-09-11T05:23:03.923 INFO:teuthology.orchestra.run.smithi012.stdout:5348 write 0xc13e215 thru 0xc146bac (0x8998 bytes) 2024-09-11T05:23:03.926 INFO:teuthology.orchestra.run.smithi012.stdout:5350 read 0x3f43013 thru 0x3f45c96 (0x2c84 bytes) 2024-09-11T05:23:03.931 INFO:teuthology.orchestra.run.smithi012.stdout:5352 trunc from 0xe7e152d to 0x9deff55 2024-09-11T05:23:03.949 INFO:teuthology.orchestra.run.smithi012.stdout:5353 writesame 0xa23628d thru 0xa23f213 data_size 0x1d(0x8f87 bytes) 2024-09-11T05:23:03.950 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:03.950 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:03.957 INFO:teuthology.orchestra.run.smithi012.stdout:5357 write 0xb8ea92b thru 0xb8f33af (0x8a85 bytes) 2024-09-11T05:23:03.961 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:03.961+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:03.965 INFO:teuthology.orchestra.run.smithi012.stdout:5358 write 0xc17cca6 thru 0xc186372 (0x96cd bytes) 2024-09-11T05:23:03.969 INFO:teuthology.orchestra.run.smithi012.stdout:5359 punch from 0x10ccdae to 0x10d095c, (0x3bae bytes) 2024-09-11T05:23:03.969 INFO:teuthology.orchestra.run.smithi012.stdout:5360 write 0x8307c57 thru 0x8316722 (0xeacc bytes) 2024-09-11T05:23:03.972 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:03.972 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:03.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:03.972 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:03.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.972 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.4321568029999998, 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:03.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "MOSDPGPush(3.14 88/87 [PushOp(3:2956cba7:::rbd_data.117968ef4d31.0000000000000000:head, version: 77'358, data_included: [0~196608,458752~131072,851968~196608,1310720~131072,1703936~196608,2162688~131072,2555904~65536], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2956cba7:::rbd_data.117968ef4d31.0000000000000000:head@77'358, size: 4297944, copy_subset: [(0, 4297944)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2621440, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:57.460283+0000", 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 6.5106425899999998, 2024-09-11T05:23:03.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002673918, 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.460283+0000", 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.460283+0000", 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:03.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.460283+0000", 2024-09-11T05:23:03.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2799999999999995e-07 2024-09-11T05:23:03.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.461257+0000", 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00097396600000000005 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.461275+0000", 2024-09-11T05:23:03.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7946000000000001e-05 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.461288+0000", 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2309e-05 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.461375+0000", 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7182000000000007e-05 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.461390+0000", 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5221999999999999e-05 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.462957+0000", 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001566465 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "MOSDPGPush(3.14 88/87 [PushOp(3:2956cba7:::rbd_data.117968ef4d31.0000000000000000:head, version: 77'358, data_included: [2621440~131072,3014656~131072,3153920~16384,3178496~16384,3203072~16384,3227648~16384,3252224~16384,3276800~16384,3301376~16384,3325952~16384,3350528~16384,3375104~16384,3399680~622592], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:2956cba7:::rbd_data.117968ef4d31.0000000000000000:head@77'358, size: 4297944, copy_subset: [(0, 4297944)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4022272, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2621440, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:57.464081+0000", 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 6.5068443160000005, 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002885543, 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.464081+0000", 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.464081+0000", 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.464082+0000", 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.206e-06 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.465071+0000", 2024-09-11T05:23:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00098851100000000008 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.465088+0000", 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7584999999999999e-05 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.465102+0000", 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3634e-05 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.465200+0000", 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8082e-05 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.465215+0000", 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5258e-05 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.466966+0000", 2024-09-11T05:23:03.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017512669999999999 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:118791 3.14 e89/87 3:2c2d5e08:::rbd_data.11794481904f.0000000000000016:head v 89'397, mlcod=86'395)", 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:58.768027+0000", 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.2028978859999997, 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0020649290000000001, 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.987 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.768027+0000", 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.768027+0000", 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.768028+0000", 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0669999999999999e-06 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.769126+0000", 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010974120000000001 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.769139+0000", 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3158e-05 2024-09-11T05:23:03.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.769146+0000", 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4240000000000004e-06 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.769211+0000", 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4467000000000005e-05 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.769236+0000", 2024-09-11T05:23:03.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5361999999999999e-05 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.770040+0000", 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00080427099999999996 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.770092+0000", 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1768000000000003e-05 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:118966 3.1a e89/87 3:5d83da73:::rbd_data.11794481904f.0000000000000017:head v 89'187, mlcod=89'185)", 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:58.898996+0000", 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.0719291110000002, 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0023002420000000001, 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:03.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.898996+0000", 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.898996+0000", 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.898997+0000", 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1319999999999999e-06 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.899020+0000", 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2682999999999999e-05 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.899035+0000", 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5164000000000001e-05 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.899044+0000", 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:23:03.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.899104+0000", 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0551999999999999e-05 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.899128+0000", 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3998999999999998e-05 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.901261+0000", 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0021328150000000001 2024-09-11T05:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.901296+0000", 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5264e-05 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:118974 3.0 e89/87 3:07826f21:::rbd_data.11794481904f.0000000000000000:head v 89'377, mlcod=89'375)", 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:58.930235+0000", 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.0406898660000001, 2024-09-11T05:23:03.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0034585110000000001, 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930235+0000", 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930235+0000", 2024-09-11T05:23:03.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930236+0000", 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3600000000000003e-07 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930243+0000", 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930255+0000", 2024-09-11T05:23:03.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1909000000000001e-05 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930261+0000", 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7580000000000003e-06 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930328+0000", 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6438000000000003e-05 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930348+0000", 2024-09-11T05:23:03.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0344e-05 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.933663+0000", 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033146510000000001 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.933694+0000", 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1131999999999999e-05 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.000 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:118976 3.0 e89/87 3:04ba2066:::rbd_data.11794481904f.0000000000000002:head v 89'378, mlcod=89'375)", 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:58.930332+0000", 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.0405935700000004, 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0033787729999999998, 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930332+0000", 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930332+0000", 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930332+0000", 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930346+0000", 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4183e-05 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930354+0000", 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5270000000000001e-06 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930358+0000", 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6720000000000003e-06 2024-09-11T05:23:04.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930678+0000", 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00031995800000000002 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.930697+0000", 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8267e-05 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.933696+0000", 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029994499999999999 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.933710+0000", 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4415e-05 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.14 epoch 89/87 rep_tid 1098 entries 89'402 (0'0) error 3:2c594444:::rbd_data.11794481904f.0000000000000005:head by client.4473.0:119021 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 89'400)", 2024-09-11T05:23:04.005 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:58.996098+0000", 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.9748276200000001, 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0036174290000000001, 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.996098+0000", 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.996098+0000", 2024-09-11T05:23:04.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.996099+0000", 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.28e-06 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.996116+0000", 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7430000000000001e-05 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.996148+0000", 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1618000000000001e-05 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.996164+0000", 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.626e-05 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.996256+0000", 2024-09-11T05:23:04.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1768000000000006e-05 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:58.999715+0000", 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003459073 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:119288 3.0 e89/87 3:04ba2066:::rbd_data.11794481904f.0000000000000002:head v 89'399, mlcod=89'396)", 2024-09-11T05:23:04.009 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:59.304622+0000", 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.6663036619999998, 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025518110000000002, 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304622+0000", 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304622+0000", 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304622+0000", 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9700000000000002e-07 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304629+0000", 2024-09-11T05:23:04.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3699999999999997e-06 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304639+0000", 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2490000000000007e-06 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304645+0000", 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0310000000000004e-06 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304693+0000", 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7978e-05 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.304713+0000", 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0659e-05 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.307132+0000", 2024-09-11T05:23:04.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0024191239999999999 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.307173+0000", 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1003e-05 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:119379 3.1a e89/87 3:5896191e:::rbd_data.11794481904f.0000000000000001:head v 89'205, mlcod=89'203)", 2024-09-11T05:23:04.014 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:59.364165+0000", 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.6067606850000002, 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002026094, 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364165+0000", 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364165+0000", 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364165+0000", 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364170+0000", 2024-09-11T05:23:04.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.814e-06 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364178+0000", 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1620000000000008e-06 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364184+0000", 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.84e-06 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364288+0000", 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010425999999999999 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364308+0000", 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0400000000000001e-05 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.366151+0000", 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0018424629999999999 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.366191+0000", 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9779e-05 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:119380 3.0 e89/87 3:04ba2066:::rbd_data.11794481904f.0000000000000002:head v 89'406, mlcod=89'403)", 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:59.364263+0000", 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.6066625999999999, 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002182612, 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364263+0000", 2024-09-11T05:23:04.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364263+0000", 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364263+0000", 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364268+0000", 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8010000000000003e-06 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364276+0000", 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3259999999999996e-06 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364281+0000", 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2700000000000004e-06 2024-09-11T05:23:04.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364424+0000", 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014295200000000001 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.364451+0000", 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6894999999999999e-05 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.366406+0000", 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0019551960000000002 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.366445+0000", 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8763999999999997e-05 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:119425 3.0 e90/87 3:04ba2066:::rbd_data.11794481904f.0000000000000002:head v 90'408, mlcod=89'405)", 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:59.418841+0000", 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.5520841269999996, 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003128128, 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418841+0000", 2024-09-11T05:23:04.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418841+0000", 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418842+0000", 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1699999999999997e-07 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418848+0000", 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418860+0000", 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2294e-05 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418868+0000", 2024-09-11T05:23:04.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4540000000000001e-06 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418914+0000", 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6115999999999997e-05 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418933+0000", 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9491e-05 2024-09-11T05:23:04.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.421931+0000", 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029981970000000002 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.421969+0000", 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7799000000000002e-05 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "pg_update_log_missing(3.1a epoch 90/87 rep_tid 1355 entries 90'206 (0'0) error 3:5896191e:::rbd_data.11794481904f.0000000000000001:head by client.4473.0:119424 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 89'204)", 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:59.418911+0000", 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 4.5520138960000001, 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0030544790000000001, 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418911+0000", 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418911+0000", 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418912+0000", 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6899999999999998e-07 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418919+0000", 2024-09-11T05:23:04.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8210000000000004e-06 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418935+0000", 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.6218999999999998e-05 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.418950+0000", 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4922999999999999e-05 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.419032+0000", 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2465000000000004e-05 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:59.421966+0000", 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0029335820000000001 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.034 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:124354 3.9 3:9180f4c5:::rbd_data.1179c9069d12.00000000000000d2:head [set-alloc-hint object_size 524288 write_size 524288,write 270336~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:02.616858+0000", 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.3540676650000001, 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031208429999999999, 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 124354 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616858+0000", 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616858+0000", 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616860+0000", 2024-09-11T05:23:04.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.153e-06 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616875+0000", 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5801e-05 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616894+0000", 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8040999999999999e-05 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616901+0000", 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6249999999999998e-06 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616966+0000", 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5141000000000005e-05 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op must wait for map", 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.616984+0000", 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8185e-05 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.618438+0000", 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001453354 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.618562+0000", 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012368000000000001 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 1", 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.618693+0000", 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00013098799999999999 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.619555+0000", 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086286800000000003 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.619889+0000", 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00033337900000000002 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.619938+0000", 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9666999999999997e-05 2024-09-11T05:23:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.619978+0000", 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9960999999999999e-05 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:124591 3.9 3:95c4fb15:::rbd_data.1179c9069d12.000000000000007d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:02.786826+0000", 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.1840987860000001, 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002060311, 2024-09-11T05:23:04.041 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 124591 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.786826+0000", 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.786826+0000", 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.786829+0000", 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2759999999999999e-06 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.786838+0000", 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2180000000000005e-06 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.786862+0000", 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3796000000000001e-05 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.786876+0000", 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3957e-05 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787007+0000", 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00013087 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787115+0000", 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108662 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 1", 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787224+0000", 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108729 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.788122+0000", 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00089818700000000005 2024-09-11T05:23:04.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.788790+0000", 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00066810800000000005 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.788840+0000", 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9851000000000001e-05 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.788887+0000", 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6656999999999997e-05 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:124587 3.14 e93/87 3:2a6886b2:::rbd_data.1179c9069d12.0000000000000056:head v 93'461, mlcod=93'459)", 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:02.787776+0000", 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.183149327, 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001762305, 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.047 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787776+0000", 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787776+0000", 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787777+0000", 2024-09-11T05:23:04.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0979999999999999e-06 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787788+0000", 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0692e-05 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787799+0000", 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1780000000000001e-05 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787806+0000", 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787875+0000", 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9262000000000002e-05 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.787901+0000", 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5599e-05 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.789496+0000", 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0015950910000000001 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.789538+0000", 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2002999999999997e-05 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.051 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:124609 3.9 3:974f854d:::rbd_data.1179c9069d12.000000000000015e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:02.792126+0000", 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.1787988949999999, 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002070555, 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 124609 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792126+0000", 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792126+0000", 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792127+0000", 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.006e-06 2024-09-11T05:23:04.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792132+0000", 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6380000000000003e-06 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792146+0000", 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4416000000000001e-05 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792153+0000", 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0199999999999997e-06 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792208+0000", 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4206999999999998e-05 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792287+0000", 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9740000000000006e-05 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 1", 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.792392+0000", 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105089 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.793215+0000", 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00082238700000000005 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.794110+0000", 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000894982 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.794159+0000", 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8890000000000001e-05 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:02.794197+0000", 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8179999999999997e-05 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:124928 3.1a e94/87 3:5a6db355:::rbd_data.117966066e90.0000000000000000:head v 94'233, mlcod=93'231)", 2024-09-11T05:23:04.057 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:03.748248+0000", 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.22267695500000001, 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003001161, 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748248+0000", 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748248+0000", 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748248+0000", 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-07 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748675+0000", 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00042604200000000001 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748689+0000", 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4786999999999999e-05 2024-09-11T05:23:04.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748698+0000", 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8729999999999996e-06 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748769+0000", 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-05 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.748783+0000", 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4296e-05 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.751205+0000", 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.002421992 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.751249+0000", 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4183e-05 2024-09-11T05:23:04.061 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:124930 3.0 e94/87 3:047604c1:::rbd_data.117966066e90.0000000000000001:head v 94'457, mlcod=93'455)", 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:03.749605+0000", 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.221319975, 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0019228369999999999, 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749605+0000", 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749605+0000", 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749606+0000", 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.032e-06 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749862+0000", 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025570500000000001 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749875+0000", 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2839e-05 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749880+0000", 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9030000000000003e-06 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749947+0000", 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7372000000000005e-05 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.749972+0000", 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4975000000000001e-05 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.751489+0000", 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0015165700000000001 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.751528+0000", 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9440999999999997e-05 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:124933 3.1a e94/87 3:5a91945c:::rbd_data.117966066e90.0000000000000004:head v 94'234, mlcod=93'231)", 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:03.752247+0000", 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.21867864300000001, 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001762764, 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:04.066 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752247+0000", 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752247+0000", 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752247+0000", 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0200000000000001e-07 2024-09-11T05:23:04.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752865+0000", 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00061797499999999999 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752883+0000", 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7345000000000001e-05 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752893+0000", 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0122000000000001e-05 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752955+0000", 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1807e-05 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.752976+0000", 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1812999999999999e-05 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.753962+0000", 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00098604199999999991 2024-09-11T05:23:04.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:03.754009+0000", 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6958e-05 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.070 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:04.071 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.071 INFO:teuthology.orchestra.run.smithi012.stdout:5363 trunc from 0xc186373 to 0x6c9b6e6 2024-09-11T05:23:04.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:04.074 INFO:teuthology.orchestra.run.smithi012.stdout:5364 read 0x3037657 thru 0x30468f4 (0xf29e bytes) 2024-09-11T05:23:04.074 INFO:teuthology.orchestra.run.smithi012.stdout:5365 writesame 0x142aa5f thru 0x142ae76 data_size 0x4(0x418 bytes) 2024-09-11T05:23:04.074 INFO:teuthology.orchestra.run.smithi012.stdout:5366 writesame 0xdcf5c7b thru 0xdd04a7a data_size 0x88(0xee00 bytes) 2024-09-11T05:23:04.074 INFO:teuthology.orchestra.run.smithi012.stdout:5367 punch from 0xdc321b9 to 0xdc34668, (0x24af bytes) 2024-09-11T05:23:04.074 INFO:teuthology.orchestra.run.smithi012.stdout:5368 write 0x6394f69 thru 0x6396f1d (0x1fb5 bytes) 2024-09-11T05:23:04.074 INFO:teuthology.orchestra.run.smithi012.stdout:5369 read 0x2da182e thru 0x2da5a0d (0x41e0 bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5370 writesame 0x953dcf6 thru 0x953f3a3 data_size 0x1(0x16ae bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5374 read 0xa5f2be3 thru 0xa5fb070 (0x848e bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5376 trunc from 0xdd04a7b to 0x29ef8aa 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5377 punch from 0x1ae1a to 0x2408f, (0x9275 bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5380 trunc from 0x29ef8aa to 0x8e4be2a 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5381 write 0xb03e4f thru 0xb134a5 (0xf657 bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5383 writesame 0xd62ae72 thru 0xd63844c data_size 0x63(0xd5db bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5384 read 0xaf6e5ad thru 0xaf71b0f (0x3563 bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5385 read 0x82c96ef thru 0x82d252c (0x8e3e bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5386 write 0x3e3df5d thru 0x3e4330e (0x53b2 bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:5387 read 0x7e86d71 thru 0x7e94b7f (0xde0f bytes) 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.075 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.076 INFO:teuthology.orchestra.run.smithi012.stdout:5393 writesame 0x443e45 thru 0x44fdca data_size 0x5(0xbf86 bytes) 2024-09-11T05:23:04.077 INFO:teuthology.orchestra.run.smithi012.stdout:5394 punch from 0x77869ad to 0x7788df2, (0x2445 bytes) 2024-09-11T05:23:04.077 INFO:teuthology.orchestra.run.smithi012.stdout:5396 read 0x530e8b5 thru 0x530f454 (0xba0 bytes) 2024-09-11T05:23:04.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:04.076+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:04.090 INFO:teuthology.orchestra.run.smithi012.stdout:5398 trunc from 0xd63844d to 0x166cd67 2024-09-11T05:23:04.118 INFO:teuthology.orchestra.run.smithi012.stdout:5399 write 0xb89d5a8 thru 0xb8a3fe7 (0x6a40 bytes) 2024-09-11T05:23:04.121 INFO:teuthology.orchestra.run.smithi012.stdout:5400 punch from 0x6248fe9 to 0x624f8a6, (0x68bd bytes) 2024-09-11T05:23:04.121 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.121 INFO:teuthology.orchestra.run.smithi012.stdout:5402 punch from 0x1e920f to 0x1f04d8, (0x72c9 bytes) 2024-09-11T05:23:04.121 INFO:teuthology.orchestra.run.smithi012.stdout:5403 read 0x3910d58 thru 0x3919d5d (0x9006 bytes) 2024-09-11T05:23:04.124 INFO:teuthology.orchestra.run.smithi012.stdout:5404 trunc from 0xb8a3fe8 to 0xdb2f7e3 2024-09-11T05:23:04.130 INFO:teuthology.orchestra.run.smithi012.stdout:5405 read 0xa42a3dd thru 0xa4361b2 (0xbdd6 bytes) 2024-09-11T05:23:04.130 INFO:teuthology.orchestra.run.smithi012.stdout:5406 write 0x843c241 thru 0x844256b (0x632b bytes) 2024-09-11T05:23:04.134 INFO:teuthology.orchestra.run.smithi012.stdout:5407 read 0x2f61cd4 thru 0x2f63a46 (0x1d73 bytes) 2024-09-11T05:23:04.135 INFO:teuthology.orchestra.run.smithi012.stdout:5408 read 0x8a1e388 thru 0x8a26838 (0x84b1 bytes) 2024-09-11T05:23:04.135 INFO:teuthology.orchestra.run.smithi012.stdout:5409 writesame 0x1f77678 thru 0x1f85a37 data_size 0x20(0xe3c0 bytes) 2024-09-11T05:23:04.139 INFO:teuthology.orchestra.run.smithi012.stdout:5411 write 0x4ae0fe3 thru 0x4aea8ff (0x991d bytes) 2024-09-11T05:23:04.152 INFO:teuthology.orchestra.run.smithi012.stdout:5412 trunc from 0xdb2f7e3 to 0x36c98ef 2024-09-11T05:23:04.174 INFO:teuthology.orchestra.run.smithi012.stdout:5413 trunc from 0x36c98ef to 0xa6b9649 2024-09-11T05:23:04.174 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:04.173+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:04.180 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.180 INFO:teuthology.orchestra.run.smithi012.stdout:5417 read 0x4b287c6 thru 0x4b2f70e (0x6f49 bytes) 2024-09-11T05:23:04.180 INFO:teuthology.orchestra.run.smithi012.stdout:5418 write 0x4712fee thru 0x471ffaf (0xcfc2 bytes) 2024-09-11T05:23:04.182 INFO:teuthology.orchestra.run.smithi012.stdout:5419 write 0x87d93fe thru 0x87e1e56 (0x8a59 bytes) 2024-09-11T05:23:04.185 INFO:teuthology.orchestra.run.smithi012.stdout:5420 write 0x4bbb22 thru 0x4c4c0e (0x90ed bytes) 2024-09-11T05:23:04.187 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.187 INFO:teuthology.orchestra.run.smithi012.stdout:5422 write 0x19cf073 thru 0x19dd994 (0xe922 bytes) 2024-09-11T05:23:04.188 INFO:teuthology.orchestra.run.smithi012.stdout:5423 writesame 0x3d37a9c thru 0x3d41d62 data_size 0x1(0xa2c7 bytes) 2024-09-11T05:23:04.204 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:04.204 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:04.204 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:04.204 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:04.207 INFO:teuthology.orchestra.run.smithi012.stdout:5424 trunc from 0xa6b9649 to 0xb3cc842 2024-09-11T05:23:04.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:04.224 INFO:teuthology.orchestra.run.smithi012.stdout:5425 write 0xdedb44a thru 0xdee2b36 (0x76ed bytes) 2024-09-11T05:23:04.227 INFO:teuthology.orchestra.run.smithi012.stdout:5426 read 0xa775e0e thru 0xa7818fb (0xbaee bytes) 2024-09-11T05:23:04.232 INFO:teuthology.orchestra.run.smithi012.stdout:5427 write 0xe3ed0a8 thru 0xe3f7589 (0xa4e2 bytes) 2024-09-11T05:23:04.236 INFO:teuthology.orchestra.run.smithi012.stdout:5429 read 0x608fef1 thru 0x6096c7a (0x6d8a bytes) 2024-09-11T05:23:04.252 INFO:teuthology.orchestra.run.smithi012.stdout:5430 trunc from 0xe3f758a to 0x5b3df0 2024-09-11T05:23:04.271 INFO:teuthology.orchestra.run.smithi012.stdout:5432 read 0x4bb4c1 thru 0x4c46c8 (0x9208 bytes) 2024-09-11T05:23:04.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:04.275+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:04.290 INFO:teuthology.orchestra.run.smithi012.stdout:5433 write 0xbb545b8 thru 0xbb5d53b (0x8f84 bytes) 2024-09-11T05:23:04.300 INFO:teuthology.orchestra.run.smithi012.stdout:5434 write 0xc8dc494 thru 0xc8e6d3a (0xa8a7 bytes) 2024-09-11T05:23:04.305 INFO:teuthology.orchestra.run.smithi012.stdout:5435 punch from 0x33faf46 to 0x3406ffc, (0xc0b6 bytes) 2024-09-11T05:23:04.305 INFO:teuthology.orchestra.run.smithi012.stdout:5436 read 0x59bf301 thru 0x59c6299 (0x6f99 bytes) 2024-09-11T05:23:04.305 INFO:teuthology.orchestra.run.smithi012.stdout:5437 write 0xbd8fd29 thru 0xbd93000 (0x32d8 bytes) 2024-09-11T05:23:04.310 INFO:teuthology.orchestra.run.smithi012.stdout:5438 punch from 0xc85aa51 to 0xc8682fa, (0xd8a9 bytes) 2024-09-11T05:23:04.322 INFO:teuthology.orchestra.run.smithi012.stdout:5441 trunc from 0xc8e6d3b to 0x25fd4c6 2024-09-11T05:23:04.342 INFO:teuthology.orchestra.run.smithi012.stdout:5442 read 0x5e5a61 thru 0x5ed8af (0x7e4f bytes) 2024-09-11T05:23:04.342 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.342 INFO:teuthology.orchestra.run.smithi012.stdout:5445 read 0x45c0ce thru 0x464b7a (0x8aad bytes) 2024-09-11T05:23:04.351 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:04.351 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:04.351 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:04.351 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:04.351 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:04.353 INFO:teuthology.orchestra.run.smithi012.stdout:5446 write 0x5cd99ec thru 0x5ce6037 (0xc64c bytes) 2024-09-11T05:23:04.354 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.355 INFO:teuthology.orchestra.run.smithi012.stdout:5449 punch from 0x365c828 to 0x366c54a, (0xfd22 bytes) 2024-09-11T05:23:04.362 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:04.363 INFO:teuthology.orchestra.run.smithi012.stdout:5450 writesame 0x7a7a5ba thru 0x7a7d66a data_size 0xf(0x30b1 bytes) 2024-09-11T05:23:04.363 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.363 INFO:teuthology.orchestra.run.smithi012.stdout:5452 write 0x3a4c59d thru 0x3a4d944 (0x13a8 bytes) 2024-09-11T05:23:04.364 INFO:teuthology.orchestra.run.smithi012.stdout:5453 read 0x3dc118f thru 0x3dcd65c (0xc4ce bytes) 2024-09-11T05:23:04.372 INFO:teuthology.orchestra.run.smithi012.stdout:5454 trunc from 0x7a7d66b to 0xe39cb27 2024-09-11T05:23:04.377 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:04.377+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:04.378 INFO:teuthology.orchestra.run.smithi012.stdout:5456 read 0x431c28f thru 0x431ee22 (0x2b94 bytes) 2024-09-11T05:23:04.378 INFO:teuthology.orchestra.run.smithi012.stdout:5458 writesame 0x7c4f413 thru 0x7c51dbc data_size 0x1(0x29aa bytes) 2024-09-11T05:23:04.385 INFO:teuthology.orchestra.run.smithi012.stdout:5460 write 0x3219032 thru 0x321ef50 (0x5f1f bytes) 2024-09-11T05:23:04.388 INFO:teuthology.orchestra.run.smithi012.stdout:5462 read 0x784e45b thru 0x7853bf5 (0x579b bytes) 2024-09-11T05:23:04.388 INFO:teuthology.orchestra.run.smithi012.stdout:5463 punch from 0x13c1be to 0x146787, (0xa5c9 bytes) 2024-09-11T05:23:04.388 INFO:teuthology.orchestra.run.smithi012.stdout:5464 trunc from 0xe39cb27 to 0xe5612c6 2024-09-11T05:23:04.393 INFO:teuthology.orchestra.run.smithi012.stdout:5465 punch from 0x84e92f4 to 0x84f1d54, (0x8a60 bytes) 2024-09-11T05:23:04.393 INFO:teuthology.orchestra.run.smithi012.stdout:5466 read 0xc516293 thru 0xc51ad99 (0x4b07 bytes) 2024-09-11T05:23:04.396 INFO:teuthology.orchestra.run.smithi012.stdout:5468 trunc from 0xe5612c6 to 0xb490726 2024-09-11T05:23:04.403 INFO:teuthology.orchestra.run.smithi012.stdout:5469 read 0x6fa1e9b thru 0x6fac28d (0xa3f3 bytes) 2024-09-11T05:23:04.403 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:04.407 INFO:teuthology.orchestra.run.smithi012.stdout:5471 trunc from 0xb490726 to 0x7d3a70f 2024-09-11T05:23:04.414 INFO:teuthology.orchestra.run.smithi012.stdout:5473 read 0x1cc603b thru 0x1ccac7b (0x4c41 bytes) 2024-09-11T05:23:04.414 INFO:teuthology.orchestra.run.smithi012.stdout:5475 writesame 0x26398bc thru 0x263f18b data_size 0x70(0x58d0 bytes) 2024-09-11T05:23:04.415 INFO:teuthology.orchestra.run.smithi012.stdout:5476 read 0x5a7ca7 thru 0x5ab9bf (0x3d19 bytes) 2024-09-11T05:23:04.416 INFO:teuthology.orchestra.run.smithi012.stdout:5479 read 0xf68a3c thru 0xf69ed6 (0x149b bytes) 2024-09-11T05:23:04.429 INFO:teuthology.orchestra.run.smithi012.stdout:5481 writesame 0xdb8e321 thru 0xdb9b131 data_size 0x1(0xce11 bytes) 2024-09-11T05:23:04.429 INFO:teuthology.orchestra.run.smithi012.stdout:5482 punch from 0x3dcf336 to 0x3dd324f, (0x3f19 bytes) 2024-09-11T05:23:04.430 INFO:teuthology.orchestra.run.smithi012.stdout:5483 write 0xbd8a2a9 thru 0xbd90151 (0x5ea9 bytes) 2024-09-11T05:23:04.432 INFO:teuthology.orchestra.run.smithi012.stdout:5484 read 0xbcbc97a thru 0xbccb641 (0xecc8 bytes) 2024-09-11T05:23:04.438 INFO:teuthology.orchestra.run.smithi012.stdout:5485 trunc from 0xdb9b132 to 0x83dd6fe 2024-09-11T05:23:04.446 INFO:teuthology.orchestra.run.smithi012.stdout:5487 clone 45 order 18 su 8192 sc 3 2024-09-11T05:23:04.477 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:04.477+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:04.483 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:04.483 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:04.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:04.483 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87567 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 961536~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855423+0000", 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.626950605999999, 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053338561, 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87567 2024-09-11T05:23:04.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855423+0000", 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855423+0000", 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855424+0000", 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.11e-07 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855425+0000", 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1400000000000001e-06 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855428+0000", 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9720000000000001e-06 2024-09-11T05:23:04.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855430+0000", 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.503e-06 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908475+0000", 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053044306999999999 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908656+0000", 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000181509 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908762+0000", 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105919 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87568 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 965632~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.626940957, 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053522581999999999, 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.489 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87568 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855433+0000", 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855434+0000", 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.052e-06 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855437+0000", 2024-09-11T05:23:04.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.847e-06 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855440+0000", 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6089999999999999e-06 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908792+0000", 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053352175000000002 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908883+0000", 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1005e-05 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.908956+0000", 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2582000000000004e-05 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.493 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87569 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 969728~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.626931164, 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054409762, 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87569 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855444+0000", 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0920000000000001e-06 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855447+0000", 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0460000000000001e-06 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855450+0000", 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4719999999999998e-06 2024-09-11T05:23:04.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909576+0000", 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054126062000000003 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909737+0000", 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016113600000000001 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909853+0000", 2024-09-11T05:23:04.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000115753 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87570 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 973824~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.626921429999999, 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054576539, 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87570 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855454+0000", 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0690000000000001e-06 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855457+0000", 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8540000000000001e-06 2024-09-11T05:23:04.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855459+0000", 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5840000000000002e-06 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909924+0000", 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054464789999999999 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909974+0000", 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9761e-05 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910029+0000", 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5274e-05 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87571 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 977920~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.502 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.626911184000001, 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054738976000000002, 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87571 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856482+0000", 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010191530000000001 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856487+0000", 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4889999999999997e-06 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856497+0000", 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0922e-05 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856505+0000", 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9310000000000008e-06 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910066+0000", 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053560732999999999 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910138+0000", 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1897999999999995e-05 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910202+0000", 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3849999999999993e-05 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.506 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87572 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 982016~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.625856528, 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053903670000000001, 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87572 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.507 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856518+0000", 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:23:04.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856520+0000", 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3700000000000002e-06 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856528+0000", 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5560000000000002e-06 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856535+0000", 2024-09-11T05:23:04.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000002e-06 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910254+0000", 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053718984999999997 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910332+0000", 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8529000000000007e-05 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910421+0000", 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8881000000000005e-05 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87573 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 986112~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.625816602, 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054081785, 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87573 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856558+0000", 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2799999999999996e-07 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856560+0000", 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:23:04.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856569+0000", 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1650000000000006e-06 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856574+0000", 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.66e-06 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910464+0000", 2024-09-11T05:23:04.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053890170000000001 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910564+0000", 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9239000000000003e-05 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910639+0000", 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5642000000000005e-05 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87574 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 990208~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.625791738, 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054248939000000003, 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87574 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856583+0000", 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856585+0000", 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2979999999999999e-06 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856592+0000", 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8419999999999999e-06 2024-09-11T05:23:04.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856598+0000", 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7679999999999997e-06 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910671+0000", 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054073259999999998 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910762+0000", 2024-09-11T05:23:04.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0661999999999994e-05 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910831+0000", 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9614000000000001e-05 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87575 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 994304~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.625769203000001, 2024-09-11T05:23:04.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054432912, 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87575 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:04.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.522 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856608+0000", 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856614+0000", 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.754e-06 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856619+0000", 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8600000000000001e-06 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910864+0000", 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054244522000000003 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910966+0000", 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010207100000000001 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911038+0000", 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2026000000000005e-05 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.524 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87576 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 998400~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.625747642, 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054624032000000003, 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.525 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87576 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856627+0000", 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856633+0000", 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6309999999999997e-06 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856641+0000", 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3590000000000002e-06 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856646+0000", 2024-09-11T05:23:04.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6450000000000002e-06 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911076+0000", 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054429098000000002 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911174+0000", 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8098999999999997e-05 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911250+0000", 2024-09-11T05:23:04.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6779000000000005e-05 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87577 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1002496~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.625719003, 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054805804999999999, 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.529 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87577 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:23:04.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858484+0000", 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001829156 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858489+0000", 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5430000000000004e-06 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858506+0000", 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7221999999999999e-05 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858513+0000", 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1189999999999999e-06 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911306+0000", 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.052792736999999999 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911393+0000", 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6996000000000005e-05 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911461+0000", 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8032000000000002e-05 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87580 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1014784~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.533 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623788138, 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053501471000000002, 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87580 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.534 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858586+0000", 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858588+0000", 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.041e-06 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858594+0000", 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1419999999999998e-06 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858599+0000", 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:04.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911921+0000", 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053321674999999999 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912006+0000", 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5346000000000006e-05 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912087+0000", 2024-09-11T05:23:04.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0968000000000001e-05 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87581 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1018880~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623767953, 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053676728999999999, 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.538 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87581 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858606+0000", 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858608+0000", 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858615+0000", 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858619+0000", 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6029999999999998e-06 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912116+0000", 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053497057000000001 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912202+0000", 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5968000000000001e-05 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912283+0000", 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0483999999999997e-05 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.542 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87582 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1022976~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623747858, 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053904077000000002, 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87582 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858627+0000", 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858629+0000", 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5170000000000002e-06 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858637+0000", 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0949999999999996e-06 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858643+0000", 2024-09-11T05:23:04.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4820000000000002e-06 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912312+0000", 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053669728999999999 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912426+0000", 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011409 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912530+0000", 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010378300000000001 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87583 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1027072~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623703994, 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054053339999999998, 2024-09-11T05:23:04.547 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87583 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858671+0000", 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858673+0000", 2024-09-11T05:23:04.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5129999999999999e-06 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858680+0000", 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.306e-06 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858686+0000", 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2619999999999998e-06 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912560+0000", 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053874440000000003 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912644+0000", 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4141999999999995e-05 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912723+0000", 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9129999999999996e-05 2024-09-11T05:23:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87584 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1031168~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623679565, 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054250643000000001, 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.552 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87584 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:23:04.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858695+0000", 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.15e-07 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858697+0000", 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7540000000000001e-06 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858701+0000", 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0419999999999996e-06 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858703+0000", 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6769999999999999e-06 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912759+0000", 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054055976999999998 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912848+0000", 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8962999999999995e-05 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912945+0000", 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6815000000000001e-05 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.556 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87585 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1035264~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623667055, 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054449115999999999, 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87585 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1799999999999999e-07 2024-09-11T05:23:04.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858708+0000", 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.22e-06 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858711+0000", 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0259999999999999e-06 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858714+0000", 2024-09-11T05:23:04.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5040000000000001e-06 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912983+0000", 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054268782000000002 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913070+0000", 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7428000000000004e-05 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913156+0000", 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5938000000000003e-05 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87586 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1039360~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623657035000001, 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.055576961000000001, 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87586 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858718+0000", 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1459999999999999e-06 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858721+0000", 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.982e-06 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858724+0000", 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913571+0000", 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054847185 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914218+0000", 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064685000000000003 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914294+0000", 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6118000000000005e-05 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.565 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87587 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1043456~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.623647159000001, 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.055819203999999997, 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87587 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860496+0000", 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001768875 2024-09-11T05:23:04.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860501+0000", 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860513+0000", 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1972e-05 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860520+0000", 2024-09-11T05:23:04.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2830000000000004e-06 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914342+0000", 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053821890999999997 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914440+0000", 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8579000000000006e-05 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914546+0000", 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105703 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87588 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1047552~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.621822504000001, 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054198646000000003, 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:04.570 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87588 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:04.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860559+0000", 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.357e-06 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:04.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860568+0000", 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7020000000000007e-06 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860574+0000", 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.28e-06 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914590+0000", 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054015781999999998 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914680+0000", 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0050999999999996e-05 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914750+0000", 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9887000000000004e-05 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:04.574 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:04.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:23:04.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:04.578 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:04.578+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:04.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:04.643 INFO:teuthology.orchestra.run.smithi012.stdout:flattening image image_client.0-clone44 2024-09-11T05:23:04.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:04.685+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:04.740 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:04.740 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:04.740 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:04.740 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:04.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:04.767 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-11T05:23:04.772 INFO:teuthology.orchestra.run.smithi012.stdout:5488 writesame 0x365c648 thru 0x366b48d data_size 0x7(0xee46 bytes) 2024-09-11T05:23:04.781 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:04.781+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:04.794 INFO:teuthology.orchestra.run.smithi012.stdout:5492 trunc from 0x83dd6fe to 0xac611b1 2024-09-11T05:23:04.801 INFO:teuthology.orchestra.run.smithi012.stdout:5493 read 0x6068136 thru 0x6068ff3 (0xebe bytes) 2024-09-11T05:23:04.801 INFO:teuthology.orchestra.run.smithi012.stdout:5494 read 0x3a3f792 thru 0x3a4f1db (0xfa4a bytes) 2024-09-11T05:23:04.803 INFO:teuthology.orchestra.run.smithi012.stdout:5495 punch from 0x6c54421 to 0x6c5f6f3, (0xb2d2 bytes) 2024-09-11T05:23:04.804 INFO:teuthology.orchestra.run.smithi012.stdout:5496 read 0x59e62b1 thru 0x59f2289 (0xbfd9 bytes) 2024-09-11T05:23:04.808 INFO:teuthology.orchestra.run.smithi012.stdout:5497 trunc from 0xac611b1 to 0x7ba0d1b 2024-09-11T05:23:04.819 INFO:teuthology.orchestra.run.smithi012.stdout:5498 read 0x383939e thru 0x383ded3 (0x4b36 bytes) 2024-09-11T05:23:04.820 INFO:teuthology.orchestra.run.smithi012.stdout:5500 read 0x2730f9b thru 0x2734b01 (0x3b67 bytes) 2024-09-11T05:23:04.822 INFO:teuthology.orchestra.run.smithi012.stdout:5501 trunc from 0x7ba0d1b to 0x5f9b703 2024-09-11T05:23:04.845 INFO:teuthology.orchestra.run.smithi012.stdout:5502 write 0xc5576b thru 0xc5ec56 (0x94ec bytes) 2024-09-11T05:23:04.882 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:04.881+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:04.894 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:04.895 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:04.895 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:04.895 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:04.895 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:04.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:04.983 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:04.983+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:04.995 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:04.995 INFO:teuthology.orchestra.run.smithi012.stdout:5503 write 0xd908330 thru 0xd914c87 (0xc958 bytes) 2024-09-11T05:23:05.011 INFO:teuthology.orchestra.run.smithi012.stdout:5504 trunc from 0xd914c88 to 0x326aaeb 2024-09-11T05:23:05.016 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:05.040 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:05.041 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:05.045 INFO:teuthology.orchestra.run.smithi012.stdout:5505 write 0x329a55c thru 0x32a7acb (0xd570 bytes) 2024-09-11T05:23:05.053 INFO:teuthology.orchestra.run.smithi012.stdout:5506 trunc from 0x32a7acc to 0x8e4c46e 2024-09-11T05:23:05.060 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:05.060 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:05.061 INFO:teuthology.orchestra.run.smithi012.stdout:5507 writesame 0xe8b4f6 thru 0xe9b120 data_size 0x1(0xfc2b bytes) 2024-09-11T05:23:05.077 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:05.077 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:05.083 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:05.083 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:05.082+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:05.086 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:05.087 INFO:teuthology.orchestra.run.smithi012.stdout:5509 read 0x41cc53b thru 0x41d1e23 (0x58e9 bytes) 2024-09-11T05:23:05.087 INFO:teuthology.orchestra.run.smithi012.stdout:5510 punch from 0x8ac8e07 to 0x8aca9f7, (0x1bf0 bytes) 2024-09-11T05:23:05.087 INFO:teuthology.orchestra.run.smithi012.stdout:5512 writesame 0x63ed01c thru 0x63fc02f data_size 0x23(0xf014 bytes) 2024-09-11T05:23:05.092 INFO:teuthology.orchestra.run.smithi012.stdout:5513 writesame 0x5129b0b thru 0x5139507 data_size 0x1(0xf9fd bytes) 2024-09-11T05:23:05.109 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:05.109 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:05.123 INFO:teuthology.orchestra.run.smithi012.stdout:5515 write 0xcd8dfdb thru 0xcd98ab8 (0xaade bytes) 2024-09-11T05:23:05.129 INFO:teuthology.orchestra.run.smithi012.stdout:5516 write 0xc071976 thru 0xc07acce (0x9359 bytes) 2024-09-11T05:23:05.130 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:05.134 INFO:teuthology.orchestra.run.smithi012.stdout:5518 write 0x34af643 thru 0x34b3e9d (0x485b bytes) 2024-09-11T05:23:05.150 INFO:teuthology.orchestra.run.smithi012.stdout:5519 trunc from 0xcd98ab9 to 0x2d60487 2024-09-11T05:23:05.151 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:05.151 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:05.183 INFO:teuthology.orchestra.run.smithi012.stdout:5520 punch from 0x951d22 to 0x95ecbf, (0xcf9d bytes) 2024-09-11T05:23:05.184 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:05.184+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:05.196 INFO:teuthology.orchestra.run.smithi012.stdout:5521 write 0x94bdf3c thru 0x94c7182 (0x9247 bytes) 2024-09-11T05:23:05.201 INFO:teuthology.orchestra.run.smithi012.stdout:5522 writesame 0x5873844 thru 0x5873c2f data_size 0x2(0x3ec bytes) 2024-09-11T05:23:05.204 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:05.204 INFO:teuthology.orchestra.run.smithi012.stdout:5524 read 0x33eb799 thru 0x33f6542 (0xadaa bytes) 2024-09-11T05:23:05.204 INFO:teuthology.orchestra.run.smithi012.stdout:5525 write 0x6f61be5 thru 0x6f61d1f (0x13b bytes) 2024-09-11T05:23:05.207 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:05.207 INFO:teuthology.orchestra.run.smithi012.stdout:5527 punch from 0x339b9bb to 0x33aaff6, (0xf63b bytes) 2024-09-11T05:23:05.207 INFO:teuthology.orchestra.run.smithi012.stdout:5531 read 0x2db0e8c thru 0x2db220d (0x1382 bytes) 2024-09-11T05:23:05.207 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:05.207 INFO:teuthology.orchestra.run.smithi012.stdout:5534 read 0x3ed4f01 thru 0x3edae47 (0x5f47 bytes) 2024-09-11T05:23:05.207 INFO:teuthology.orchestra.run.smithi012.stdout:5535 read 0x554fabe thru 0x555cda5 (0xd2e8 bytes) 2024-09-11T05:23:05.208 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:05.216 INFO:teuthology.orchestra.run.smithi012.stdout:5537 write 0xc6b912f thru 0xc6c386d (0xa73f bytes) 2024-09-11T05:23:05.229 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:05.230 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:05.231 INFO:teuthology.orchestra.run.smithi012.stdout:5538 trunc from 0xc6c386e to 0x5170e1d 2024-09-11T05:23:05.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:05.258 INFO:teuthology.orchestra.run.smithi012.stdout:5539 writesame 0xdc621d0 thru 0xdc63968 data_size 0x1(0x1799 bytes) 2024-09-11T05:23:05.266 INFO:teuthology.orchestra.run.smithi012.stdout:5540 trunc from 0xdc63969 to 0x6b53573 2024-09-11T05:23:05.272 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:05.272 INFO:teuthology.orchestra.run.smithi012.stdout:5544 write 0x2729a77 thru 0x2738e6d (0xf3f7 bytes) 2024-09-11T05:23:05.285 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:05.285+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:05.292 INFO:teuthology.orchestra.run.smithi012.stdout:5545 write 0x809635f thru 0x809a3a3 (0x4045 bytes) 2024-09-11T05:23:05.296 INFO:teuthology.orchestra.run.smithi012.stdout:5546 writesame 0x5c6ebc7 thru 0x5c7b38a data_size 0xa(0xc7c4 bytes) 2024-09-11T05:23:05.301 INFO:teuthology.orchestra.run.smithi012.stdout:5551 read 0x7dc1c6a thru 0x7dc643e (0x47d5 bytes) 2024-09-11T05:23:05.302 INFO:teuthology.orchestra.run.smithi012.stdout:5552 writesame 0x41bfd76 thru 0x41c8e4d data_size 0x5a(0x90d8 bytes) 2024-09-11T05:23:05.306 INFO:teuthology.orchestra.run.smithi012.stdout:5553 read 0x91e9a1 thru 0x92d980 (0xefe0 bytes) 2024-09-11T05:23:05.308 INFO:teuthology.orchestra.run.smithi012.stdout:5556 writesame 0x1aab98e thru 0x1aae81e data_size 0xd(0x2e91 bytes) 2024-09-11T05:23:05.326 INFO:teuthology.orchestra.run.smithi012.stdout:5558 write 0x75bc934 thru 0x75cbb8c (0xf259 bytes) 2024-09-11T05:23:05.333 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:05.333 INFO:teuthology.orchestra.run.smithi012.stdout:5561 write 0x144a1fd thru 0x1456d98 (0xcb9c bytes) 2024-09-11T05:23:05.338 INFO:teuthology.orchestra.run.smithi012.stdout:5565 punch from 0x2e8ecd8 to 0x2e91b82, (0x2eaa bytes) 2024-09-11T05:23:05.338 INFO:teuthology.orchestra.run.smithi012.stdout:5566 write 0x831460 thru 0x8316cf (0x270 bytes) 2024-09-11T05:23:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:5567 punch from 0x7f9ed7f to 0x7fa5382, (0x6603 bytes) 2024-09-11T05:23:05.344 INFO:teuthology.orchestra.run.smithi012.stdout:5568 clone 46 order 21 su 32768 sc 8 2024-09-11T05:23:05.382 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:05.382 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:05.386 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:05.386+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:05.391 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:05.480 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6] out_osds: [7, 4] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:05.481 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:05.481 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-09-11T05:23:05.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-09-11T05:23:05.487 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:05.487+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:05.539 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:05.539 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:05.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:23:05.588 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:05.587+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:05.638 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone45 from 0x809a3a4 (overlap 0x2d60487) to 0x244d06c 2024-09-11T05:23:05.656 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:05.656 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:05.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:05.689 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:05.688+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:05.775 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:05.775 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:05.784 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:05.787 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-09-11T05:23:05.829 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:05.829+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:05.842 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:23:05.841+0000 7f4182606640 -1 mon.a@0(leader).osd e96 definitely_dead 0 2024-09-11T05:23:05.888 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:05.888 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:05.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:05.890+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:05.897 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:05.941 INFO:teuthology.orchestra.run.smithi012.stdout:5569 write 0x87000be thru 0x870b119 (0xb05c bytes) 2024-09-11T05:23:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:5570 read 0x48cf9ae thru 0x48d0ff0 (0x1643 bytes) 2024-09-11T05:23:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:5573 read 0x1f447bb thru 0x1f4cad7 (0x831d bytes) 2024-09-11T05:23:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:5574 read 0x14150db thru 0x1422742 (0xd668 bytes) 2024-09-11T05:23:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:5575 punch from 0x2929385 to 0x29375d6, (0xe251 bytes) 2024-09-11T05:23:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:5576 read 0x7612d11 thru 0x761a1e2 (0x74d2 bytes) 2024-09-11T05:23:05.948 INFO:teuthology.orchestra.run.smithi012.stdout:5578 writesame 0x4268e3 thru 0x42f55b data_size 0x1(0x8c79 bytes) 2024-09-11T05:23:05.991 INFO:teuthology.orchestra.run.smithi012.stdout:5580 punch from 0x21191cd to 0x2122c0f, (0x9a42 bytes) 2024-09-11T05:23:05.992 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:05.991+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:05.994 INFO:teuthology.orchestra.run.smithi012.stdout:5581 trunc from 0x870b11a to 0x6120dbe 2024-09-11T05:23:06.025 INFO:teuthology.orchestra.run.smithi012.stdout:5582 writesame 0x864479c thru 0x865422e data_size 0x1(0xfa93 bytes) 2024-09-11T05:23:06.025 INFO:teuthology.orchestra.run.smithi012.stdout:5583 read 0x56d0bca thru 0x56d1a0b (0xe42 bytes) 2024-09-11T05:23:06.025 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:06.025 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:06.025 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:06.025 INFO:teuthology.orchestra.run.smithi012.stdout:5589 writesame 0x3c5174a thru 0x3c5b847 data_size 0x3(0xa0fe bytes) 2024-09-11T05:23:06.045 INFO:teuthology.orchestra.run.smithi012.stdout:5592 write 0xd61a719 thru 0xd62954d (0xee35 bytes) 2024-09-11T05:23:06.047 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:06.047 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:06.050 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:5595 clone 47 order 21 su 65536 sc 6 2024-09-11T05:23:06.056 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:06.097 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:06.097+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:06.193 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:06.193+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:06.200 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:06.200 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:06.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:06.294 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:06.294+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:06.352 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:06.352 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:06.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:06.404 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:06.404+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:06.464 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:06.465 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:06.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:06.514 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:06.514+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:06.585 INFO:teuthology.orchestra.run.smithi012.stderr:marked in osd.7. 2024-09-11T05:23:06.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:06.596+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:06.603 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-09-11T05:23:06.621 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:06.621 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:06.630 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:06.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:06.697+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:06.734 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:06.734 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:06.743 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:06.798 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:06.798+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:06.847 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:06.847 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:06.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:06.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:06.898+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:07.000 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:07.001 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:07.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:07.000+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:07.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:07.101 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:07.101+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:07.112 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:07.112 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:07.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:07.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:07.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:07.213+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:07.243 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:07.243 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:07.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:07.303 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:07.303 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:07.303+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:07.322 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:07.322 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:07.339 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:07.339 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:07.355 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:07.356 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:07.373 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:07.390 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:07.404 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:07.403+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:07.404 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:07.404 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:07.405 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:07.405 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:07.405 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:07.408 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:07.417 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:07.431 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:07.431 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:07.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:07.504+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:07.540 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:07.540 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 11.000382108, 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.541 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:07.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:07.547 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.3495527379999999, 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.548 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:07.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126073 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 614400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.846916+0000", 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6922347640000002, 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0084634310000000004, 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126073 2024-09-11T05:23:07.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.555 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846916+0000", 2024-09-11T05:23:07.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846916+0000", 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846916+0000", 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:07.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846919+0000", 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6589999999999999e-06 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846927+0000", 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7670000000000003e-06 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.557 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846932+0000", 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8610000000000003e-06 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855208+0000", 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0082755669999999993 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855284+0000", 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6273000000000006e-05 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855379+0000", 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4877999999999995e-05 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126074 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 638976~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.846945+0000", 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6922054600000003, 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0086808170000000004, 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126074 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846945+0000", 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846945+0000", 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846945+0000", 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999998e-07 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846948+0000", 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.543e-06 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846955+0000", 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3390000000000004e-06 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846961+0000", 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4589999999999997e-06 2024-09-11T05:23:07.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855420+0000", 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0084595009999999995 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855513+0000", 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2664999999999995e-05 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855626+0000", 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112855 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126075 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 663552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.846969+0000", 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6921816720000002, 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0088854050000000007, 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126075 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846969+0000", 2024-09-11T05:23:07.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846969+0000", 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846969+0000", 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846971+0000", 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1770000000000001e-06 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846980+0000", 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0319999999999992e-06 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846986+0000", 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.412e-06 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855669+0000", 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.008683563 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855752+0000", 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2191e-05 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855854+0000", 2024-09-11T05:23:07.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010264699999999999 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126076 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 688128~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.846994+0000", 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6921569180000002, 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0090889460000000005, 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.569 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126076 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846994+0000", 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846994+0000", 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846994+0000", 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.846998+0000", 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2610000000000004e-06 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.571 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847005+0000", 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.007e-06 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847010+0000", 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1699999999999996e-06 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855898+0000", 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0088877750000000005 2024-09-11T05:23:07.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855975+0000", 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7114999999999996e-05 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856083+0000", 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107193 2024-09-11T05:23:07.573 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126077 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 712704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847019+0000", 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.692131984, 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0092767470000000001, 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126077 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847019+0000", 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847019+0000", 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847019+0000", 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4400000000000001e-07 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847021+0000", 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.097e-06 2024-09-11T05:23:07.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847028+0000", 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6490000000000002e-06 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847033+0000", 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856129+0000", 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0090963569999999994 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856202+0000", 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3089000000000004e-05 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856295+0000", 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3049999999999998e-05 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126078 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 737280~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847040+0000", 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.692110129, 2024-09-11T05:23:07.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0095156379999999999, 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126078 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.580 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847040+0000", 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847040+0000", 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847041+0000", 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847043+0000", 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0559999999999999e-06 2024-09-11T05:23:07.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847053+0000", 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.022e-05 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847059+0000", 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8359999999999997e-06 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856347+0000", 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0092883559999999993 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856436+0000", 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8380000000000004e-05 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856556+0000", 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000120382 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.584 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126079 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847066+0000", 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6920848830000002, 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0097034479999999999, 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126079 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847066+0000", 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847066+0000", 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847066+0000", 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.72e-07 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847073+0000", 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9879999999999998e-06 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847092+0000", 2024-09-11T05:23:07.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8981e-05 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847099+0000", 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6030000000000001e-06 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856596+0000", 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0094970990000000002 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856673+0000", 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7688999999999994e-05 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856769+0000", 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5716000000000003e-05 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.589 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126080 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 786432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847110+0000", 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6920400139999998, 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0098951160000000007, 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126080 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847110+0000", 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847110+0000", 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847111+0000", 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847115+0000", 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847122+0000", 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4730000000000003e-06 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847129+0000", 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856813+0000", 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0096836240000000001 2024-09-11T05:23:07.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856898+0000", 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5432999999999993e-05 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857006+0000", 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010738000000000001 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126081 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 811008~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847137+0000", 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6920138639999998, 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010079886999999999, 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126081 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.595 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847137+0000", 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847137+0000", 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847137+0000", 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847140+0000", 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4030000000000001e-06 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847152+0000", 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2886e-05 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847159+0000", 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2910000000000004e-06 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857044+0000", 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.009884795 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857119+0000", 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5982999999999994e-05 2024-09-11T05:23:07.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857217+0000", 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7027999999999993e-05 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126082 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 835584~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847166+0000", 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.691984529, 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010284046999999999, 2024-09-11T05:23:07.599 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126082 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847166+0000", 2024-09-11T05:23:07.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847166+0000", 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847166+0000", 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847169+0000", 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2060000000000001e-06 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847175+0000", 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4239999999999998e-06 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847182+0000", 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8480000000000003e-06 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857258+0000", 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010075825 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857341+0000", 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3208999999999996e-05 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857450+0000", 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109096 2024-09-11T05:23:07.603 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126083 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 860160~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847190+0000", 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6919603300000001, 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010480891000000001, 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.604 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126083 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847190+0000", 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847190+0000", 2024-09-11T05:23:07.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847191+0000", 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847193+0000", 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847206+0000", 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3393e-05 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847212+0000", 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6049999999999997e-06 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857498+0000", 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010286086 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857577+0000", 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9127000000000003e-05 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857671+0000", 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.433e-05 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.608 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6919268519999999, 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:07.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:07.612 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.691901782, 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.613 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.617 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6918736700000001, 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:07.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6918474030000001, 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:07.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:07.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.691815772, 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:07.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.691791314, 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:07.631 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:07.633 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.6917648409999999, 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:07.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:07.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:07.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:07.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:07.640 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:07.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:23:07.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:07.643 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:07.642+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:07.743 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:07.742+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:07.792 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:07.792 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:07.792 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:07.792 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:07.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:07.844 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:07.843+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:07.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:07.943+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:07.952 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:07.952 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:07.952 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:07.952 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:07.952 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:07.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:08.046 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:08.045+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:08.111 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:08.111 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:08.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:08.111 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:08.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87569 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 969728~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.254484899000001, 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054409762, 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87569 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.112 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855443+0000", 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855444+0000", 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0920000000000001e-06 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855447+0000", 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0460000000000001e-06 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855450+0000", 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4719999999999998e-06 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909576+0000", 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054126062000000003 2024-09-11T05:23:08.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909737+0000", 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00016113600000000001 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909853+0000", 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000115753 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87570 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 973824~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.254475164999999, 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054576539, 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87570 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855453+0000", 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855454+0000", 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0690000000000001e-06 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855457+0000", 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.8540000000000001e-06 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855459+0000", 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5840000000000002e-06 2024-09-11T05:23:08.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909924+0000", 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054464789999999999 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.909974+0000", 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9761e-05 2024-09-11T05:23:08.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910029+0000", 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5274e-05 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87571 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 977920~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.122 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.254464919, 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054738976000000002, 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87571 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.855463+0000", 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856482+0000", 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010191530000000001 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856487+0000", 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4889999999999997e-06 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856497+0000", 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0922e-05 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856505+0000", 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9310000000000008e-06 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910066+0000", 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053560732999999999 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910138+0000", 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1897999999999995e-05 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910202+0000", 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3849999999999993e-05 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87573 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 986112~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.253370337, 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054081785, 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87573 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856557+0000", 2024-09-11T05:23:08.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856558+0000", 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2799999999999996e-07 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856560+0000", 2024-09-11T05:23:08.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856569+0000", 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1650000000000006e-06 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856574+0000", 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.66e-06 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910464+0000", 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053890170000000001 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910564+0000", 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9239000000000003e-05 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910639+0000", 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5642000000000005e-05 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87574 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 990208~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.253345473, 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054248939000000003, 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87574 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856582+0000", 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856583+0000", 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856585+0000", 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2979999999999999e-06 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856592+0000", 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8419999999999999e-06 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856598+0000", 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7679999999999997e-06 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910671+0000", 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054073259999999998 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910762+0000", 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0661999999999994e-05 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910831+0000", 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9614000000000001e-05 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87575 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 994304~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.253322938, 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054432912, 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87575 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:08.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856605+0000", 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856608+0000", 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856614+0000", 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.754e-06 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856619+0000", 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8600000000000001e-06 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910864+0000", 2024-09-11T05:23:08.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054244522000000003 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.910966+0000", 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010207100000000001 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911038+0000", 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2026000000000005e-05 2024-09-11T05:23:08.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87576 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 998400~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.253301377, 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054624032000000003, 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87576 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856626+0000", 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856627+0000", 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856633+0000", 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6309999999999997e-06 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856641+0000", 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3590000000000002e-06 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856646+0000", 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6450000000000002e-06 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911076+0000", 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054429098000000002 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911174+0000", 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8098999999999997e-05 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911250+0000", 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6779000000000005e-05 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.146 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87577 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1002496~0] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.253272738, 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054805804999999999, 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87577 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.147 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.856655+0000", 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858484+0000", 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001829156 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858489+0000", 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5430000000000004e-06 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858506+0000", 2024-09-11T05:23:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7221999999999999e-05 2024-09-11T05:23:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858513+0000", 2024-09-11T05:23:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1189999999999999e-06 2024-09-11T05:23:08.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911306+0000", 2024-09-11T05:23:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.052792736999999999 2024-09-11T05:23:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911393+0000", 2024-09-11T05:23:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6996000000000005e-05 2024-09-11T05:23:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.911461+0000", 2024-09-11T05:23:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8032000000000002e-05 2024-09-11T05:23:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87582 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1022976~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:23:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.251301593000001, 2024-09-11T05:23:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053904077000000002, 2024-09-11T05:23:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87582 2024-09-11T05:23:08.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:23:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858626+0000", 2024-09-11T05:23:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.158 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858627+0000", 2024-09-11T05:23:08.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:08.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.158 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858629+0000", 2024-09-11T05:23:08.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5170000000000002e-06 2024-09-11T05:23:08.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858637+0000", 2024-09-11T05:23:08.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0949999999999996e-06 2024-09-11T05:23:08.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858643+0000", 2024-09-11T05:23:08.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4820000000000002e-06 2024-09-11T05:23:08.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912312+0000", 2024-09-11T05:23:08.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053669728999999999 2024-09-11T05:23:08.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.162 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.162 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912426+0000", 2024-09-11T05:23:08.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011409 2024-09-11T05:23:08.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.163 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.163 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912530+0000", 2024-09-11T05:23:08.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010378300000000001 2024-09-11T05:23:08.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.163 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.164 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87583 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1027072~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.164 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:23:08.164 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.251257728999999, 2024-09-11T05:23:08.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054053339999999998, 2024-09-11T05:23:08.164 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.165 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.165 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.165 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.165 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87583 2024-09-11T05:23:08.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.166 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:23:08.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858670+0000", 2024-09-11T05:23:08.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858671+0000", 2024-09-11T05:23:08.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:23:08.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858673+0000", 2024-09-11T05:23:08.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5129999999999999e-06 2024-09-11T05:23:08.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858680+0000", 2024-09-11T05:23:08.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.306e-06 2024-09-11T05:23:08.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858686+0000", 2024-09-11T05:23:08.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2619999999999998e-06 2024-09-11T05:23:08.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912560+0000", 2024-09-11T05:23:08.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053874440000000003 2024-09-11T05:23:08.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912644+0000", 2024-09-11T05:23:08.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4141999999999995e-05 2024-09-11T05:23:08.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912723+0000", 2024-09-11T05:23:08.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9129999999999996e-05 2024-09-11T05:23:08.173 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.173 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87584 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1031168~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:23:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.251233299999999, 2024-09-11T05:23:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054250643000000001, 2024-09-11T05:23:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87584 2024-09-11T05:23:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:23:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858694+0000", 2024-09-11T05:23:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858695+0000", 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.15e-07 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858697+0000", 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7540000000000001e-06 2024-09-11T05:23:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858701+0000", 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0419999999999996e-06 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858703+0000", 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6769999999999999e-06 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912759+0000", 2024-09-11T05:23:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054055976999999998 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912848+0000", 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8962999999999995e-05 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912945+0000", 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6815000000000001e-05 2024-09-11T05:23:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87585 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1035264~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.251220790000001, 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054449115999999999, 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87585 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858707+0000", 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1799999999999999e-07 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858708+0000", 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.22e-06 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858711+0000", 2024-09-11T05:23:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0259999999999999e-06 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858714+0000", 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5040000000000001e-06 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.912983+0000", 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054268782000000002 2024-09-11T05:23:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913070+0000", 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7428000000000004e-05 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913156+0000", 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5938000000000003e-05 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87586 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1039360~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.25121077, 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.055576961000000001, 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87586 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858717+0000", 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858718+0000", 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1459999999999999e-06 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858721+0000", 2024-09-11T05:23:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.982e-06 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858724+0000", 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.913571+0000", 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054847185 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914218+0000", 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00064685000000000003 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914294+0000", 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6118000000000005e-05 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87587 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1043456~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:23:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.251200894, 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.055819203999999997, 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87587 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.858727+0000", 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860496+0000", 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001768875 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860501+0000", 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860513+0000", 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1972e-05 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860520+0000", 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2830000000000004e-06 2024-09-11T05:23:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914342+0000", 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.053821890999999997 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914440+0000", 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8579000000000006e-05 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914546+0000", 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105703 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:87588 3.1 3:876df9a4:::rbd_data.1179a8ecd52d.0000000000000020:26 [read 1047552~0] snapc 0=[] RETRY=6 ondisk+retry+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.249376239, 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054198646000000003, 2024-09-11T05:23:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 87588 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860552+0000", 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860559+0000", 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.357e-06 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860568+0000", 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7020000000000007e-06 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.860574+0000", 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.28e-06 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914590+0000", 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.054015781999999998 2024-09-11T05:23:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914680+0000", 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0050999999999996e-05 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.914750+0000", 2024-09-11T05:23:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9887000000000004e-05 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.2585558639999999, 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:23:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:23:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:23:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.255206179, 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:23:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:23:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:23:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:23:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.2535092190000001, 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:23:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:23:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.2529337389999999, 2024-09-11T05:23:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 3.2504792870000001, 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:23:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.233 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:08.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:08.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:08.234+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:08.335 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:08.335+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:08.382 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:08.383 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:08.392 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:08.408 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:23:08.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:08.474+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:08.508 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:08.509 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:08.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:08.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:08.557+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:08.638 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:08.638+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:08.666 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.777470363999999, 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:23:08.671 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.777449865000001, 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.672 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.676 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:08.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.679 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.777426923, 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:23:08.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:23:08.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:23:08.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.777218764000001, 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:23:08.684 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:23:08.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:23:08.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.777076229999999, 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.777009328999998, 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.776672993999998, 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.699 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.776538000999999, 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:23:08.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:08.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.706 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.708 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.77650306, 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:23:08.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.711 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.712 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.776481390000001, 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.713 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:23:08.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:23:08.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.776383335999999, 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:23:08.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.776262340999999, 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:23:08.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:23:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:23:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.727 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.776126775000002, 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.728 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:08.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.730 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:23:08.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:08.732 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.775918269999998, 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.733 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:23:08.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:23:08.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.775731874999998, 2024-09-11T05:23:08.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:23:08.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:23:08.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.77563103, 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:23:08.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.746 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.775451832999998, 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.748 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:23:08.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.775180800000001, 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.751 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:08.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:23:08.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:08.755 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.775130941, 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:08.759 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.774977567000001, 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:08.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:08.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:08.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:08.763 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:08.765 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:08.765 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:08.763+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:08.828 INFO:teuthology.orchestra.run.smithi012.stdout:leaving image image_client.0-clone46 intact 2024-09-11T05:23:08.866 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:08.865+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:08.927 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:08.927 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:08.927 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:08.928 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:08.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:08.980 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:08.979+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:09.002 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #45, image image_client.0-clone45 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent46 2024-09-11T05:23:09.068 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:09.067+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:09.154 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:09.155 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:09.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:09.170 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:09.168+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:09.269 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:09.268+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:09.313 INFO:teuthology.orchestra.run.smithi012.stdout:5596 write 0x8571bc1 thru 0x857d1b4 (0xb5f4 bytes) 2024-09-11T05:23:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:5597 read 0x69bebdd thru 0x69c297f (0x3da3 bytes) 2024-09-11T05:23:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:5599 write 0x7bf636 thru 0x7c84f8 (0x8ec3 bytes) 2024-09-11T05:23:09.353 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.606625799, 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:23:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:23:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.606613910999997, 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:23:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:23:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.606576691000001, 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:23:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.606561909999996, 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.606550573999996, 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:23:09.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:23:09.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.377 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.605399773000002, 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:09.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.381 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.382 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.605385318000003, 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:23:09.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:09.387 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.605374838000003, 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:09.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:23:09.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.605364370999993, 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:23:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.605346010999995, 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:23:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:23:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.602636939000007, 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:23:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.407 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.602613938999994, 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:23:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.602592576000006, 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:23:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.602571057000006, 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:23:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.602550129999997, 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:23:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.600706392999996, 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:23:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.600696020000001, 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:23:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.600680991000004, 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:23:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.600670983000001, 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 1.9364029949999999, 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:09.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout:5600 trunc from 0xd62954e to 0xd2dbb8f 2024-09-11T05:23:09.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:5601 write 0x90ee008 thru 0x90f3e77 (0x5e70 bytes) 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:5607 write 0xcd1cd93 thru 0xcd2084b (0x3ab9 bytes) 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:5609 writesame 0x6f08fe1 thru 0x6f16f52 data_size 0x25(0xdf72 bytes) 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:5614 write 0xb09bde4 thru 0xb0a4be4 (0x8e01 bytes) 2024-09-11T05:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout:5616 read 0x1a65e1a thru 0x1a6b638 (0x581f bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5617 read 0x9be814f thru 0x9beb432 (0x32e4 bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5618 read 0x41f861e thru 0x41f89e8 (0x3cb bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5620 writesame 0x7616479 thru 0x761d363 data_size 0x9(0x6eeb bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5621 writesame 0xad8ab00 thru 0xad900a3 data_size 0x57(0x55a4 bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5623 write 0xdf930aa thru 0xdf96d95 (0x3cec bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5626 write 0x9d4707c thru 0x9d567a4 (0xf729 bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5627 read 0x49e294f thru 0x49e7d23 (0x53d5 bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5628 trunc from 0xdf96d96 to 0x9e42fe3 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5629 write 0x4c03b94 thru 0x4c06a2f (0x2e9c bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5630 punch from 0x6e56f56 to 0x6e66937, (0xf9e1 bytes) 2024-09-11T05:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout:5631 write 0xaaa7a1b thru 0xaaae78f (0x6d75 bytes) 2024-09-11T05:23:09.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:09.452+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:09.458 INFO:teuthology.orchestra.run.smithi012.stdout:5632 writesame 0x54a1b2d thru 0x54a214f data_size 0x1(0x623 bytes) 2024-09-11T05:23:09.461 INFO:teuthology.orchestra.run.smithi012.stdout:5633 read 0x289d771 thru 0x28a26a9 (0x4f39 bytes) 2024-09-11T05:23:09.462 INFO:teuthology.orchestra.run.smithi012.stdout:5634 write 0x8bd5883 thru 0x8be52f7 (0xfa75 bytes) 2024-09-11T05:23:09.467 INFO:teuthology.orchestra.run.smithi012.stdout:5635 read 0x9b29728 thru 0x9b37cc5 (0xe59e bytes) 2024-09-11T05:23:09.467 INFO:teuthology.orchestra.run.smithi012.stdout:5637 punch from 0x78830b7 to 0x788f5c1, (0xc50a bytes) 2024-09-11T05:23:09.467 INFO:teuthology.orchestra.run.smithi012.stdout:5638 writesame 0x26e0987 thru 0x26eaba0 data_size 0x1(0xa21a bytes) 2024-09-11T05:23:09.511 INFO:teuthology.orchestra.run.smithi012.stdout:5640 write 0xb997e86 thru 0xb99943f (0x15ba bytes) 2024-09-11T05:23:09.514 INFO:teuthology.orchestra.run.smithi012.stdout:5641 read 0x6efae45 thru 0x6f09c0a (0xedc6 bytes) 2024-09-11T05:23:09.515 INFO:teuthology.orchestra.run.smithi012.stdout:5642 write 0x7c285a4 thru 0x7c313b8 (0x8e15 bytes) 2024-09-11T05:23:09.528 INFO:teuthology.orchestra.run.smithi012.stdout:5643 writesame 0xd9f0cad thru 0xd9f1034 data_size 0x2(0x388 bytes) 2024-09-11T05:23:09.528 INFO:teuthology.orchestra.run.smithi012.stdout:5644 read 0xb00b052 thru 0xb0122e4 (0x7293 bytes) 2024-09-11T05:23:09.528 INFO:teuthology.orchestra.run.smithi012.stdout:5645 read 0x6c1e659 thru 0x6c2a7ed (0xc195 bytes) 2024-09-11T05:23:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:5646 writesame 0xe628bc4 thru 0xe62e5c0 data_size 0x7(0x59fd bytes) 2024-09-11T05:23:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:5649 read 0x7b10af3 thru 0x7b1a49c (0x99aa bytes) 2024-09-11T05:23:09.536 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:5652 trunc from 0xe62e5c1 to 0x9d884f4 2024-09-11T05:23:09.554 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:09.554+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:09.565 INFO:teuthology.orchestra.run.smithi012.stdout:5653 write 0xe38c518 thru 0xe395c95 (0x977e bytes) 2024-09-11T05:23:09.569 INFO:teuthology.orchestra.run.smithi012.stdout:5655 writesame 0x2743858 thru 0x274eb82 data_size 0x1(0xb32b bytes) 2024-09-11T05:23:09.574 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:09.575 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:09.575 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:09.575 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:09.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:09.596 INFO:teuthology.orchestra.run.smithi012.stdout:5657 read 0x9af921a thru 0x9affb75 (0x695c bytes) 2024-09-11T05:23:09.596 INFO:teuthology.orchestra.run.smithi012.stdout:5659 write 0xb4ed6a3 thru 0xb4fd160 (0xfabe bytes) 2024-09-11T05:23:09.603 INFO:teuthology.orchestra.run.smithi012.stdout:5660 read 0x9da825b thru 0x9dac537 (0x42dd bytes) 2024-09-11T05:23:09.604 INFO:teuthology.orchestra.run.smithi012.stdout:5662 punch from 0x81ab771 to 0x81adf63, (0x27f2 bytes) 2024-09-11T05:23:09.604 INFO:teuthology.orchestra.run.smithi012.stdout:5663 writesame 0x328a2ea thru 0x328b381 data_size 0x24(0x1098 bytes) 2024-09-11T05:23:09.607 INFO:teuthology.orchestra.run.smithi012.stdout:5665 punch from 0x6b767b7 to 0x6b7cae3, (0x632c bytes) 2024-09-11T05:23:09.623 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:09.624 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:09.624 INFO:teuthology.orchestra.run.smithi012.stdout:5666 trunc from 0xe395c96 to 0x125d1c4 2024-09-11T05:23:09.647 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:09.647 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:09.654 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:09.653+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:09.663 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:09.664 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:09.680 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:09.680 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:09.700 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:09.701 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:09.720 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:09.720 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:09.735 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:09.735 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:09.740 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:09.740 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:09.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:09.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:09.755+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:09.760 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:09.761 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:09.857 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:09.857 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:09.857 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:09.857+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:09.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:09.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:09.957+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:10.022 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.022 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:10.075 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:10.075+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:10.139 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.139 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.148 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:10.189 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:10.189+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:10.260 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:10.259+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:10.299 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.299 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:10.361 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:10.360+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:10.421 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.421 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.430 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:10.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:23:10.474 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:10.474+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:10.540 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.540 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.550 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:10.591 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:10.591+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:10.663 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:10.662+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:10.707 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.708 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:10.764 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:10.763+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:10.833 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.833 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:10.886 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:10.886+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:10.954 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:10.954 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:10.964 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:11.004 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:11.004+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:11.067 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:11.067+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:11.112 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:11.113 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:11.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:11.167 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:11.167+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:11.237 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:11.269 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:11.268+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:11.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:11.397 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:11.396+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:11.460 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:11.461 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:11.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:11.470 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:11.470+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:11.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:11.570+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:11.598 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:23:11.604 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:11.604 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:11.604 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-11T05:23:11.604 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-11T05:23:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:11.635 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:5667 read 0x112f5cd thru 0x113c87e (0xd2b2 bytes) 2024-09-11T05:23:11.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:5668 trunc from 0x125d1c4 to 0x337ac47 2024-09-11T05:23:11.653 INFO:teuthology.orchestra.run.smithi012.stdout:5669 punch from 0x4f7d42 to 0x4fa4ef, (0x27ad bytes) 2024-09-11T05:23:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:5670 punch from 0x2d42af5 to 0x2d4452f, (0x1a3a bytes) 2024-09-11T05:23:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:5671 punch from 0x2e5c28b to 0x2e6a219, (0xdf8e bytes) 2024-09-11T05:23:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:5672 read 0x255be9d thru 0x25669c2 (0xab26 bytes) 2024-09-11T05:23:11.660 INFO:teuthology.orchestra.run.smithi012.stdout:5673 trunc from 0x337ac47 to 0x839e895 2024-09-11T05:23:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:5675 punch from 0x27c97c9 to 0x27cba06, (0x223d bytes) 2024-09-11T05:23:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:5676 read 0x51bdf60 thru 0x51cad2a (0xcdcb bytes) 2024-09-11T05:23:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:5679 punch from 0x5c63e43 to 0x5c6fd9c, (0xbf59 bytes) 2024-09-11T05:23:11.667 INFO:teuthology.orchestra.run.smithi012.stdout:5680 read 0x5990b00 thru 0x5992b0e (0x200f bytes) 2024-09-11T05:23:11.667 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:11.667 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:11.667 INFO:teuthology.orchestra.run.smithi012.stdout:5684 write 0x133ee1e thru 0x13445f4 (0x57d7 bytes) 2024-09-11T05:23:11.668 INFO:teuthology.orchestra.run.smithi012.stdout:5685 punch from 0x5dfbb85 to 0x5dfe5f0, (0x2a6b bytes) 2024-09-11T05:23:11.668 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:11.672 INFO:teuthology.orchestra.run.smithi012.stdout:5687 trunc from 0x839e895 to 0x509abfc 2024-09-11T05:23:11.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:11.671+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:11.677 INFO:teuthology.orchestra.run.smithi012.stdout:5688 read 0x2b8967a thru 0x2b97976 (0xe2fd bytes) 2024-09-11T05:23:11.689 INFO:teuthology.orchestra.run.smithi012.stdout:5690 write 0x97a21c6 thru 0x97a8239 (0x6074 bytes) 2024-09-11T05:23:11.692 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:11.701 INFO:teuthology.orchestra.run.smithi012.stdout:5692 trunc from 0x97a823a to 0x26f5a6e 2024-09-11T05:23:11.718 INFO:teuthology.orchestra.run.smithi012.stdout:5695 write 0x2a3c4d3 thru 0x2a3f87c (0x33aa bytes) 2024-09-11T05:23:11.767 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:11.768 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:11.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:11.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:11.772+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:11.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:11.874 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:11.874+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:11.899 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:11.917 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:11.917 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:11.930 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.078113203, 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:23:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.0747635180000001, 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:23:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:23:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:23:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.0730665579999998, 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:23:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:23:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.0724910779999997, 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:23:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:23:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:23:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:23:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:23:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 7.0700366260000003, 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:23:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:23:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130262 3.1f 3.a5f18dbf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8286430920000001, 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061307469000000003, 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130262 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.32e-07 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100844+0000", 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100850+0000", 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6380000000000001e-06 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100854+0000", 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162141+0000", 2024-09-11T05:23:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061286555999999999 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162150+0000", 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5029999999999997e-06 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130325 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8269286720000002, 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060079722000000002, 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130325 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102557+0000", 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:23:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102559+0000", 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102566+0000", 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102570+0000", 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162174+0000", 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.059604048999999999 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162636+0000", 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00046200400000000002 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130326 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.826909283, 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060097697999999998, 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130326 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102578+0000", 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9659999999999999e-06 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102584+0000", 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.772e-06 2024-09-11T05:23:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102589+0000", 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162665+0000", 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060076606999999997 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162674+0000", 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4319999999999999e-06 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130327 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8268899169999999, 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060123397000000002, 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130327 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102596+0000", 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102597+0000", 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.827e-06 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102603+0000", 2024-09-11T05:23:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102607+0000", 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2679999999999996e-06 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162696+0000", 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060088849999999999 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162719+0000", 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2285000000000001e-05 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130328 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8268712540000003, 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060139489999999997, 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130328 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102617+0000", 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102624+0000", 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102629+0000", 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162745+0000", 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060116145000000003 2024-09-11T05:23:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162753+0000", 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130329 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8268498279999998, 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060160739999999997, 2024-09-11T05:23:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130329 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102636+0000", 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102642+0000", 2024-09-11T05:23:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6989999999999997e-06 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102650+0000", 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3490000000000003e-06 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102655+0000", 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162787+0000", 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060131974999999997 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162796+0000", 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6729999999999998e-06 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130330 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8268229690000002, 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060169009000000002, 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130330 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102663+0000", 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102665+0000", 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.125e-06 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102671+0000", 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102675+0000", 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162823+0000", 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060147618 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162831+0000", 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130331 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8267925489999999, 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060170659000000001, 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130331 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102695+0000", 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102702+0000", 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102706+0000", 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7979999999999996e-06 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162855+0000", 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060148733000000003 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162863+0000", 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:23:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130332 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8267728939999999, 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060183778, 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130332 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102713+0000", 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102715+0000", 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9530000000000002e-06 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102720+0000", 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102726+0000", 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162887+0000", 2024-09-11T05:23:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060161144999999999 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162896+0000", 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0750000000000004e-06 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130333 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.826753267, 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060197321999999998, 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130333 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102734+0000", 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9309999999999998e-06 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102740+0000", 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102744+0000", 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5079999999999999e-06 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162921+0000", 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060176306999999998 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162929+0000", 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6270000000000006e-06 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130334 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.826735437, 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060210554999999999, 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130334 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102752+0000", 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102758+0000", 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:23:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102762+0000", 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162952+0000", 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060190180000000003 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162960+0000", 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1159999999999999e-06 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130335 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8267180590000001, 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224879000000002, 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130335 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102769+0000", 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0549999999999998e-06 2024-09-11T05:23:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102775+0000", 2024-09-11T05:23:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:23:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102779+0000", 2024-09-11T05:23:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:23:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162984+0000", 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060204437999999999 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162992+0000", 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1669999999999999e-06 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130336 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8267005840000001, 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060247271999999998, 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130336 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.84e-07 2024-09-11T05:23:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102787+0000", 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9120000000000001e-06 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102792+0000", 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102797+0000", 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5000000000000001e-06 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163022+0000", 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224969000000003 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163032+0000", 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8649999999999996e-06 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130337 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.82668293, 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060276431999999998, 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130337 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102803+0000", 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102804+0000", 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102810+0000", 2024-09-11T05:23:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102815+0000", 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4299999999999999e-06 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163067+0000", 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060252732000000003 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163079+0000", 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1321000000000001e-05 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130338 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 2.8266654849999999, 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060299902000000002, 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130338 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104763+0000", 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001943005 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104768+0000", 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104808+0000", 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9691000000000003e-05 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104815+0000", 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4549999999999998e-06 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163110+0000", 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.058294374000000003 2024-09-11T05:23:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163120+0000", 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9359999999999994e-06 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.026 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:12.027 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:12.027 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:12.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:12.029 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:23:11.938+0000 7f4182606640 -1 mon.a@0(leader).osd e102 definitely_dead 0 2024-09-11T05:23:12.029 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:12.029 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:12.030 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:12.030 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:12.030 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:12.030 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:12.031 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:12.031 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:12.031 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:12.031 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:12.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:12.026+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:12.129 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:12.129+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:12.175 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:12.175 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:12.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:12.230 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:12.230+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:12.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:12.331 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:12.331+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.517456461999998, 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:23:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:23:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.517435963, 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:23:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.517413020999999, 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:23:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:23:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.517204862, 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:23:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.517062328000002, 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:23:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516995427000001, 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:23:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:23:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516659092000001, 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516524099000002, 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:23:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:23:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516489157999999, 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516467488, 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:23:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516369434000001, 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:23:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516248439000002, 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:23:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:23:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:23:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.516112873000001, 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:23:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.515904368000001, 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:23:12.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.515717973000001, 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.515617127999999, 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:23:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.515437931000001, 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:23:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.515166898, 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:23:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:23:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.515117039, 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:23:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.514963665, 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:23:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:23:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.499 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:12.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:12.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:12.499+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:marked in osd.4. 2024-09-11T05:23:12.601 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:12.600+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:12.616 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-11T05:23:12.656 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:12.656 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:12.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:12.705 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:12.704+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:12.807 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:12.807+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:12.811 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:12.811 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:12.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:12.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:12.907+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:12.928 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.183422032999999, 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.183410144999996, 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.183372925, 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:23:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:23:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.183358143999996, 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:23:12.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.183346807999996, 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:23:12.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.182196007000002, 2024-09-11T05:23:12.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:12.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:23:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.182181552000003, 2024-09-11T05:23:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:23:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:23:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:23:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:23:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:23:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:23:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:23:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:23:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:23:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:23:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:23:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.182171072000003, 2024-09-11T05:23:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:23:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:23:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:23:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:23:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.182160605000007, 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:23:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.182142244999994, 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:23:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:23:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:23:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.179433173000007, 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.179410172999994, 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:23:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:23:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.179388810000006, 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.179367291000005, 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:23:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:23:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.179346363999997, 2024-09-11T05:23:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:23:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.177502626999996, 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:23:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:23:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:23:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.177492254000001, 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.177477225000004, 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:23:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:23:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:23:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:23:13.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.020 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.020 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.020 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:13.021 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 74.177467217, 2024-09-11T05:23:13.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:23:13.021 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:13.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:13.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:13.021 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:13.022 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:13.022 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:23:13.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.022 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:13.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:13.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:13.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:13.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:13.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:13.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:23:13.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:23:13.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:13.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:23:13.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:23:13.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:13.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:23:13.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:23:13.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:23:13.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:23:13.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:23:13.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:23:13.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:13.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:23:13.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:23:13.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.030 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.030 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:23:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 5.5131992289999996, 2024-09-11T05:23:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:23:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:23:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:23:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:23:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:23:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:23:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:23:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:23:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:23:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:23:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:23:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:23:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:23:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:23:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:13.042 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:13.044 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:13.045 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:13.043+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:13.144 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:13.144+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:13.161 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:13.161 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:13.170 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:13.254 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:13.254+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:13.314 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:13.315 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:13.323 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:13.364 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:13.364+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:13.447 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:13.446+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:13.468 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.833862960000005, 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:23:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:23:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.831721439000006, 2024-09-11T05:23:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:23:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:23:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.831699874999998, 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.831685863999994, 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:23:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:23:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.829860562999997, 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:23:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.82984596, 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:23:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:23:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.829828655, 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:23:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.829804546000005, 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:23:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.829776469999999, 2024-09-11T05:23:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:23:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.829749477999997, 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:23:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.829708918999998, 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:23:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:23:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.829685531999999, 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:23:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:23:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:23:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.733700424999995, 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:23:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.733680864999997, 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:23:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.733661650000002, 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 74.73364085, 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:23:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:23:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.849540335, 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:23:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:23:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:23:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:23:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:23:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:23:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:23:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:23:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.846550526999998, 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:23:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:23:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:23:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:23:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:23:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:23:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:23:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:23:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:23:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:23:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.381953635000002, 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:23:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:23:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:23:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:23:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.847369747000002, 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:23:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:23:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:13.584 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:13.585 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:13.585 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:13.585+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:13.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:23:13.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:13.685+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:13.729 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:13.729 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:13.729 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:13.729 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:13.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:13.787 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:13.787+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:13.841 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:13.841 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:13.841 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:13.841 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:13.841 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:13.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:13.888 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:13.887+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:13.990 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:13.989+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:13.997 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.997 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.399636564000005, 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.998 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:13.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.399409067999997, 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:23:14.002 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:23:14.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.399154253999995, 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:23:14.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.398785359000001, 2024-09-11T05:23:14.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:14.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:23:14.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:23:14.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.398623813, 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.016 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:14.021 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.398181077999993, 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:23:14.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.396034185000005, 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:23:14.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.394003632999997, 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:23:14.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:23:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:23:14.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.393983247999998, 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:14.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.176799442999993, 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:14.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:23:14.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.176778419000001, 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:23:14.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.050 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.176754164000002, 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:23:14.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.175075079999999, 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:23:14.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:23:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:23:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:23:14.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.061 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.175055733999997, 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:23:14.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:23:14.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.175034961999998, 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:14.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:23:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:23:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:23:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:23:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:23:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:23:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:23:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:23:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:23:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:23:14.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:23:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:23:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:23:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:23:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.175015552000005, 2024-09-11T05:23:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:23:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:23:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:14.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:23:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:23:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:23:14.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:23:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:14.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:23:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:23:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:23:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:23:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:23:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:23:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:23:14.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:23:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.085 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.174995082999999, 2024-09-11T05:23:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:23:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:23:14.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.174976193000006, 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:23:14.091 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.092 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:23:14.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.165638400000006, 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.097 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.165627573999998, 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:14.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:14.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:14.107 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:14.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:14.108 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:14.108+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:14.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:14.209 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:14.208+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:14.213 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:14.214 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:14.214 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:14.214 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:14.223 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:14.250 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:14.266 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:14.282 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:14.300 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:14.309 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:14.308+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:14.317 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:14.317 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:14.326 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:14.327 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:14.327 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:14.334 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:14.334 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:14.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:14.352 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:14.352 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:14.412 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:14.411+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:14.439 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:14.440 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:14.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:14.513 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:14.512+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:14.593 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:14.593 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:14.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:23:14.613 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:14.612+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:5696 trunc from 0x2a3f87d to 0xe0c983f 2024-09-11T05:23:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:5697 trunc from 0xe0c983f to 0x91fd87a 2024-09-11T05:23:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:5698 clone 48 order 18 su 32768 sc 9 2024-09-11T05:23:14.714 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:14.713+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:14.734 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:14.734 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:14.743 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:14.815 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:14.814+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:14.854 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:14.854 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:14.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:14.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:14.915+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:14.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:15.017 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:15.017+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:15.119 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:15.118+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:15.130 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:15.130 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:15.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:15.222 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:15.221+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:15.285 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:15.285 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:15.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:15.321 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:15.320+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:15.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:15.420+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:15.447 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:15.447 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:15.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:15.523 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:15.522+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:15.610 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:15.611 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:15.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:15.623 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:15.622+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:15.724 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:15.724+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:15.731 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:15.732 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:15.740 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:15.825 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:15.824+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:15.847 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:15.847 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:15.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:15.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:15.939+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:16.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:16.028 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:16.028+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:16.129 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:16.129+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:16.166 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:16.166 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:16.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:16.229 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:16.229+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:16.291 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:16.291 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:16.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:16.343 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:16.342+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:16.363 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:16.407 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:16.407 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:16.416 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:16.460 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:16.459+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:16.496 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:16.515 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:16.533 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:16.532+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:16.534 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:16.534 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:16.535 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:16.535 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:16.546 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:16.552 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:16.553 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:16.571 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:16.572 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:16.608 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:16.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:23:16.633 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:16.634 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:16.633+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:16.673 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:16.673 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:16.673 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:16.674 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:16.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:16.768 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:16.768+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:16.832 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:16.832 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:16.835 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:16.835+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:16.840 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:16.937 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:16.936+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:16.986 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:16.986 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:16.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.352166462, 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:16.987 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:23:16.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:23:16.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.350024941000001, 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:16.992 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:16.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:16.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:16.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:16.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:16.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:16.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:16.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:23:16.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:23:16.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:16.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:23:16.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:23:16.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:16.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:16.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.350003376999993, 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.349989366000003, 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:23:17.005 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.010 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.348164065000006, 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.011 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.348149461999995, 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.016 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.348132156999995, 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.021 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:23:17.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:23:17.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.025 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.348108048, 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:23:17.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.348079971999994, 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:23:17.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:23:17.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.348052980000006, 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:17.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:23:17.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.348012421000007, 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:23:17.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:23:17.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.347989033999994, 2024-09-11T05:23:17.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:23:17.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:23:17.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:23:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:23:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:23:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:23:17.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.252003927000004, 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:23:17.051 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.052 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:23:17.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:23:17.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.251984367000006, 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:23:17.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.061 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.251965151999997, 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.062 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.063 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:23:17.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.063 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:17.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:17.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:23:17.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:23:17.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:23:17.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:23:17.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:23:17.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:23:17.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:23:17.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:23:17.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.070 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:17.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.251944351999995, 2024-09-11T05:23:17.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:23:17.071 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.071 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.071 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.071 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:23:17.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:17.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:23:17.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.367843837000002, 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:23:17.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:17.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.364854029, 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.083 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:23:17.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:23:17.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:23:17.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.900257136999997, 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:23:17.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:23:17.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:17.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:23:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:23:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:23:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:23:17.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:23:17.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:23:17.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:17.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:23:17.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:23:17.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:23:17.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.365673248999997, 2024-09-11T05:23:17.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:23:17.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:23:17.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:23:17.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.108 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:17.110 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:17.111 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:17.109+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:17.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:17.211+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:17.215 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:17.215 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:17.215 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:17.215 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:17.223 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:17.312 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:17.311+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:17.325 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:17.325 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:17.325 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:17.325 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:17.326 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:17.334 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:23:17.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:17.411+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:17.449 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.851253572999994, 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:23:17.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.851026077, 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.850771262999999, 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:23:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.850402368000005, 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:23:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:23:17.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.850240822000004, 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:23:17.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:23:17.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.472 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.849798086999996, 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.847651193999994, 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:23:17.477 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:23:17.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.845620642, 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.482 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:23:17.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.845600257000001, 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.628416451999996, 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:23:17.491 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.495 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.628395428000005, 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.496 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:23:17.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:23:17.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:17.500 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.628371173000005, 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:23:17.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.626692089000002, 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.505 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:23:17.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.626672743, 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:23:17.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:17.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:23:17.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.626651971000001, 2024-09-11T05:23:17.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:23:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:23:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:23:17.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:23:17.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:23:17.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:23:17.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:23:17.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:23:17.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:23:17.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:23:17.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.521 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:17.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.626632560999994, 2024-09-11T05:23:17.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:23:17.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.523 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.523 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.523 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:23:17.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.524 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:17.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:17.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:17.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:23:17.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:23:17.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:23:17.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:23:17.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:17.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:23:17.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:23:17.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:23:17.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:23:17.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:23:17.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:23:17.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:23:17.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:23:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.626612092000002, 2024-09-11T05:23:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:23:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:23:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:23:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:23:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:23:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:23:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:23:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:23:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:23:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.626593201999995, 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:23:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:23:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.617255408999995, 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:23:17.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:23:17.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:23:17.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:23:17.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:23:17.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:23:17.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:23:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:23:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:23:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:23:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.617244583000002, 2024-09-11T05:23:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:23:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:23:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:23:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:23:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:17.560 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:17.561 INFO:teuthology.orchestra.run.smithi012.stdout:truncating image image_client.0-clone47 from 0x91fd87a (overlap 0x125d1c4) to 0x75871b 2024-09-11T05:23:17.562 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:17.560+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:17.562 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:17.609 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #46, image image_client.0-clone46 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent47 2024-09-11T05:23:17.618 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:17.618 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:17.618 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T05:23:17.618 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.598453 2024-09-11T05:23:17.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.5984526339576342 2024-09-11T05:23:17.663 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:17.662+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:17.678 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:17.679 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:17.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:17.763 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:17.762+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:17.863 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:17.863 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:17.863 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:17.864 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:17.863+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:17.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:17.964 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:17.963+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383982251999999, 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:23:18.017 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:23:18.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383972386, 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:23:18.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:23:18.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383947970000001, 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:23:18.026 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:23:18.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383936682000002, 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383927162999999, 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:18.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:23:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383917804999999, 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:23:18.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.044 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383903922999998, 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.045 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:23:18.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.049 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383894355999999, 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:18.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:23:18.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383878526, 2024-09-11T05:23:18.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:23:18.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.058 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383852768000001, 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.059 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:23:18.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383824110999999, 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:23:18.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:23:18.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383799278000001, 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.068 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:23:18.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.072 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383781725999999, 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.073 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:23:18.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.077 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383771756000002, 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:23:18.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383761568000001, 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.082 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:23:18.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383752228999999, 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:23:18.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:23:18.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383743069000001, 2024-09-11T05:23:18.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:18.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:23:18.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383731874999999, 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.096 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383707934, 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:23:18.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:23:18.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.383696317999998, 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:23:18.105 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:23:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.110 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:18.111 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:18.112 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:18.111+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:18.212 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:18.212+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:18.260 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:18.260 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136841 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.676721+0000", 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58050012399999995, 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58052092099999997, 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136841 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676721+0000", 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676721+0000", 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676722+0000", 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6100000000000001e-07 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676724+0000", 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.34e-06 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676730+0000", 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9309999999999996e-06 2024-09-11T05:23:18.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676735+0000", 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6229999999999996e-06 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676809+0000", 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4103999999999994e-05 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676814+0000", 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7400000000000004e-06 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136965 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681848+0000", 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57537297799999998, 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57543453600000005, 2024-09-11T05:23:18.265 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136965 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681848+0000", 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681848+0000", 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681849+0000", 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681851+0000", 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7859999999999999e-06 2024-09-11T05:23:18.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681857+0000", 2024-09-11T05:23:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.964e-06 2024-09-11T05:23:18.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681862+0000", 2024-09-11T05:23:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4280000000000004e-06 2024-09-11T05:23:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682732+0000", 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00086999400000000002 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682738+0000", 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136966 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.270 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681868+0000", 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57535365699999996, 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57544762900000002, 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136966 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681868+0000", 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681868+0000", 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681868+0000", 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681870+0000", 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8139999999999999e-06 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681876+0000", 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2090000000000002e-06 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681881+0000", 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5220000000000001e-06 2024-09-11T05:23:18.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682762+0000", 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00088157000000000003 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682768+0000", 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9750000000000004e-06 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.274 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136967 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681886+0000", 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57533500900000001, 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57546029899999995, 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.275 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136967 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681886+0000", 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681886+0000", 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681887+0000", 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681896+0000", 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7409999999999998e-06 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681902+0000", 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5579999999999997e-06 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681907+0000", 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0089999999999998e-06 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682790+0000", 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00088270799999999995 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682797+0000", 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9779999999999999e-06 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3.80269691 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.279 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59983609599999999, 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59999381200000002, 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.280 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:18.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.69621946899999998, 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.69640885600000002, 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.288 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59434538000000003, 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59456598299999996, 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:18.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59431898100000002, 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59457159199999998, 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.293 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:18.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.297 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3.ed0c8f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59968060000000001, 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59996454499999996, 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:18.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59428379200000003, 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59459860200000003, 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.302 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59426199300000004, 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59460768600000002, 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:18.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136920 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681244+0000", 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57597765400000001, 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57635427800000005, 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.311 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136920 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681244+0000", 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681244+0000", 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681244+0000", 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681246+0000", 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2589999999999999e-06 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681253+0000", 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4099999999999996e-06 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681258+0000", 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:23:18.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681321+0000", 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2298000000000006e-05 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681329+0000", 2024-09-11T05:23:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0849999999999997e-06 2024-09-11T05:23:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59424066399999997, 2024-09-11T05:23:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59464840699999999, 2024-09-11T05:23:18.317 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:18.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:18.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136921 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681273+0000", 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57594842800000001, 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57638730900000001, 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136921 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681273+0000", 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681273+0000", 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681273+0000", 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681276+0000", 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3879999999999998e-06 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681283+0000", 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2640000000000002e-06 2024-09-11T05:23:18.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681289+0000", 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5339999999999999e-06 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682504+0000", 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001215755 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682512+0000", 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2300000000000002e-06 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59421994499999997, 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59469242300000003, 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:18.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:18.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136922 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681348+0000", 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57587396099999999, 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57637761399999998, 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136922 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681348+0000", 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681348+0000", 2024-09-11T05:23:18.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681348+0000", 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5600000000000005e-07 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681362+0000", 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3329000000000001e-05 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681371+0000", 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0250000000000008e-06 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681377+0000", 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7710000000000001e-06 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682535+0000", 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001157854 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682541+0000", 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7649999999999999e-06 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58995610099999996, 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59049037000000004, 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.335 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:18.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58991041, 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59047523199999996, 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:18.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:18.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:18.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136992 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.345 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.682094+0000", 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57512754799999999, 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57572337500000004, 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136992 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682094+0000", 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682094+0000", 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682094+0000", 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682096+0000", 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7710000000000001e-06 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682102+0000", 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682106+0000", 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5140000000000003e-06 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682819+0000", 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00071307300000000005 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682825+0000", 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9479999999999996e-06 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.349 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.350 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58987047199999998, 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59049707399999996, 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136767 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674440+0000", 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58278105999999996, 2024-09-11T05:23:18.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58343854900000003, 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136767 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674440+0000", 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674440+0000", 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674441+0000", 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.96e-07 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674443+0000", 2024-09-11T05:23:18.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1019999999999999e-06 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674449+0000", 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0959999999999997e-06 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674454+0000", 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7899999999999999e-06 2024-09-11T05:23:18.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674492+0000", 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8538999999999998e-05 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674499+0000", 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6630000000000004e-06 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136993 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.682112+0000", 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57510972999999999, 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57579822000000003, 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.360 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136993 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682112+0000", 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682112+0000", 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682112+0000", 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2e-07 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682114+0000", 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.711e-06 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682120+0000", 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7860000000000002e-06 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682124+0000", 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5399999999999997e-06 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682849+0000", 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00072476099999999998 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682855+0000", 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.364 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136768 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674467+0000", 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58275483699999997, 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58349783099999997, 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136768 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674467+0000", 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674467+0000", 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674467+0000", 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:18.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674469+0000", 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3760000000000002e-06 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674476+0000", 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9689999999999997e-06 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674481+0000", 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0000000000000004e-06 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674525+0000", 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3543e-05 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674530+0000", 2024-09-11T05:23:18.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4750000000000001e-06 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136929 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681464+0000", 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57575749899999995, 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57653324500000003, 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136929 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681464+0000", 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681464+0000", 2024-09-11T05:23:18.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681464+0000", 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7500000000000001e-07 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681466+0000", 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1050000000000002e-06 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681473+0000", 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0360000000000001e-06 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681479+0000", 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0699999999999997e-06 2024-09-11T05:23:18.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682562+0000", 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001083732 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682568+0000", 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6010000000000002e-06 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136994 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.682130+0000", 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57509178299999997, 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57589984400000005, 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136994 2024-09-11T05:23:18.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682130+0000", 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682130+0000", 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682130+0000", 2024-09-11T05:23:18.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682139+0000", 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6989999999999992e-06 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682145+0000", 2024-09-11T05:23:18.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3219999999999998e-06 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682155+0000", 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7380000000000006e-06 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682877+0000", 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00072232799999999995 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682883+0000", 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5979999999999996e-06 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.582733116, 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58357405399999995, 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.378 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:18.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136930 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.383 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681485+0000", 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57573633099999999, 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57660970700000003, 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136930 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681485+0000", 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681485+0000", 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681486+0000", 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681488+0000", 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1890000000000001e-06 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681494+0000", 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681498+0000", 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682590+0000", 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001091383 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682597+0000", 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1369999999999996e-06 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136789 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.387 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.675187+0000", 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58203412300000001, 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58294087800000005, 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136789 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675187+0000", 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675187+0000", 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675188+0000", 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3099999999999997e-07 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675193+0000", 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5940000000000004e-06 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675201+0000", 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.456e-06 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675208+0000", 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.72e-06 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675255+0000", 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6937999999999997e-05 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675261+0000", 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.657e-06 2024-09-11T05:23:18.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136931 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681504+0000", 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57571715000000001, 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.576687485, 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136931 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681504+0000", 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681504+0000", 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681505+0000", 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2300000000000002e-07 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681515+0000", 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662000000000001e-05 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681521+0000", 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1770000000000003e-06 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681527+0000", 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1159999999999998e-06 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682622+0000", 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010949989999999999 2024-09-11T05:23:18.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682628+0000", 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2049999999999999e-06 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136790 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.675227+0000", 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58199468899999995, 2024-09-11T05:23:18.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58301330500000004, 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136790 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675227+0000", 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675227+0000", 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675227+0000", 2024-09-11T05:23:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9200000000000001e-07 2024-09-11T05:23:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675230+0000", 2024-09-11T05:23:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9280000000000002e-06 2024-09-11T05:23:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675239+0000", 2024-09-11T05:23:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.32e-06 2024-09-11T05:23:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675244+0000", 2024-09-11T05:23:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8150000000000002e-06 2024-09-11T05:23:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675291+0000", 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675296+0000", 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5110000000000003e-06 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136791 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.675253+0000", 2024-09-11T05:23:18.403 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58196834399999997, 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58301986699999997, 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.404 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136791 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675253+0000", 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675253+0000", 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675254+0000", 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.58e-07 2024-09-11T05:23:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675256+0000", 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.666e-06 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675264+0000", 2024-09-11T05:23:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9230000000000002e-06 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675269+0000", 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0379999999999999e-06 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675318+0000", 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8763000000000001e-05 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.675323+0000", 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3090000000000003e-06 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58966806699999996, 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59075186800000001, 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136938 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681591+0000", 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57563018200000005, 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57674487500000005, 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136938 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681591+0000", 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681591+0000", 2024-09-11T05:23:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681592+0000", 2024-09-11T05:23:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1100000000000002e-07 2024-09-11T05:23:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681593+0000", 2024-09-11T05:23:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5719999999999999e-06 2024-09-11T05:23:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681599+0000", 2024-09-11T05:23:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4229999999999996e-06 2024-09-11T05:23:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681604+0000", 2024-09-11T05:23:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682649+0000", 2024-09-11T05:23:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010454609999999999 2024-09-11T05:23:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682655+0000", 2024-09-11T05:23:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5520000000000004e-06 2024-09-11T05:23:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58964519699999995, 2024-09-11T05:23:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59079201299999995, 2024-09-11T05:23:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136939 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681610+0000", 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57561133399999997, 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57678915399999997, 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136939 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681610+0000", 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681610+0000", 2024-09-11T05:23:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681611+0000", 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681613+0000", 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.069e-06 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681619+0000", 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5320000000000003e-06 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681625+0000", 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682676+0000", 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010513709999999999 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682682+0000", 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.925e-06 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:137011 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.682285+0000", 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57493652699999998, 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57614626300000005, 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137011 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682285+0000", 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682285+0000", 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682285+0000", 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682287+0000", 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.736e-06 2024-09-11T05:23:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682293+0000", 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4529999999999999e-06 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682298+0000", 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7110000000000003e-06 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682904+0000", 2024-09-11T05:23:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060585999999999995 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682909+0000", 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4299999999999997e-06 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58962556200000005, 2024-09-11T05:23:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59086599200000001, 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136821 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.676460+0000", 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58076169499999997, 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58203396200000002, 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136821 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676460+0000", 2024-09-11T05:23:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676460+0000", 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676461+0000", 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4600000000000003e-07 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676465+0000", 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1659999999999996e-06 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676476+0000", 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1143e-05 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676483+0000", 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2860000000000002e-06 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676526+0000", 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2877000000000003e-05 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676533+0000", 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3719999999999999e-06 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136940 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.681631+0000", 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.575590822, 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57689745800000003, 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136940 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681631+0000", 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681631+0000", 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681631+0000", 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0900000000000002e-07 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681637+0000", 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5820000000000001e-06 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681643+0000", 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2149999999999998e-06 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.681648+0000", 2024-09-11T05:23:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.045e-06 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682703+0000", 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001055081 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682709+0000", 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7209999999999999e-06 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:137012 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.682303+0000", 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57491811199999998, 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57625550999999997, 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137012 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682303+0000", 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682303+0000", 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682304+0000", 2024-09-11T05:23:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3499999999999996e-07 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682306+0000", 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.79e-06 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682312+0000", 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9800000000000003e-06 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682316+0000", 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.639e-06 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682934+0000", 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000617521 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682940+0000", 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0809999999999999e-06 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136822 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.676500+0000", 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58072162900000002, 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.582110672, 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136822 2024-09-11T05:23:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676500+0000", 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676500+0000", 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676500+0000", 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.68e-07 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676503+0000", 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6000000000000001e-06 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676512+0000", 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5269999999999998e-06 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676517+0000", 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6180000000000003e-06 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676563+0000", 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5521e-05 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676569+0000", 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1099999999999999e-06 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136823 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.676525+0000", 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58069637900000004, 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58211803399999995, 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136823 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676525+0000", 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676525+0000", 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676525+0000", 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676528+0000", 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.266e-06 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676534+0000", 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1380000000000004e-06 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676539+0000", 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3539999999999999e-06 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676610+0000", 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0547000000000001e-05 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676618+0000", 2024-09-11T05:23:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1820000000000006e-06 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:137014 3.11 3.4dbf3751 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.682344+0000", 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.57487707499999996, 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.57633231200000001, 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 137014 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682344+0000", 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682344+0000", 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682345+0000", 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9299999999999999e-07 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682347+0000", 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7799999999999999e-06 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682352+0000", 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7599999999999999e-06 2024-09-11T05:23:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682357+0000", 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5249999999999999e-06 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682960+0000", 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060313299999999995 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.682966+0000", 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6269999999999997e-06 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59687411999999995, 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59836228999999996, 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.59684875599999998, 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59837084100000004, 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.596826729, 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59838244100000004, 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136839 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.676666+0000", 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58055496799999995, 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58214303300000003, 2024-09-11T05:23:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136839 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676666+0000", 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676666+0000", 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676667+0000", 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5900000000000002e-07 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676669+0000", 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-11T05:23:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676676+0000", 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676681+0000", 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.729e-06 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676722+0000", 2024-09-11T05:23:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1208999999999998e-05 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676729+0000", 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7559999999999999e-06 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136840 3.11 3.aeb40f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.676697+0000", 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.58052405799999995, 2024-09-11T05:23:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.58216174399999998, 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136840 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676697+0000", 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676697+0000", 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676698+0000", 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3600000000000003e-07 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676700+0000", 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.413e-06 2024-09-11T05:23:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676707+0000", 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5560000000000004e-06 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676712+0000", 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676779+0000", 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6934999999999995e-05 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.676785+0000", 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1929999999999998e-06 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 48 2024-09-11T05:23:18.486 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:18.488 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.0 primary-affinity to 0.598453 (8392202) 2024-09-11T05:23:18.488 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:18.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:18.487+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:18.588 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:18.588+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:18.629 INFO:teuthology.orchestra.run.smithi012.stdout:5700 writesame 0x2d1b5a7 thru 0x2d25326 data_size 0xa8(0x9d80 bytes) 2024-09-11T05:23:18.634 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:18.634 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:18.634 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:18.634 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:18.634 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:18.643 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:18.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:18.727 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:18.727+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:18.773 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:23:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.1418487069999999, 2024-09-11T05:23:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:23:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.793 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.793 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:23:18.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.793 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:23:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.798 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.227190096, 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:18.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1308067230000001, 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:18.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.130651227, 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:23:18.809 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:23:18.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1278447469999999, 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:18.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:18.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:18.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:23:18.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1278193830000001, 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:18.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:23:18.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1277973560000001, 2024-09-11T05:23:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:23:18.826 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.827 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:18.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:18.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:18.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:23:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:23:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:23:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:23:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:23:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:23:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1253160069999999, 2024-09-11T05:23:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:23:18.838 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.839 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:18.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:18.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:23:18.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.847 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1252896080000001, 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:18.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:18.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.125254419, 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.853 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:18.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:18.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:23:18.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.12523262, 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:18.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.868 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1252112910000001, 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.869 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.870 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.870 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.870 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.870 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.870 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:18.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.870 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:18.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.875 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1251905719999999, 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.876 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:18.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1209267279999999, 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.881 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:23:18.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.120881037, 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.887 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:18.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:23:18.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.120841099, 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:23:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1206386939999999, 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1206158239999999, 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:18.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:18.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:23:18.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.120596189, 2024-09-11T05:23:18.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:18.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:23:18.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.1137037430000001, 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:18.918 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:18.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:18.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:23:18.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:23:18.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.925 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:18.925 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:18.925 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:18.925 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:18.789+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:18.926 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:18.927 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:18.928 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:18.928 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:18.930 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:18.930 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:18.967 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:18.967+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:19.029 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:19.027+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:19.086 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:19.129 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:19.129+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:19.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:19.229+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:19.234 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:19.234 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:19.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:19.331 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:19.330+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:19.391 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:19.391 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:19.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:19.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:23:19.431 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:19.431+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:19.442 INFO:teuthology.orchestra.run.smithi012.stdout:5701 write 0xe9ea5b1 thru 0xe9f6e3b (0xc88b bytes) 2024-09-11T05:23:19.446 INFO:teuthology.orchestra.run.smithi012.stdout:5704 read 0x724bf75 thru 0x724e74e (0x27da bytes) 2024-09-11T05:23:19.446 INFO:teuthology.orchestra.run.smithi012.stdout:5706 write 0x3adfab4 thru 0x3ae70a0 (0x75ed bytes) 2024-09-11T05:23:19.450 INFO:teuthology.orchestra.run.smithi012.stdout:5709 punch from 0x640dba6 to 0x641b668, (0xdac2 bytes) 2024-09-11T05:23:19.450 INFO:teuthology.orchestra.run.smithi012.stdout:5711 read 0x4a5c983 thru 0x4a66bfc (0xa27a bytes) 2024-09-11T05:23:19.450 INFO:teuthology.orchestra.run.smithi012.stdout:5713 write 0xdf885ce thru 0xdf8ca39 (0x446c bytes) 2024-09-11T05:23:19.453 INFO:teuthology.orchestra.run.smithi012.stdout:5715 write 0x690c710 thru 0x691bbde (0xf4cf bytes) 2024-09-11T05:23:19.459 INFO:teuthology.orchestra.run.smithi012.stdout:5716 write 0x9c1d3fa thru 0x9c23b7d (0x6784 bytes) 2024-09-11T05:23:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:5717 read 0xd0118e9 thru 0xd01f482 (0xdb9a bytes) 2024-09-11T05:23:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:5718 write 0xe4c497b thru 0xe4c9c87 (0x530d bytes) 2024-09-11T05:23:19.468 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.468 INFO:teuthology.orchestra.run.smithi012.stdout:5720 read 0x4184db7 thru 0x41902e6 (0xb530 bytes) 2024-09-11T05:23:19.468 INFO:teuthology.orchestra.run.smithi012.stdout:5722 read 0x5d1d56f thru 0x5d25eba (0x894c bytes) 2024-09-11T05:23:19.468 INFO:teuthology.orchestra.run.smithi012.stdout:5724 read 0x39879c8 thru 0x3997192 (0xf7cb bytes) 2024-09-11T05:23:19.468 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.468 INFO:teuthology.orchestra.run.smithi012.stdout:5726 read 0xe8895fa thru 0xe8994d9 (0xfee0 bytes) 2024-09-11T05:23:19.469 INFO:teuthology.orchestra.run.smithi012.stdout:5727 read 0xc1a0920 thru 0xc1aaa3a (0xa11b bytes) 2024-09-11T05:23:19.469 INFO:teuthology.orchestra.run.smithi012.stdout:5728 writesame 0x83a1ba9 thru 0x83a4d69 data_size 0x1(0x31c1 bytes) 2024-09-11T05:23:19.477 INFO:teuthology.orchestra.run.smithi012.stdout:5729 read 0x8fae59a thru 0x8fb7a3c (0x94a3 bytes) 2024-09-11T05:23:19.477 INFO:teuthology.orchestra.run.smithi012.stdout:5730 punch from 0x64349c9 to 0x643a9f1, (0x6028 bytes) 2024-09-11T05:23:19.478 INFO:teuthology.orchestra.run.smithi012.stdout:5731 trunc from 0xe9f6e3c to 0xd4ed295 2024-09-11T05:23:19.489 INFO:teuthology.orchestra.run.smithi012.stdout:5733 punch from 0x68d31a3 to 0x68d5b1c, (0x2979 bytes) 2024-09-11T05:23:19.490 INFO:teuthology.orchestra.run.smithi012.stdout:5735 trunc from 0xd4ed295 to 0xdb0fe2f 2024-09-11T05:23:19.503 INFO:teuthology.orchestra.run.smithi012.stdout:5736 trunc from 0xdb0fe2f to 0x70b3d9d 2024-09-11T05:23:19.532 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:19.532+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:19.534 INFO:teuthology.orchestra.run.smithi012.stdout:5737 write 0x74659ea thru 0x7468195 (0x27ac bytes) 2024-09-11T05:23:19.545 INFO:teuthology.orchestra.run.smithi012.stdout:5738 trunc from 0x7468196 to 0xca99772 2024-09-11T05:23:19.550 INFO:teuthology.orchestra.run.smithi012.stdout:5740 punch from 0xbbdf7e to 0xbbf5e7, (0x1669 bytes) 2024-09-11T05:23:19.551 INFO:teuthology.orchestra.run.smithi012.stdout:5742 punch from 0x4877be5 to 0x4884c02, (0xd01d bytes) 2024-09-11T05:23:19.551 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.551 INFO:teuthology.orchestra.run.smithi012.stdout:5744 read 0x9337276 thru 0x93420bc (0xae47 bytes) 2024-09-11T05:23:19.551 INFO:teuthology.orchestra.run.smithi012.stdout:5745 read 0x8eecfbf thru 0x8ef2507 (0x5549 bytes) 2024-09-11T05:23:19.551 INFO:teuthology.orchestra.run.smithi012.stdout:5746 punch from 0x5009665 to 0x5012f64, (0x98ff bytes) 2024-09-11T05:23:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:5747 write 0xd7f40bb thru 0xd7ff580 (0xb4c6 bytes) 2024-09-11T05:23:19.561 INFO:teuthology.orchestra.run.smithi012.stdout:5748 read 0xc5f922d thru 0xc5f9a4e (0x822 bytes) 2024-09-11T05:23:19.570 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:19.570 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:19.575 INFO:teuthology.orchestra.run.smithi012.stdout:5749 trunc from 0xd7ff581 to 0x2933301 2024-09-11T05:23:19.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:19.613 INFO:teuthology.orchestra.run.smithi012.stdout:5750 write 0x8068baf thru 0x806e49f (0x58f1 bytes) 2024-09-11T05:23:19.616 INFO:teuthology.orchestra.run.smithi012.stdout:5751 write 0x762666f thru 0x7634731 (0xe0c3 bytes) 2024-09-11T05:23:19.621 INFO:teuthology.orchestra.run.smithi012.stdout:5752 punch from 0x2cced83 to 0x2cdb608, (0xc885 bytes) 2024-09-11T05:23:19.627 INFO:teuthology.orchestra.run.smithi012.stdout:5753 write 0x8934f8a thru 0x893c674 (0x76eb bytes) 2024-09-11T05:23:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:5757 writesame 0x25c8965 thru 0x25d870d data_size 0x1(0xfda9 bytes) 2024-09-11T05:23:19.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:19.632+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:19.676 INFO:teuthology.orchestra.run.smithi012.stdout:5758 read 0x1bd5434 thru 0x1be0d8e (0xb95b bytes) 2024-09-11T05:23:19.679 INFO:teuthology.orchestra.run.smithi012.stdout:5759 trunc from 0x893c675 to 0xb9e665c 2024-09-11T05:23:19.685 INFO:teuthology.orchestra.run.smithi012.stdout:5760 writesame 0x46cc319 thru 0x46d7ecf data_size 0x7(0xbbb7 bytes) 2024-09-11T05:23:19.691 INFO:teuthology.orchestra.run.smithi012.stdout:5762 read 0x1d18458 thru 0x1d1c14e (0x3cf7 bytes) 2024-09-11T05:23:19.691 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.691 INFO:teuthology.orchestra.run.smithi012.stdout:5764 write 0x196add5 thru 0x197572a (0xa956 bytes) 2024-09-11T05:23:19.696 INFO:teuthology.orchestra.run.smithi012.stdout:5767 read 0x9f925b9 thru 0x9f9d4d5 (0xaf1d bytes) 2024-09-11T05:23:19.707 INFO:teuthology.orchestra.run.smithi012.stdout:5768 trunc from 0xb9e665c to 0x1d512bc 2024-09-11T05:23:19.734 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:19.734+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:19.740 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:19.740 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:19.748 INFO:teuthology.orchestra.run.smithi012.stdout:5770 write 0xe766921 thru 0xe77520b (0xe8eb bytes) 2024-09-11T05:23:19.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:19.752 INFO:teuthology.orchestra.run.smithi012.stdout:5771 write 0x26596e2 thru 0x2662d79 (0x9698 bytes) 2024-09-11T05:23:19.760 INFO:teuthology.orchestra.run.smithi012.stdout:5773 trunc from 0xe77520c to 0xb559b64 2024-09-11T05:23:19.771 INFO:teuthology.orchestra.run.smithi012.stdout:5774 write 0x2099f89 thru 0x209ab75 (0xbed bytes) 2024-09-11T05:23:19.774 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.774 INFO:teuthology.orchestra.run.smithi012.stdout:5777 read 0x1930711 thru 0x193d14a (0xca3a bytes) 2024-09-11T05:23:19.774 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.784 INFO:teuthology.orchestra.run.smithi012.stdout:5780 writesame 0xebe0da3 thru 0xebef778 data_size 0x21(0xe9d6 bytes) 2024-09-11T05:23:19.784 INFO:teuthology.orchestra.run.smithi012.stdout:5782 write 0x39bb09d thru 0x39c0267 (0x51cb bytes) 2024-09-11T05:23:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:5784 writesame 0x9c962ff thru 0x9c99375 data_size 0x1(0x3077 bytes) 2024-09-11T05:23:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:5787 trunc from 0xebef779 to 0x4dbe08a 2024-09-11T05:23:19.820 INFO:teuthology.orchestra.run.smithi012.stdout:5788 punch from 0x373a952 to 0x374795c, (0xd00a bytes) 2024-09-11T05:23:19.829 INFO:teuthology.orchestra.run.smithi012.stdout:5791 write 0x8408331 thru 0x840fba5 (0x7875 bytes) 2024-09-11T05:23:19.836 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:19.836+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:19.840 INFO:teuthology.orchestra.run.smithi012.stdout:5792 write 0xad1ebfb thru 0xad2dc81 (0xf087 bytes) 2024-09-11T05:23:19.845 INFO:teuthology.orchestra.run.smithi012.stdout:5794 writesame 0x67e751a thru 0x67f1ad5 data_size 0x2(0xa5bc bytes) 2024-09-11T05:23:19.858 INFO:teuthology.orchestra.run.smithi012.stdout:5795 read 0x3ae848f thru 0x3af6552 (0xe0c4 bytes) 2024-09-11T05:23:19.858 INFO:teuthology.orchestra.run.smithi012.stdout:5796 read 0x7ddfe4d thru 0x7de8e13 (0x8fc7 bytes) 2024-09-11T05:23:19.858 INFO:teuthology.orchestra.run.smithi012.stdout:5797 write 0x9b5be02 thru 0x9b609db (0x4bda bytes) 2024-09-11T05:23:19.862 INFO:teuthology.orchestra.run.smithi012.stdout:5798 write 0x26c0bd1 thru 0x26c4a9e (0x3ece bytes) 2024-09-11T05:23:19.865 INFO:teuthology.orchestra.run.smithi012.stdout:5799 read 0x58b0808 thru 0x58bde5b (0xd654 bytes) 2024-09-11T05:23:19.865 INFO:teuthology.orchestra.run.smithi012.stdout:5800 punch from 0x31a06be to 0x31ac161, (0xbaa3 bytes) 2024-09-11T05:23:19.865 INFO:teuthology.orchestra.run.smithi012.stdout:5801 write 0x30298a3 thru 0x30328a5 (0x9003 bytes) 2024-09-11T05:23:19.868 INFO:teuthology.orchestra.run.smithi012.stdout:5802 write 0x7457441 thru 0x7461736 (0xa2f6 bytes) 2024-09-11T05:23:19.873 INFO:teuthology.orchestra.run.smithi012.stdout:5804 write 0x3d3ccce thru 0x3d47a25 (0xad58 bytes) 2024-09-11T05:23:19.877 INFO:teuthology.orchestra.run.smithi012.stdout:5806 read 0x5351fd3 thru 0x5357108 (0x5136 bytes) 2024-09-11T05:23:19.877 INFO:teuthology.orchestra.run.smithi012.stdout:5811 read 0x6a42472 thru 0x6a49027 (0x6bb6 bytes) 2024-09-11T05:23:19.877 INFO:teuthology.orchestra.run.smithi012.stdout:5813 writesame 0x364be0e thru 0x365542b data_size 0x7e(0x961e bytes) 2024-09-11T05:23:19.879 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:19.879 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:19.881 INFO:teuthology.orchestra.run.smithi012.stdout:5814 punch from 0x2835d47 to 0x283ab36, (0x4def bytes) 2024-09-11T05:23:19.881 INFO:teuthology.orchestra.run.smithi012.stdout:5816 write 0x90d7625 thru 0x90e2fca (0xb9a6 bytes) 2024-09-11T05:23:19.885 INFO:teuthology.orchestra.run.smithi012.stdout:5817 read 0x3255038 thru 0x325ed2f (0x9cf8 bytes) 2024-09-11T05:23:19.890 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:19.894 INFO:teuthology.orchestra.run.smithi012.stdout:5818 write 0xd9f0373 thru 0xd9f566f (0x52fd bytes) 2024-09-11T05:23:19.897 INFO:teuthology.orchestra.run.smithi012.stdout:5820 writesame 0xd4915d2 thru 0xd498c63 data_size 0x3(0x7692 bytes) 2024-09-11T05:23:19.903 INFO:teuthology.orchestra.run.smithi012.stdout:5821 writesame 0x3e5fd9 thru 0x3e7ffb data_size 0x1(0x2023 bytes) 2024-09-11T05:23:19.917 INFO:teuthology.orchestra.run.smithi012.stdout:5822 trunc from 0xd9f5670 to 0xb933dc8 2024-09-11T05:23:19.926 INFO:teuthology.orchestra.run.smithi012.stdout:5823 read 0x8a10673 thru 0x8a13eb2 (0x3840 bytes) 2024-09-11T05:23:19.927 INFO:teuthology.orchestra.run.smithi012.stdout:5824 write 0xb299969 thru 0xb29e872 (0x4f0a bytes) 2024-09-11T05:23:19.929 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:19.929 INFO:teuthology.orchestra.run.smithi012.stdout:5829 writesame 0xab7aa4f thru 0xab83894 data_size 0x1(0x8e46 bytes) 2024-09-11T05:23:19.936 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:19.935+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:19.941 INFO:teuthology.orchestra.run.smithi012.stdout:5830 writesame 0xa630589 thru 0xa63fb2a data_size 0x2(0xf5a2 bytes) 2024-09-11T05:23:19.953 INFO:teuthology.orchestra.run.smithi012.stdout:5831 read 0x380bf7b thru 0x380ffcc (0x4052 bytes) 2024-09-11T05:23:19.954 INFO:teuthology.orchestra.run.smithi012.stdout:5832 writesame 0xd479ec thru 0xd4cb9d data_size 0x1(0x51b2 bytes) 2024-09-11T05:23:19.967 INFO:teuthology.orchestra.run.smithi012.stdout:5833 write 0x8118e70 thru 0x812850a (0xf69b bytes) 2024-09-11T05:23:19.982 INFO:teuthology.orchestra.run.smithi012.stdout:5834 trunc from 0xb933dc8 to 0x30c87bc 2024-09-11T05:23:19.999 INFO:teuthology.orchestra.run.smithi012.stdout:5835 read 0x13db21f thru 0x13e271e (0x7500 bytes) 2024-09-11T05:23:20.002 INFO:teuthology.orchestra.run.smithi012.stdout:5836 trunc from 0x30c87bc to 0x50cb823 2024-09-11T05:23:20.008 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.009 INFO:teuthology.orchestra.run.smithi012.stdout:5839 read 0x4812d4c thru 0x4817188 (0x443d bytes) 2024-09-11T05:23:20.009 INFO:teuthology.orchestra.run.smithi012.stdout:5840 punch from 0x4e25499 to 0x4e32ba1, (0xd708 bytes) 2024-09-11T05:23:20.013 INFO:teuthology.orchestra.run.smithi012.stdout:5841 write 0x57a433e thru 0x57aa630 (0x62f3 bytes) 2024-09-11T05:23:20.016 INFO:teuthology.orchestra.run.smithi012.stdout:5842 read 0x404aeec thru 0x40530cd (0x81e2 bytes) 2024-09-11T05:23:20.017 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:20.017 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:20.027 INFO:teuthology.orchestra.run.smithi012.stdout:5843 write 0x8930cf0 thru 0x8940c35 (0xff46 bytes) 2024-09-11T05:23:20.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:20.039 INFO:teuthology.orchestra.run.smithi012.stdout:5844 write 0x9a5b090 thru 0x9a61ab0 (0x6a21 bytes) 2024-09-11T05:23:20.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:20.038+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:20.043 INFO:teuthology.orchestra.run.smithi012.stdout:5845 writesame 0x8f72225 thru 0x8f7d4f4 data_size 0x8(0xb2d0 bytes) 2024-09-11T05:23:20.048 INFO:teuthology.orchestra.run.smithi012.stdout:5846 write 0x64ce6c7 thru 0x64cfda2 (0x16dc bytes) 2024-09-11T05:23:20.062 INFO:teuthology.orchestra.run.smithi012.stdout:5847 write 0xda57ca9 thru 0xda631ce (0xb526 bytes) 2024-09-11T05:23:20.067 INFO:teuthology.orchestra.run.smithi012.stdout:5850 punch from 0x302d56d to 0x30316c4, (0x4157 bytes) 2024-09-11T05:23:20.067 INFO:teuthology.orchestra.run.smithi012.stdout:5851 write 0x7904d0c thru 0x7909c13 (0x4f08 bytes) 2024-09-11T05:23:20.071 INFO:teuthology.orchestra.run.smithi012.stdout:5852 read 0x2e77c19 thru 0x2e7e6c4 (0x6aac bytes) 2024-09-11T05:23:20.071 INFO:teuthology.orchestra.run.smithi012.stdout:5853 punch from 0xd142d20 to 0xd144e3a, (0x211a bytes) 2024-09-11T05:23:20.072 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.072 INFO:teuthology.orchestra.run.smithi012.stdout:5855 write 0x1a3946 thru 0x1b2c62 (0xf31d bytes) 2024-09-11T05:23:20.079 INFO:teuthology.orchestra.run.smithi012.stdout:5856 writesame 0x4e9eacc thru 0x4ea2f82 data_size 0x7(0x44b7 bytes) 2024-09-11T05:23:20.083 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.083 INFO:teuthology.orchestra.run.smithi012.stdout:5858 writesame 0x313c684 thru 0x3140af8 data_size 0x5(0x4475 bytes) 2024-09-11T05:23:20.098 INFO:teuthology.orchestra.run.smithi012.stdout:5859 trunc from 0xda631cf to 0x4f090e8 2024-09-11T05:23:20.120 INFO:teuthology.orchestra.run.smithi012.stdout:5861 write 0x829cb01 thru 0x82a192a (0x4e2a bytes) 2024-09-11T05:23:20.131 INFO:teuthology.orchestra.run.smithi012.stdout:5863 writesame 0x943388a thru 0x9435642 data_size 0x1(0x1db9 bytes) 2024-09-11T05:23:20.132 INFO:teuthology.orchestra.run.smithi012.stdout:5864 read 0x839c2d7 thru 0x83a42f0 (0x801a bytes) 2024-09-11T05:23:20.132 INFO:teuthology.orchestra.run.smithi012.stdout:5869 read 0x5fe95dc thru 0x5ff335e (0x9d83 bytes) 2024-09-11T05:23:20.132 INFO:teuthology.orchestra.run.smithi012.stdout:5871 writesame 0xfce43e thru 0xfd72b0 data_size 0x1(0x8e73 bytes) 2024-09-11T05:23:20.138 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:20.138+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:20.149 INFO:teuthology.orchestra.run.smithi012.stdout:5872 write 0x7113029 thru 0x7122bcc (0xfba4 bytes) 2024-09-11T05:23:20.156 INFO:teuthology.orchestra.run.smithi012.stdout:5873 trunc from 0x9435643 to 0x7915983 2024-09-11T05:23:20.166 INFO:teuthology.orchestra.run.smithi012.stdout:5876 writesame 0xa2b412 thru 0xa31c8a data_size 0x5(0x6879 bytes) 2024-09-11T05:23:20.169 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:20.169 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:20.173 INFO:teuthology.orchestra.run.smithi012.stdout:5877 read 0x626122a thru 0x626a1b5 (0x8f8c bytes) 2024-09-11T05:23:20.173 INFO:teuthology.orchestra.run.smithi012.stdout:5879 punch from 0x1280501 to 0x1289e1f, (0x991e bytes) 2024-09-11T05:23:20.174 INFO:teuthology.orchestra.run.smithi012.stdout:5881 punch from 0x4cd3810 to 0x4cd7ddf, (0x45cf bytes) 2024-09-11T05:23:20.174 INFO:teuthology.orchestra.run.smithi012.stdout:5882 write 0xed4241 thru 0xedc889 (0x8649 bytes) 2024-09-11T05:23:20.179 INFO:teuthology.orchestra.run.smithi012.stdout:5883 read 0x47d91a9 thru 0x47dbf92 (0x2dea bytes) 2024-09-11T05:23:20.179 INFO:teuthology.orchestra.run.smithi012.stdout:5884 punch from 0x1494fe3 to 0x149bead, (0x6eca bytes) 2024-09-11T05:23:20.180 INFO:teuthology.orchestra.run.smithi012.stdout:5885 read 0x65972f5 thru 0x659f085 (0x7d91 bytes) 2024-09-11T05:23:20.181 INFO:teuthology.orchestra.run.smithi012.stdout:5886 trunc from 0x7915983 to 0x909ca1c 2024-09-11T05:23:20.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:20.200 INFO:teuthology.orchestra.run.smithi012.stdout:5887 write 0xdd2be2d thru 0xdd2dd38 (0x1f0c bytes) 2024-09-11T05:23:20.215 INFO:teuthology.orchestra.run.smithi012.stdout:5888 trunc from 0xdd2dd39 to 0x21f9f8f 2024-09-11T05:23:20.235 INFO:teuthology.orchestra.run.smithi012.stdout:5889 trunc from 0x21f9f8f to 0x8761f99 2024-09-11T05:23:20.239 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:20.238+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:20.241 INFO:teuthology.orchestra.run.smithi012.stdout:5891 punch from 0x4bcc08e to 0x4bce3c8, (0x233a bytes) 2024-09-11T05:23:20.244 INFO:teuthology.orchestra.run.smithi012.stdout:5892 trunc from 0x8761f99 to 0xbbd96ee 2024-09-11T05:23:20.250 INFO:teuthology.orchestra.run.smithi012.stdout:5893 write 0x1ec674f thru 0x1ed2499 (0xbd4b bytes) 2024-09-11T05:23:20.255 INFO:teuthology.orchestra.run.smithi012.stdout:5895 write 0xb7da226 thru 0xb7dc04c (0x1e27 bytes) 2024-09-11T05:23:20.346 INFO:teuthology.orchestra.run.smithi012.stdout:5899 writesame 0xa4738c0 thru 0xa480704 data_size 0x3b(0xce45 bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5900 trunc from 0xbbd96ee to 0x5d92ff3 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5901 read 0x21e5cab thru 0x21f2e4b (0xd1a1 bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5902 punch from 0x4fbef23 to 0x4fce85a, (0xf937 bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5904 read 0x2afcf0e thru 0x2afd0ed (0x1e0 bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5905 trunc from 0x5d92ff3 to 0x3b00c8e 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5906 read 0x1da397b thru 0x1db272b (0xedb1 bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5908 punch from 0x32e1781 to 0x32eda0c, (0xc28b bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5909 writesame 0xd4da6da thru 0xd4e0cb2 data_size 0x3(0x65d9 bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5910 write 0xd185dba thru 0xd189db1 (0x3ff8 bytes) 2024-09-11T05:23:20.347 INFO:teuthology.orchestra.run.smithi012.stdout:5912 writesame 0x3967f5 thru 0x39aa9b data_size 0x1(0x42a7 bytes) 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:5914 write 0x29cd82c thru 0x29d12f7 (0x3acc bytes) 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:5916 read 0xa219a9 thru 0xa22cde (0x1336 bytes) 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:5917 write 0xa291b8d thru 0xa297762 (0x5bd6 bytes) 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:5919 punch from 0x1572a3c to 0x15801e5, (0xd7a9 bytes) 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:5920 read 0x80e4c5d thru 0x80f3f70 (0xf314 bytes) 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:5922 write 0xb114ddf thru 0xb11a72b (0x594d bytes) 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.348 INFO:teuthology.orchestra.run.smithi012.stdout:5924 writesame 0xd59d145 thru 0xd5ab978 data_size 0x2c(0xe834 bytes) 2024-09-11T05:23:20.349 INFO:teuthology.orchestra.run.smithi012.stdout:5925 read 0x8b0f5df thru 0x8b1d5e6 (0xe008 bytes) 2024-09-11T05:23:20.349 INFO:teuthology.orchestra.run.smithi012.stdout:5926 trunc from 0xd5ab979 to 0xad10140 2024-09-11T05:23:20.349 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:20.349 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:20.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:20.344+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:20.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:20.361 INFO:teuthology.orchestra.run.smithi012.stdout:5927 write 0xda98f31 thru 0xdaa86f2 (0xf7c2 bytes) 2024-09-11T05:23:20.370 INFO:teuthology.orchestra.run.smithi012.stdout:5928 write 0xb2913fd thru 0xb299965 (0x8569 bytes) 2024-09-11T05:23:20.371 INFO:teuthology.orchestra.run.smithi012.stdout:5929 read 0x383b8e4 thru 0x384b664 (0xfd81 bytes) 2024-09-11T05:23:20.371 INFO:teuthology.orchestra.run.smithi012.stdout:5931 write 0xce59593 thru 0xce5b85c (0x22ca bytes) 2024-09-11T05:23:20.374 INFO:teuthology.orchestra.run.smithi012.stdout:5932 read 0x5b6670f thru 0x5b6c0a3 (0x5995 bytes) 2024-09-11T05:23:20.374 INFO:teuthology.orchestra.run.smithi012.stdout:5933 punch from 0x6e34f8d to 0x6e3ecfd, (0x9d70 bytes) 2024-09-11T05:23:20.381 INFO:teuthology.orchestra.run.smithi012.stdout:5934 trunc from 0xdaa86f3 to 0x7ee3ad8 2024-09-11T05:23:20.392 INFO:teuthology.orchestra.run.smithi012.stdout:5935 write 0x9b8ca6 thru 0x9bffea (0x7345 bytes) 2024-09-11T05:23:20.395 INFO:teuthology.orchestra.run.smithi012.stdout:5936 read 0x3249c8e thru 0x324b8fc (0x1c6f bytes) 2024-09-11T05:23:20.395 INFO:teuthology.orchestra.run.smithi012.stdout:5937 read 0x3c7cab5 thru 0x3c8b818 (0xed64 bytes) 2024-09-11T05:23:20.396 INFO:teuthology.orchestra.run.smithi012.stdout:5938 write 0x22591d8 thru 0x2267201 (0xe02a bytes) 2024-09-11T05:23:20.399 INFO:teuthology.orchestra.run.smithi012.stdout:5939 punch from 0x384dc8e to 0x38565a6, (0x8918 bytes) 2024-09-11T05:23:20.412 INFO:teuthology.orchestra.run.smithi012.stdout:5940 write 0xec0255d thru 0xec0e5a3 (0xc047 bytes) 2024-09-11T05:23:20.417 INFO:teuthology.orchestra.run.smithi012.stdout:5941 read 0xcf248db thru 0xcf28c3c (0x4362 bytes) 2024-09-11T05:23:20.417 INFO:teuthology.orchestra.run.smithi012.stdout:5943 writesame 0x6ab4c2b thru 0x6ac47a2 data_size 0x34(0xfb78 bytes) 2024-09-11T05:23:20.422 INFO:teuthology.orchestra.run.smithi012.stdout:5945 writesame 0xca8403 thru 0xcb059f data_size 0x1(0x819d bytes) 2024-09-11T05:23:20.443 INFO:teuthology.orchestra.run.smithi012.stdout:5946 punch from 0x2d08df6 to 0x2d10aec, (0x7cf6 bytes) 2024-09-11T05:23:20.443 INFO:teuthology.orchestra.run.smithi012.stdout:5947 write 0x9e2551f thru 0x9e29c87 (0x4769 bytes) 2024-09-11T05:23:20.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:20.445+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:20.463 INFO:teuthology.orchestra.run.smithi012.stdout:5948 trunc from 0xec0e5a4 to 0xb2b82b 2024-09-11T05:23:20.484 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.484 INFO:teuthology.orchestra.run.smithi012.stdout:5950 read 0x64554 thru 0x6ae07 (0x68b4 bytes) 2024-09-11T05:23:20.485 INFO:teuthology.orchestra.run.smithi012.stdout:5951 punch from 0x64c03a to 0x654735, (0x86fb bytes) 2024-09-11T05:23:20.485 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.490 INFO:teuthology.orchestra.run.smithi012.stdout:5954 trunc from 0xb2b82b to 0x561a8e8 2024-09-11T05:23:20.496 INFO:teuthology.orchestra.run.smithi012.stdout:5955 punch from 0x95f928 to 0x9684d6, (0x8bae bytes) 2024-09-11T05:23:20.497 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:20.497 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:20.497 INFO:teuthology.orchestra.run.smithi012.stdout:5956 trunc from 0x561a8e8 to 0x4eae32d 2024-09-11T05:23:20.503 INFO:teuthology.orchestra.run.smithi012.stdout:5959 read 0x35993f1 thru 0x359c7a8 (0x33b8 bytes) 2024-09-11T05:23:20.503 INFO:teuthology.orchestra.run.smithi012.stdout:5960 flatten 2024-09-11T05:23:20.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:20.543 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.554 INFO:teuthology.orchestra.run.smithi012.stdout:5962 write 0x96fe942 thru 0x970e618 (0xfcd7 bytes) 2024-09-11T05:23:20.554 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:20.554+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:20.559 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.569 INFO:teuthology.orchestra.run.smithi012.stdout:5964 trunc from 0x970e619 to 0xbabb78 2024-09-11T05:23:20.580 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.580 INFO:teuthology.orchestra.run.smithi012.stdout:5967 read 0x2f0791 thru 0x2f4fda (0x484a bytes) 2024-09-11T05:23:20.598 INFO:teuthology.orchestra.run.smithi012.stdout:5968 write 0xa596cab thru 0xa59c686 (0x59dc bytes) 2024-09-11T05:23:20.602 INFO:teuthology.orchestra.run.smithi012.stdout:5970 punch from 0x68160a1 to 0x6820f5c, (0xaebb bytes) 2024-09-11T05:23:20.602 INFO:teuthology.orchestra.run.smithi012.stdout:5972 read 0x5c89762 thru 0x5c8a9b0 (0x124f bytes) 2024-09-11T05:23:20.602 INFO:teuthology.orchestra.run.smithi012.stdout:5974 read 0x8c10944 thru 0x8c1accd (0xa38a bytes) 2024-09-11T05:23:20.602 INFO:teuthology.orchestra.run.smithi012.stdout:5975 read 0x6eab5e6 thru 0x6eb614b (0xab66 bytes) 2024-09-11T05:23:20.603 INFO:teuthology.orchestra.run.smithi012.stdout:5979 write 0x79a2a45 thru 0x79a3fa5 (0x1561 bytes) 2024-09-11T05:23:20.605 INFO:teuthology.orchestra.run.smithi012.stdout:5980 write 0x6b579e4 thru 0x6b58d40 (0x135d bytes) 2024-09-11T05:23:20.609 INFO:teuthology.orchestra.run.smithi012.stdout:5981 read 0x1ee94e0 thru 0x1ef7cd2 (0xe7f3 bytes) 2024-09-11T05:23:20.609 INFO:teuthology.orchestra.run.smithi012.stdout:5983 writesame 0x6a0de73 thru 0x6a1376a data_size 0x27(0x58f8 bytes) 2024-09-11T05:23:20.613 INFO:teuthology.orchestra.run.smithi012.stdout:5984 read 0x8bd8c0 thru 0x8c8608 (0xad49 bytes) 2024-09-11T05:23:20.617 INFO:teuthology.orchestra.run.smithi012.stdout:5985 trunc from 0xa59c687 to 0xd0a8d91 2024-09-11T05:23:20.629 INFO:teuthology.orchestra.run.smithi012.stdout:5986 write 0xdcd4ac1 thru 0xdcdc769 (0x7ca9 bytes) 2024-09-11T05:23:20.633 INFO:teuthology.orchestra.run.smithi012.stdout:compare and write disabled 2024-09-11T05:23:20.633 INFO:teuthology.orchestra.run.smithi012.stdout:5989 punch from 0x687071f to 0x68743e5, (0x3cc6 bytes) 2024-09-11T05:23:20.633 INFO:teuthology.orchestra.run.smithi012.stdout:5991 writesame 0x4e7b5d8 thru 0x4e86831 data_size 0x25(0xb25a bytes) 2024-09-11T05:23:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:23:20.640 INFO:teuthology.orchestra.run.smithi012.stdout:5992 write 0xba1dfc thru 0xba7c35 (0x5e3a bytes) 2024-09-11T05:23:20.644 INFO:teuthology.orchestra.run.smithi012.stdout:5993 read 0x66b1c8d thru 0x66ba9d2 (0x8d46 bytes) 2024-09-11T05:23:20.644 INFO:teuthology.orchestra.run.smithi012.stdout:5994 read 0x391c25c thru 0x3925f9c (0x9d41 bytes) 2024-09-11T05:23:20.644 INFO:teuthology.orchestra.run.smithi012.stdout:5995 punch from 0x1e186b6 to 0x1e1ee30, (0x677a bytes) 2024-09-11T05:23:20.645 INFO:teuthology.orchestra.run.smithi012.stdout:5996 writesame 0x5eb3bde thru 0x5ebad6d data_size 0x4(0x7190 bytes) 2024-09-11T05:23:20.647 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:20.646+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:20.651 INFO:teuthology.orchestra.run.smithi012.stdout:5998 punch from 0x287fec5 to 0x28898bc, (0x99f7 bytes) 2024-09-11T05:23:20.651 INFO:teuthology.orchestra.run.smithi012.stdout:5999 writesame 0x56c951c thru 0x56cee15 data_size 0x7(0x58fa bytes) 2024-09-11T05:23:20.670 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:20.670 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:20.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:20.692 INFO:teuthology.orchestra.run.smithi012.stdout:checking clone #47, image image_client.0-clone47 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent48 2024-09-11T05:23:20.747 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:20.747+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:20.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:20.809 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:20.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:20.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:20.848+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:20.924 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:20.924 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:20.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:20.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:20.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:20.977+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:21.036 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:21.036 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:21.044 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:21.050 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:21.049+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:21.056 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:21.073 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:21.089 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:21.105 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:21.106 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:21.122 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:21.139 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:21.151 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.151 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.516727724000006, 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:23:21.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.514586202999993, 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.156 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:23:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.514564639, 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.162 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:23:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:23:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:23:21.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:23:21.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.168 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.514550627999995, 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:23:21.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:23:21.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512725326999998, 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.174 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:23:21.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:23:21.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512710724000002, 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:23:21.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:23:21.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512693419000001, 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:23:21.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:23:21.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512669310000007, 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.194 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512641234, 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:23:21.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:23:21.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512614241999998, 2024-09-11T05:23:21.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512573682999999, 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:23:21.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:23:21.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.512550296000001, 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:23:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.416565188999996, 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:23:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:21.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.416545628999998, 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:23:21.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.416526414000003, 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:21.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:23:21.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.416505614000002, 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.228 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:23:21.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 55.532405099000002, 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.232 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:23:21.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:23:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 55.529415290999999, 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:23:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:23:21.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:23:21.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:23:21.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 55.064818399000004, 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.247 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:23:21.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:23:21.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.530234511000003, 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:23:21.254 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:23:21.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.261 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.261 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.261 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.261 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.261 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:21.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:21.149+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:21.262 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:21.263 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:21.263 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:21.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:21.264 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:21.262+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:21.363 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:21.363+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:21.407 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:21.407 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:21.415 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:21.464 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:21.463+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:21.519 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:21.519 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:21.519 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:21.519 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:21.519 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:21.527 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:21.565 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:21.564+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:21.666 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:21.665+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:21.683 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:21.683 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:21.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.085705489999995, 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.684 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:23:21.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.085477994000001, 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:23:21.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:23:21.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:23:21.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:23:21.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.08522318, 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.084854285000006, 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.700 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.704 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.084692739000005, 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.705 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:23:21.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.084250003999998, 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.710 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:23:21.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.714 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.082103110999995, 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.715 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:21.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:21.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:23:21.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.080072559000001, 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.722 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:23:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:21.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:21.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:21.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:23:21.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:23:21.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:23:21.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:23:21.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:23:21.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:23:21.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:23:21.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.729 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 83.080052174000002, 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:21.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:23:21.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:23:21.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:23:21.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:23:21.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.862868368999997, 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.737 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:21.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:23:21.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.862847345000006, 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.742 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:21.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:23:21.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.862823090000006, 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:23:21.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:23:21.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:23:21.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:23:21.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:23:21.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.751 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.861144006000004, 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:23:21.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:23:21.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.861124660000002, 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.757 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:23:21.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.861103888000002, 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.762 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:23:21.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:23:21.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:23:21.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:21.767 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.861084477999995, 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:23:21.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.861064009000003, 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:21.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:23:21.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.861045118999996, 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:23:21.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:23:21.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.851707325999996, 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:21.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:23:21.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 82.851696500000003, 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:23:21.787 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:21.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.791 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.792 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:21.792 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:21.792 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:21.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:21.794 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:21.793+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:21.894 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:21.894+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:21.938 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:21.939 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:21.939 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:21.939 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:21.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:21.995 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:21.995+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:22.090 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:22.091 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:22.091 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:22.091 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:22.091 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:22.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:22.095+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:22.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:22.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:22.196+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:22.205 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:22.205 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:22.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572475885999999, 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:23:22.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.57246602, 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.211 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:23:22.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:23:22.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:23:22.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572441603999998, 2024-09-11T05:23:22.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:22.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:23:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572430316000002, 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.222 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:22.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:23:22.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:23:22.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572420796999999, 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.228 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:23:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572411439, 2024-09-11T05:23:22.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:22.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572397557000002, 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.237 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:23:22.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:23:22.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572387990000003, 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:23:22.241 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:23:22.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:23:22.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.57237216, 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.246 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:22.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572346402000001, 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.250 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:22.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:22.254 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572317744999999, 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:22.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:23:22.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572292912000002, 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.263 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572275359999999, 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:23:22.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:23:22.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572265389999998, 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.268 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:23:22.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:23:22.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572255202000001, 2024-09-11T05:23:22.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:22.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:23:22.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572245862999999, 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.277 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:23:22.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572236703000002, 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:23:22.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:22.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:23:22.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.286 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572225508999999, 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:23:22.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:23:22.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572201567999997, 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:23:22.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:23:22.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.572189952000002, 2024-09-11T05:23:22.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:22.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:22.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:22.302 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:22.301+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:22.402 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:22.402+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:22.406 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:22.406 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:22.406 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:22.414 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:22.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:22.503+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:22.559 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:22.560 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:22.560 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:22.560 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:22.560 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:22.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:22.604 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:22.604+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:22.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:23:22.677 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 6.0300625080000003, 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.678 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:23:22.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:23:22.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1154038970000002, 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:22.684 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:22.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.688 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0190205240000001, 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:23:22.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0188650279999996, 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:23:22.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:23:22.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0160585480000002, 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.698 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:22.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0160331840000003, 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.703 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0160111570000003, 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:23:22.708 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:22.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.713 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0135298080000004, 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:22.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.718 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0135034090000001, 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:22.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:22.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:23:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.01346822, 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.724 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:23:22.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0134464210000003, 2024-09-11T05:23:22.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:22.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0134250920000003, 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:22.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:23:22.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0134043730000002, 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.744 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0091405289999997, 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.745 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:22.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:23:22.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0090948380000002, 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.750 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:22.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0090548999999998, 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0088524950000002, 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:23:22.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0088296249999997, 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:22.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.770 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0088099899999996, 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:22.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:23:22.775 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.0019175440000003, 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:22.776 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:22.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:22.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:22.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:23:22.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:23:22.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:22.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:22.781 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:22.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:22.783+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:22.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:22.885 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:22.884+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:22.893 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:22.893 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:22.902 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:22.986 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:22.986+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:22.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T05:23:22.989+0000 7f110effd640 0 --2- 172.21.15.12:0/2665692887 >> [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] conn(0x7f11101427d0 0x7f11101daf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-11T05:23:23.052 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:23.052 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:23.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:23.102 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:23.101+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:23.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:23.187+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.669955076000001, 2024-09-11T05:23:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 19.019125706000001, 2024-09-11T05:23:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.361499819999999, 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.361474749999999, 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.361446638, 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.361420371000001, 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.361388739999999, 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.361364282, 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.361337808999998, 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176979176, 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:23:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176959026, 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:23:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176939007, 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:23:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:23:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176919256, 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:23:23.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176899876, 2024-09-11T05:23:23.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:23:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176881828999999, 2024-09-11T05:23:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176863641000001, 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:23:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176844677, 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176824398000001, 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:23:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176787611, 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 14.176752438999999, 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:23:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:23.308 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:23.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:23.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:23.311 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:23.310+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:23.411 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:23.411+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:23.460 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:23.460 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:23.460 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:23.460 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:23.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:23.476 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:23.489 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:23.490 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:23.490 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:23:23.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-11T05:23:23.494 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:23.512 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:23.510+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:23.513 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:23.531 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:23.549 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:23.549 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:23.567 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:23.581 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:23.581 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:23.584 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:23.584 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:23.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:23.602 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:23.614 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:23.613+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:23.670 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:23:23.713 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:23.712+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:23.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:23.814 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:23.814+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:23.825 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:23:23.824+0000 7f4182606640 -1 mon.a@0(leader).osd e114 definitely_dead 0 2024-09-11T05:23:23.881 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:23.881 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:23.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:23.914 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:23.914+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:23.999 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:23.999 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:24.015 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:24.015+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:24.116 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:24.116 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:24.115+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:24.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:24.217 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:24.217+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:24.272 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:24.273 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:24.318 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:24.318+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:24.419 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:24.419+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:24.429 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:24.429 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:24.520 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:24.519+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:24.545 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:24.545 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:24.621 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:24.621+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:marked out osd.4. 2024-09-11T05:23:24.675 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:24.675 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:24.728 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:24.728+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:24.789 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:24.789 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:24.840 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:24.839+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:24.923 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:24.923+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:24.943 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:24.944 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:24.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:25.024 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:25.024+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:25.056 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:25.056 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:25.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:25.125 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:25.125+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:25.209 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:25.209 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:25.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:25.261 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:25.261+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:25.321 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:25.321 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:25.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:25.326+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:25.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:25.427 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:25.427+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:25.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:25.529 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:25.528+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:25.587 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:25.587 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:25.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:25.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:25.660 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:25.660+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:25.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:23:25.734 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:25.734+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:25.743 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:25.743 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:25.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:25.758 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:25.758 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:25.776 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:25.793 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:25.793 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:25.811 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:25.811 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:25.828 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:25.828 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:25.834 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:25.834+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:25.846 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:25.847 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:25.858 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:25.858 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:25.863 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:25.863 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:25.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:25.879 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:25.880 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:25.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:25.937+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:25.971 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:25.971 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:25.971 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:25.971 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:25.971 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:25.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:26.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:26.038+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.4381377329999996, 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.086 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.5234791219999995, 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4270957489999994, 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4269402529999997, 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:23:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4241337729999994, 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4241084090000005, 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:23:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4240863820000005, 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4216050330000005, 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:23:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4215786339999994, 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4215434449999993, 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:26.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:26.139 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4215216460000004, 2024-09-11T05:23:26.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:23:26.140 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.140 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.140 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.141 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.141 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.141 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.141 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:26.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:26.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:26.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.148 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4215003169999996, 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:26.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:26.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.153 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4214795979999995, 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:26.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:26.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.158 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4172157540000008, 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:26.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:23:26.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4171700630000004, 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:26.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4171301249999999, 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.169 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:23:26.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4169277200000003, 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:23:26.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:26.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:26.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:26.179 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4169048499999999, 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:26.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.184 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4168852150000006, 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:23:26.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.4099927690000005, 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:26.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:26.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:26.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:26.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.194 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:26.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:26.195 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:26.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:26.197 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:26.196+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:26.297 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:26.297+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:26.304 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:26.304 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:26.304 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:26.304 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:26.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:26.398 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:26.398+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:26.420 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:26.421 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:26.421 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:26.421 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:26.421 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:26.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:26.498 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:26.498+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:26.580 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:26.580 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:26.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:26.580 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 30.039889056, 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.581 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:26.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:26.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.586 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.389059686, 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:26.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:26.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:26.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:26.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:26.594 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.731433800000001, 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.595 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:26.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:26.599 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.731408729999998, 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.731380617999999, 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.608 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:26.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.610 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.731354351, 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.611 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:26.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.731322720000001, 2024-09-11T05:23:26.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:26.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:26.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.731298261999999, 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.622 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:26.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:26.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.731271789000001, 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:26.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.631 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546913155999999, 2024-09-11T05:23:26.632 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.633 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:23:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.636 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546893006000001, 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:26.639 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.640 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.641 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:23:26.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:23:26.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.642 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.642 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:23:26.642 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:23:26.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546872987, 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.644 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.645 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:23:26.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546853236, 2024-09-11T05:23:26.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:26.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:23:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.654 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546833855999999, 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:23:26.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:23:26.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.659 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546815809000002, 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.660 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:23:26.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546797621, 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:23:26.665 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:26.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:23:26.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.670 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546778657000001, 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:23:26.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546758378, 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:23:26.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.681 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546721591000001, 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:23:26.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.686 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 17.546686419, 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:26.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:23:26.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:23:26.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:26.692 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:26.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:26.695 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:23:26.696 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:26.693+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:26.794 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:26.794+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:26.895 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:26.895+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:26.901 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:26.902 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:26.902 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:26.902 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:26.913 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:26.996 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:26.996+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:27.070 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:27.071 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:27.071 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:27.071 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:27.071 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:27.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:27.098 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:27.097+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:27.198 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:27.198+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.358227525, 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:23:27.211 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.213 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:23:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:23:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:27.217 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.35487784, 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:27.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:23:27.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:27.222 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:27.223 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.35318088, 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.352605400000002, 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:23:27.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 22.350150948, 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:27.232 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:23:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:23:27.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.238 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130262 3.1f 3.a5f18dbf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.108757413999999, 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061307469000000003, 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130262 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.32e-07 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100844+0000", 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100850+0000", 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6380000000000001e-06 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100854+0000", 2024-09-11T05:23:27.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162141+0000", 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061286555999999999 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162150+0000", 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5029999999999997e-06 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130325 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.107042994, 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060079722000000002, 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130325 2024-09-11T05:23:27.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102557+0000", 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102559+0000", 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102566+0000", 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102570+0000", 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162174+0000", 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.059604048999999999 2024-09-11T05:23:27.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162636+0000", 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00046200400000000002 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130326 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.107023604999998, 2024-09-11T05:23:27.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060097697999999998, 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130326 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102578+0000", 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9659999999999999e-06 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102584+0000", 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.772e-06 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102589+0000", 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162665+0000", 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060076606999999997 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162674+0000", 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4319999999999999e-06 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130327 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.251 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.107004238999998, 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060123397000000002, 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130327 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102596+0000", 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:23:27.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102597+0000", 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.827e-06 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102603+0000", 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102607+0000", 2024-09-11T05:23:27.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2679999999999996e-06 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162696+0000", 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060088849999999999 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162719+0000", 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2285000000000001e-05 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130328 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106985576, 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060139489999999997, 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130328 2024-09-11T05:23:27.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102617+0000", 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102624+0000", 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102629+0000", 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162745+0000", 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060116145000000003 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162753+0000", 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:23:27.259 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130329 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.10696415, 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060160739999999997, 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.260 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130329 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102636+0000", 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102642+0000", 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6989999999999997e-06 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102650+0000", 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3490000000000003e-06 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102655+0000", 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162787+0000", 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060131974999999997 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162796+0000", 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6729999999999998e-06 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130330 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106937291000001, 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060169009000000002, 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130330 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102663+0000", 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102665+0000", 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.125e-06 2024-09-11T05:23:27.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102671+0000", 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102675+0000", 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162823+0000", 2024-09-11T05:23:27.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060147618 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162831+0000", 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130331 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:27.268 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106906871, 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060170659000000001, 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130331 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:27.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102695+0000", 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102702+0000", 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102706+0000", 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7979999999999996e-06 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162855+0000", 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060148733000000003 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162863+0000", 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.272 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130332 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106887216000001, 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060183778, 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130332 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102713+0000", 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102715+0000", 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9530000000000002e-06 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102720+0000", 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102726+0000", 2024-09-11T05:23:27.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162887+0000", 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060161144999999999 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162896+0000", 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0750000000000004e-06 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.276 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130333 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106867589, 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060197321999999998, 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130333 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102734+0000", 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9309999999999998e-06 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102740+0000", 2024-09-11T05:23:27.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102744+0000", 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5079999999999999e-06 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162921+0000", 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060176306999999998 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162929+0000", 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6270000000000006e-06 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130334 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106849758999999, 2024-09-11T05:23:27.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060210554999999999, 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130334 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:27.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102752+0000", 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102758+0000", 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102762+0000", 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162952+0000", 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060190180000000003 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162960+0000", 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1159999999999999e-06 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130335 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106832381, 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224879000000002, 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130335 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.286 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:27.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102769+0000", 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0549999999999998e-06 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102775+0000", 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102779+0000", 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162984+0000", 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060204437999999999 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162992+0000", 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1669999999999999e-06 2024-09-11T05:23:27.289 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130336 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106814906, 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060247271999999998, 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.290 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130336 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:27.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.84e-07 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102787+0000", 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9120000000000001e-06 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102792+0000", 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102797+0000", 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5000000000000001e-06 2024-09-11T05:23:27.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163022+0000", 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224969000000003 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163032+0000", 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8649999999999996e-06 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130337 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106797252, 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060276431999999998, 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130337 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102803+0000", 2024-09-11T05:23:27.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102804+0000", 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102810+0000", 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102815+0000", 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4299999999999999e-06 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163067+0000", 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060252732000000003 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163079+0000", 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1321000000000001e-05 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.298 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130338 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 18.106779806999999, 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060299902000000002, 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130338 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104763+0000", 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001943005 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104768+0000", 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104808+0000", 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9691000000000003e-05 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104815+0000", 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4549999999999998e-06 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163110+0000", 2024-09-11T05:23:27.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.058294374000000003 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163120+0000", 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9359999999999994e-06 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.303 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:27.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:27.305 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:27.304+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:27.406 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:27.405+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:27.471 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:27.471 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:27.471 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:27.472 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:27.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:27.524 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:27.524+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:27.594 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:27.594 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:27.595 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:27.595 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:27.595 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:27.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:27.606 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:27.606+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:27.707 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:27.708+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:27.753 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.864320405999997, 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.754 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:27.758 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.864299907000003, 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:27.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.761 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:23:27.762 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.763 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.864276965000002, 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.766 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:23:27.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.864068805999999, 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:23:27.769 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:23:27.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863926272, 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:23:27.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:23:27.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:23:27.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:27.781 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863859370999997, 2024-09-11T05:23:27.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:23:27.781 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:23:27.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:23:27.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863523035999997, 2024-09-11T05:23:27.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:27.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:23:27.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863388043, 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.793 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:27.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:23:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:23:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863353101999998, 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:27.804 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863331432000003, 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:23:27.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863233377999997, 2024-09-11T05:23:27.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:23:27.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.863112383000001, 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.814 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:23:27.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:23:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.819 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.862976817000003, 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:23:27.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.821 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:27.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:23:27.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:23:27.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:23:27.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.862768312, 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:23:27.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.862581917, 2024-09-11T05:23:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.834 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.862481072000001, 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:27.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:27.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:27.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:23:27.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:23:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:23:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:23:27.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:23:27.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:23:27.841 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.841 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.841 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.842 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.842 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:27.842 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.862301875, 2024-09-11T05:23:27.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:23:27.842 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.843 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:23:27.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.844 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:27.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.862030842000003, 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:23:27.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.861980983000002, 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.852 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:23:27.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:27.856 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.861827609000002, 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:27.860 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:27.861 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:27.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:27.862 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:27.862+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:27.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:27.962 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:27.962+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:28.013 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:28.013 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:28.014 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:28.014 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:28.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:28.029 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:28.046 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:28.047 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:28.063 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:28.063+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:28.064 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:28.064 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:28.081 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:28.081 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:28.098 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:28.098 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:28.115 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:28.131 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:28.132 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:28.137 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:28.137 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:28.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:28.149 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:28.149 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:28.163 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:28.163+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:28.263 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:28.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:28.265+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:28.366 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:28.366+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:28.368 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:28.369 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:28.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:28.466 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:28.466+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:28.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:28.568 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:28.568+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:28.650 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:28.650 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:28.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:28.668 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:28.669+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:28.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:23:28.763 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:28.763 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:28.769 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:28.769+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:28.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:28.870 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:28.870+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:28.914 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:28.914 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:28.923 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:28.970 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:28.970+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:29.027 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:29.027 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:29.035 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:29.076 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:29.076+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:29.173 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:29.173+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:29.180 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:29.180 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:29.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:29.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:29.274+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:29.332 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:29.332 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:29.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:29.384 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:29.384+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:23:29.457 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:29.457 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:29.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:29.508 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:29.508+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:29.578 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:29.577+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:29.613 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:29.613 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:29.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:29.678 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:29.678+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:29.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:29.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:29.680 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T05:23:29.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:23:29.770 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:29.770 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:29.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:29.779 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:29.778+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:29.879 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:29.879+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:29.922 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:29.922 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:29.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:29.980 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:29.980+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 120, 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "5fd14db5-8ee9-4e34-bd57-a8040293ab17", 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2024-09-11T05:21:12.602514+0000", 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2024-09-11T05:23:29.415339+0000", 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2024-09-11T05:22:56.527907+0000", 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2024-09-11T05:23:24.657382+0000", 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5801984, 2024-09-11T05:23:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "noscrub", 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 3, 2024-09-11T05:23:29.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "luminous", 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "squid", 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_crimson": false, 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": ".mgr", 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:27.582783+0000", 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2024-09-11T05:23:29.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2024-09-11T05:23:29.985 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "17", 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:23:29.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:23:29.987 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.988 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:23:29.989 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_max": 32, 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": {} 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 8, 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 8, 2024-09-11T05:23:29.990 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.25, 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 2, 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 2, 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:31.353652+0000", 2024-09-11T05:23:29.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:23:29.992 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:23:29.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "21", 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 2, 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 21, 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:23:29.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:23:29.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:23:29.996 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 1.9900000095367432, 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 1.9900000095367432, 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 1.75, 2024-09-11T05:23:29.997 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 1.75, 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "pool_client.0", 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:41.109530+0000", 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:23:29.998 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 32, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 32, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 32, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 32, 2024-09-11T05:23:29.999 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 32, 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "118", 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:23:30.000 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 50, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 118, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:23:30.001 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:23:30.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:23:30.003 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 1.9900000095367432, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 1.9900000095367432, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 1.75, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 1.75, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:23:30.004 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e628e137-3e68-4084-a084-200022b8da35", 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 0.59844970703125, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 119, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.005 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.006 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2024-09-11T05:23:30.007 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/2997410357", 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/2997410357", 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/2997410357", 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/2997410357", 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.009 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "26db6fe3-81d0-40ae-a4e1-9a7460fabc2c", 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:30.010 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 118, 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.013 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/852655937", 2024-09-11T05:23:30.015 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/852655937", 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/852655937", 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/852655937", 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "00ff2990-a7cb-48a2-ab03-6739942d65d7", 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:30.016 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 13, 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 70, 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 87, 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 118, 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 71, 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T05:23:30.020 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/2878270387", 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/2878270387", 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/2878270387", 2024-09-11T05:23:30.021 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/2878270387", 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "d1c858fd-7b66-4e1b-aa18-e3fd567e1417", 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:30.022 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 100, 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/2211289880", 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/2211289880", 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/2211289880", 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/2211289880", 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "586534a4-d5e3-4af4-a2e5-aa4ec052b582", 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 0, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 0, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 107, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:30.028 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6800", 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.033 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6801", 2024-09-11T05:23:30.033 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.033 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.033 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6802", 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6803", 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6806", 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6807", 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6804", 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6805", 2024-09-11T05:23:30.036 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6801/1639325236", 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6803/1639325236", 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6807/1639325236", 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6805/1639325236", 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.037 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "801041dc-7a4c-4776-bfbb-68be37655407", 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 119, 2024-09-11T05:23:30.038 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6816", 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6817", 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.039 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6818", 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6819", 2024-09-11T05:23:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6822", 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.041 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6823", 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6820", 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6821", 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6817/2370940838", 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6819/2370940838", 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6823/2370940838", 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6821/2370940838", 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.043 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e0820ac1-b43f-486f-9d7b-155b46b33950", 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 118, 2024-09-11T05:23:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6826", 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6827", 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6828", 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.046 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6829", 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6832", 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.047 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6833", 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6830", 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6831", 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6827/1798055911", 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6829/1798055911", 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6833/1798055911", 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6831/1798055911", 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e22fdfda-9a13-42f2-be4f-f7c6e0ffd324", 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:30.050 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 119, 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6808", 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6809", 2024-09-11T05:23:30.051 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6810", 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6811", 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6814", 2024-09-11T05:23:30.053 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6815", 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6812", 2024-09-11T05:23:30.054 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6813", 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6809/1122624549", 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6811/1122624549", 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6815/1122624549", 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6813/1122624549", 2024-09-11T05:23:30.055 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.056 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.912439+0000", 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.788769+0000", 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.857319+0000", 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 71 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.058 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.926699+0000", 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 65536, 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.752975+0000", 2024-09-11T05:23:30.059 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.222079+0000", 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.060 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.095040+0000", 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:30.061 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.860946+0000", 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [ 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: "pgid": "2.5", 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: 3, 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: 6 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_primaries": [], 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklist": {}, 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "range_blocklist": {}, 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2024-09-11T05:23:30.063 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [ 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: "snaps": [ 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: "begin": 46, 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: "length": 5 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.064 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [], 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {}, 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode": { 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_enabled": false, 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_bucket_count": 0, 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_bucket": 0 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.065 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:30.067 INFO:tasks.thrashosds.thrasher:j is {'epoch': 120, 'fsid': '5fd14db5-8ee9-4e34-bd57-a8040293ab17', 'created': '2024-09-11T05:21:12.602514+0000', 'modified': '2024-09-11T05:23:29.415339+0000', 'last_up_change': '2024-09-11T05:22:56.527907+0000', 'last_in_change': '2024-09-11T05:23:24.657382+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:21:27.582783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:21:31.353652+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:21:41.109530+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 50, 'snap_epoch': 118, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}], 'osds': [{'osd': 0, 'uuid': 'e628e137-3e68-4084-a084-200022b8da35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.59844970703125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6808', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6809', 'nonce': 2997410357}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6810', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6811', 'nonce': 2997410357}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6814', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6815', 'nonce': 2997410357}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6812', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6813', 'nonce': 2997410357}]}, 'public_addr': '172.21.15.12:6809/2997410357', 'cluster_addr': '172.21.15.12:6811/2997410357', 'heartbeat_back_addr': '172.21.15.12:6815/2997410357', 'heartbeat_front_addr': '172.21.15.12:6813/2997410357', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '26db6fe3-81d0-40ae-a4e1-9a7460fabc2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6816', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6817', 'nonce': 852655937}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6818', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6819', 'nonce': 852655937}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6822', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6823', 'nonce': 852655937}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6820', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6821', 'nonce': 852655937}]}, 'public_addr': '172.21.15.12:6817/852655937', 'cluster_addr': '172.21.15.12:6819/852655937', 'heartbeat_back_addr': '172.21.15.12:6823/852655937', 'heartbeat_front_addr': '172.21.15.12:6821/852655937', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '00ff2990-a7cb-48a2-ab03-6739942d65d7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 70, 'up_from': 87, 'up_thru': 118, 'down_at': 71, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6824', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6825', 'nonce': 2878270387}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6826', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6827', 'nonce': 2878270387}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6830', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6831', 'nonce': 2878270387}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6828', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 2878270387}]}, 'public_addr': '172.21.15.12:6825/2878270387', 'cluster_addr': '172.21.15.12:6827/2878270387', 'heartbeat_back_addr': '172.21.15.12:6831/2878270387', 'heartbeat_front_addr': '172.21.15.12:6829/2878270387', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'd1c858fd-7b66-4e1b-aa18-e3fd567e1417', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6800', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6801', 'nonce': 2211289880}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6802', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6803', 'nonce': 2211289880}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6806', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6807', 'nonce': 2211289880}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6804', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6805', 'nonce': 2211289880}]}, 'public_addr': '172.21.15.12:6801/2211289880', 'cluster_addr': '172.21.15.12:6803/2211289880', 'heartbeat_back_addr': '172.21.15.12:6807/2211289880', 'heartbeat_front_addr': '172.21.15.12:6805/2211289880', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '586534a4-d5e3-4af4-a2e5-aa4ec052b582', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 1639325236}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 1639325236}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 1639325236}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 1639325236}]}, 'public_addr': '172.21.15.153:6801/1639325236', 'cluster_addr': '172.21.15.153:6803/1639325236', 'heartbeat_back_addr': '172.21.15.153:6807/1639325236', 'heartbeat_front_addr': '172.21.15.153:6805/1639325236', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '801041dc-7a4c-4776-bfbb-68be37655407', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6816', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6817', 'nonce': 2370940838}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6818', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6819', 'nonce': 2370940838}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6822', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6823', 'nonce': 2370940838}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6820', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6821', 'nonce': 2370940838}]}, 'public_addr': '172.21.15.153:6817/2370940838', 'cluster_addr': '172.21.15.153:6819/2370940838', 'heartbeat_back_addr': '172.21.15.153:6823/2370940838', 'heartbeat_front_addr': '172.21.15.153:6821/2370940838', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e0820ac1-b43f-486f-9d7b-155b46b33950', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6826', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6827', 'nonce': 1798055911}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6828', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6829', 'nonce': 1798055911}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 1798055911}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6830', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6831', 'nonce': 1798055911}]}, 'public_addr': '172.21.15.153:6827/1798055911', 'cluster_addr': '172.21.15.153:6829/1798055911', 'heartbeat_back_addr': '172.21.15.153:6833/1798055911', 'heartbeat_front_addr': '172.21.15.153:6831/1798055911', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e22fdfda-9a13-42f2-be4f-f7c6e0ffd324', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6808', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6809', 'nonce': 1122624549}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6810', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6811', 'nonce': 1122624549}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6814', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6815', 'nonce': 1122624549}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6812', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6813', 'nonce': 1122624549}]}, 'public_addr': '172.21.15.153:6809/1122624549', 'cluster_addr': '172.21.15.153:6811/1122624549', 'heartbeat_back_addr': '172.21.15.153:6815/1122624549', 'heartbeat_front_addr': '172.21.15.153:6813/1122624549', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.912439+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.788769+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.857319+0000', 'dead_epoch': 71}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.926699+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.752975+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.222079+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.095040+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.860946+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.5', 'osds': [3, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 46, 'length': 5}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:23:30.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:23:30.069 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:30.069 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:30.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:30.108 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:30.108+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:30.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:30.204 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:30.204+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:30.231 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:30.231 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:30.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:30.283 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:30.283+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:30.303 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:30.322 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:30.322 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:30.340 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:30.376 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:30.377 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:30.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:30.384+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:30.396 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:30.396 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:30.397 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:30.397 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:30.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:30.397 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:30.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.397 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 33.857369734999999, 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.206540364999999, 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:30.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 25.548914479, 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:30.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 25.548889409000001, 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:30.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:30.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 25.548861296999998, 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 25.548835029999999, 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:30.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.426 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 25.548803399000001, 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:30.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:30.430 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 25.548778940999998, 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.435 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 25.548752468, 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:30.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364393835000001, 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:23:30.440 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:23:30.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:23:30.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:30.449 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364373685, 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:23:30.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364353666, 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.459 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364333915, 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.460 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:23:30.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:30.464 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364314534999998, 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:23:30.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364296488000001, 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.469 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:23:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364278299999999, 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:30.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364259336, 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:30.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.482 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364239056999999, 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:23:30.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:23:30.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.36420227, 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.489 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.364167097999999, 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:23:30.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:23:30.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.496 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:30.497 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:30.497+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:30.498 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:30.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:30.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:23:30.501 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:23:30.502 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:30.502 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-09-11T05:23:29.558068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1144209684,"num_objects":2624,"num_object_clones":375,"num_object_copies":5248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1599,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2624,"num_whiteouts":1449,"num_read":181107,"num_read_kb":668258,"num_write":19452,"num_write_kb":310580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5273,"num_bytes_recovered":161791700,"num_keys_recovered":776,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16860,"ondisk_log_size":16860,"up":82,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":532680,"kb_used_data":236652,"kb_used_omap":20,"kb_used_meta":295787,"kb_avail":660070200,"statfs":{"total":676457349120,"available":675911884800,"internally_reserved":0,"allocated":242331648,"data_stored":286798789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21025,"internal_metadata":302886367},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19201326,"num_objects":-93,"num_object_clones":-24,"num_object_copies":-186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1599,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-93,"num_whiteouts":-23,"num_read":722,"num_read_kb":615,"num_write":142,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.893730"},"pg_stats":[{"pgid":"3.1f","version":"114'613","reported_seq":3603,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.671324+0000","last_change":"2024-09-11T05:23:24.671404+0000","last_active":"2024-09-11T05:23:26.671324+0000","last_peered":"2024-09-11T05:23:26.671324+0000","last_clean":"2024-09-11T05:23:26.671324+0000","last_became_active":"2024-09-11T05:21:42.406554+0000","last_became_peered":"2024-09-11T05:21:42.406554+0000","last_unstale":"2024-09-11T05:23:26.671324+0000","last_undegraded":"2024-09-11T05:23:26.671324+0000","last_fullsized":"2024-09-11T05:23:26.671324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:56:35.191424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000688253,"stat_sum":{"num_bytes":56433310,"num_objects":89,"num_object_clones":20,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":45,"num_read":4860,"num_read_kb":21768,"num_write":659,"num_write_kb":10336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.1e","version":"114'492","reported_seq":6660,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.674143+0000","last_change":"2024-09-11T05:23:24.667380+0000","last_active":"2024-09-11T05:23:26.674143+0000","last_peered":"2024-09-11T05:23:26.674143+0000","last_clean":"2024-09-11T05:23:26.674143+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:23:26.674143+0000","last_undegraded":"2024-09-11T05:23:26.674143+0000","last_fullsized":"2024-09-11T05:23:26.674143+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:26.439144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069950399999999999,"stat_sum":{"num_bytes":25865846,"num_objects":80,"num_object_clones":10,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":35,"num_read":7781,"num_read_kb":24598,"num_write":577,"num_write_kb":13409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.1d","version":"114'543","reported_seq":3760,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.672790+0000","last_change":"2024-09-11T05:23:26.676231+0000","last_active":"2024-09-11T05:23:24.670276+0000","last_peered":"2024-09-11T05:23:23.751668+0000","last_clean":"2024-09-11T05:23:23.751668+0000","last_became_active":"2024-09-11T05:23:17.412967+0000","last_became_peered":"2024-09-11T05:23:17.412967+0000","last_unstale":"2024-09-11T05:23:26.672790+0000","last_undegraded":"2024-09-11T05:23:26.672790+0000","last_fullsized":"2024-09-11T05:23:26.672790+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0061132859999999999,"stat_sum":{"num_bytes":10326780,"num_objects":74,"num_object_clones":8,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":136,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":45,"num_read":4397,"num_read_kb":11122,"num_write":645,"num_write_kb":4805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":4952282,"num_keys_recovered":34,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"5","objects":74}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.1c","version":"114'594","reported_seq":4824,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.672378+0000","last_change":"2024-09-11T05:23:26.674329+0000","last_active":"2024-09-11T05:23:24.669686+0000","last_peered":"2024-09-11T05:23:23.751456+0000","last_clean":"2024-09-11T05:23:23.751456+0000","last_became_active":"2024-09-11T05:23:16.625153+0000","last_became_peered":"2024-09-11T05:23:16.625153+0000","last_unstale":"2024-09-11T05:23:26.672378+0000","last_undegraded":"2024-09-11T05:23:26.672378+0000","last_fullsized":"2024-09-11T05:23:26.672378+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004115194,"stat_sum":{"num_bytes":18184286,"num_objects":86,"num_object_clones":16,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":138,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":44,"num_read":5466,"num_read_kb":17337,"num_write":675,"num_write_kb":6634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":5468549,"num_keys_recovered":174,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5],"avail_no_missing":["5","4"],"object_location_counts":[{"shards":"5","objects":86}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.1b","version":"114'705","reported_seq":4322,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.673196+0000","last_change":"2024-09-11T05:23:26.675030+0000","last_active":"2024-09-11T05:23:24.671273+0000","last_peered":"2024-09-11T05:23:23.753257+0000","last_clean":"2024-09-11T05:23:23.753257+0000","last_became_active":"2024-09-11T05:23:17.414010+0000","last_became_peered":"2024-09-11T05:23:17.414010+0000","last_unstale":"2024-09-11T05:23:26.673196+0000","last_undegraded":"2024-09-11T05:23:26.673196+0000","last_fullsized":"2024-09-11T05:23:26.673196+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0091347870000000001,"stat_sum":{"num_bytes":20265160,"num_objects":84,"num_object_clones":14,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":142,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":49,"num_read":4510,"num_read_kb":11869,"num_write":874,"num_write_kb":11550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":353,"num_bytes_recovered":5606302,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0],"avail_no_missing":["0","4"],"object_location_counts":[{"shards":"0","objects":84}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.1a","version":"114'274","reported_seq":6070,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.670916+0000","last_change":"2024-09-11T05:23:26.671879+0000","last_active":"2024-09-11T05:23:24.664371+0000","last_peered":"2024-09-11T05:23:23.741652+0000","last_clean":"2024-09-11T05:23:23.741652+0000","last_became_active":"2024-09-11T05:23:16.626926+0000","last_became_peered":"2024-09-11T05:23:16.626926+0000","last_unstale":"2024-09-11T05:23:26.670916+0000","last_undegraded":"2024-09-11T05:23:26.670916+0000","last_fullsized":"2024-09-11T05:23:26.670916+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0065214690000000002,"stat_sum":{"num_bytes":39929897,"num_objects":65,"num_object_clones":5,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":5428,"num_read_kb":38718,"num_write":242,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":10404035,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","4"],"object_location_counts":[{"shards":"1","objects":65}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.19","version":"114'267","reported_seq":3482,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.670629+0000","last_change":"2024-09-11T05:23:24.664600+0000","last_active":"2024-09-11T05:23:26.670629+0000","last_peered":"2024-09-11T05:23:26.670629+0000","last_clean":"2024-09-11T05:23:26.670629+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:23:26.670629+0000","last_undegraded":"2024-09-11T05:23:26.670629+0000","last_fullsized":"2024-09-11T05:23:26.670629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:47.265176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000645829,"stat_sum":{"num_bytes":30605233,"num_objects":73,"num_object_clones":8,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":43,"num_read":3053,"num_read_kb":14643,"num_write":251,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.18","version":"111'734","reported_seq":11410,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.674193+0000","last_change":"2024-09-11T05:23:24.666506+0000","last_active":"2024-09-11T05:23:26.674193+0000","last_peered":"2024-09-11T05:23:26.674193+0000","last_clean":"2024-09-11T05:23:26.674193+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:23:26.674193+0000","last_undegraded":"2024-09-11T05:23:26.674193+0000","last_fullsized":"2024-09-11T05:23:26.674193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:06.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040919099999999999,"stat_sum":{"num_bytes":38092544,"num_objects":85,"num_object_clones":12,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":48,"num_read":13821,"num_read_kb":34442,"num_write":1106,"num_write_kb":15875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.17","version":"114'621","reported_seq":4674,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672424+0000","last_change":"2024-09-11T05:23:24.670142+0000","last_active":"2024-09-11T05:23:26.672424+0000","last_peered":"2024-09-11T05:23:26.672424+0000","last_clean":"2024-09-11T05:23:26.672424+0000","last_became_active":"2024-09-11T05:23:19.420246+0000","last_became_peered":"2024-09-11T05:23:19.420246+0000","last_unstale":"2024-09-11T05:23:26.672424+0000","last_undegraded":"2024-09-11T05:23:26.672424+0000","last_fullsized":"2024-09-11T05:23:26.672424+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:50.482531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042272799999999998,"stat_sum":{"num_bytes":30531904,"num_objects":83,"num_object_clones":13,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":48,"num_read":6170,"num_read_kb":19951,"num_write":638,"num_write_kb":7958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.16","version":"114'580","reported_seq":12761,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672195+0000","last_change":"2024-09-11T05:23:24.670190+0000","last_active":"2024-09-11T05:23:26.672195+0000","last_peered":"2024-09-11T05:23:26.672195+0000","last_clean":"2024-09-11T05:23:26.672195+0000","last_became_active":"2024-09-11T05:23:10.602439+0000","last_became_peered":"2024-09-11T05:23:10.602439+0000","last_unstale":"2024-09-11T05:23:26.672195+0000","last_undegraded":"2024-09-11T05:23:26.672195+0000","last_fullsized":"2024-09-11T05:23:26.672195+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:23:29.226036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053604599999999998,"stat_sum":{"num_bytes":33627283,"num_objects":85,"num_object_clones":11,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":44,"num_read":13310,"num_read_kb":32378,"num_write":759,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.15","version":"113'439","reported_seq":3573,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.669324+0000","last_change":"2024-09-11T05:23:24.673058+0000","last_active":"2024-09-11T05:23:26.669324+0000","last_peered":"2024-09-11T05:23:26.669324+0000","last_clean":"2024-09-11T05:23:26.669324+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:23:26.669324+0000","last_undegraded":"2024-09-11T05:23:26.669324+0000","last_fullsized":"2024-09-11T05:23:26.669324+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:55:33.960840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042465100000000001,"stat_sum":{"num_bytes":23911314,"num_objects":71,"num_object_clones":5,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":46,"num_read":4152,"num_read_kb":19835,"num_write":402,"num_write_kb":6815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.14","version":"111'477","reported_seq":5011,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.669305+0000","last_change":"2024-09-11T05:23:26.674548+0000","last_active":"2024-09-11T05:23:24.670623+0000","last_peered":"2024-09-11T05:23:20.644891+0000","last_clean":"2024-09-11T05:23:20.644891+0000","last_became_active":"2024-09-11T05:23:16.626719+0000","last_became_peered":"2024-09-11T05:23:16.626719+0000","last_unstale":"2024-09-11T05:23:26.669305+0000","last_undegraded":"2024-09-11T05:23:26.669305+0000","last_fullsized":"2024-09-11T05:23:26.669305+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038850000000000001,"stat_sum":{"num_bytes":39452468,"num_objects":80,"num_object_clones":11,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":134,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":46,"num_read":5058,"num_read_kb":23085,"num_write":565,"num_write_kb":15649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":325,"num_bytes_recovered":15015050,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7],"avail_no_missing":["7","4"],"object_location_counts":[{"shards":"7","objects":80}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"2.7","version":"0'0","reported_seq":175,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672192+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:23:26.672192+0000","last_peered":"2024-09-11T05:23:26.672192+0000","last_clean":"2024-09-11T05:23:26.672192+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:23:26.672192+0000","last_undegraded":"2024-09-11T05:23:26.672192+0000","last_fullsized":"2024-09-11T05:23:26.672192+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"114'559","reported_seq":7340,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.671266+0000","last_change":"2024-09-11T05:23:24.671450+0000","last_active":"2024-09-11T05:23:26.671266+0000","last_peered":"2024-09-11T05:23:26.671266+0000","last_clean":"2024-09-11T05:23:26.671266+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:23:26.671266+0000","last_undegraded":"2024-09-11T05:23:26.671266+0000","last_fullsized":"2024-09-11T05:23:26.671266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:06.607912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355700000000002,"stat_sum":{"num_bytes":63393048,"num_objects":85,"num_object_clones":10,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":50,"num_read":8631,"num_read_kb":23074,"num_write":580,"num_write_kb":13682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"2.6","version":"0'0","reported_seq":221,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.670852+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:23:26.670852+0000","last_peered":"2024-09-11T05:23:26.670852+0000","last_clean":"2024-09-11T05:23:26.670852+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:23:26.670852+0000","last_undegraded":"2024-09-11T05:23:26.670852+0000","last_fullsized":"2024-09-11T05:23:26.670852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"114'493","reported_seq":4050,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.674390+0000","last_change":"2024-09-11T05:23:24.667716+0000","last_active":"2024-09-11T05:23:26.674390+0000","last_peered":"2024-09-11T05:23:26.674390+0000","last_clean":"2024-09-11T05:23:26.674390+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:23:26.674390+0000","last_undegraded":"2024-09-11T05:23:26.674390+0000","last_fullsized":"2024-09-11T05:23:26.674390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:02.481097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065187199999999995,"stat_sum":{"num_bytes":66404642,"num_objects":90,"num_object_clones":17,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":48,"num_read":4995,"num_read_kb":21266,"num_write":432,"num_write_kb":11271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.673945+0000","last_change":"2024-09-11T05:22:20.600569+0000","last_active":"2024-09-11T05:23:26.673945+0000","last_peered":"2024-09-11T05:23:26.673945+0000","last_clean":"2024-09-11T05:23:26.673945+0000","last_became_active":"2024-09-11T05:22:20.600190+0000","last_became_peered":"2024-09-11T05:22:20.600190+0000","last_unstale":"2024-09-11T05:23:26.673945+0000","last_undegraded":"2024-09-11T05:23:26.673945+0000","last_fullsized":"2024-09-11T05:23:26.673945+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:24.527563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"114'427","reported_seq":1745,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.670685+0000","last_change":"2024-09-11T05:23:24.665096+0000","last_active":"2024-09-11T05:23:26.670685+0000","last_peered":"2024-09-11T05:23:26.670685+0000","last_clean":"2024-09-11T05:23:26.670685+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:23:26.670685+0000","last_undegraded":"2024-09-11T05:23:26.670685+0000","last_fullsized":"2024-09-11T05:23:26.670685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:59.771512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045154599999999999,"stat_sum":{"num_bytes":39938173,"num_objects":99,"num_object_clones":11,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":50,"num_read":1869,"num_read_kb":19586,"num_write":447,"num_write_kb":10413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.670754+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:23:26.670754+0000","last_peered":"2024-09-11T05:23:26.670754+0000","last_clean":"2024-09-11T05:23:26.670754+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:23:26.670754+0000","last_undegraded":"2024-09-11T05:23:26.670754+0000","last_fullsized":"2024-09-11T05:23:26.670754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"114'343","reported_seq":5325,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672870+0000","last_change":"2024-09-11T05:23:24.671291+0000","last_active":"2024-09-11T05:23:26.672870+0000","last_peered":"2024-09-11T05:23:26.672870+0000","last_clean":"2024-09-11T05:23:26.672870+0000","last_became_active":"2024-09-11T05:21:42.409551+0000","last_became_peered":"2024-09-11T05:21:42.409551+0000","last_unstale":"2024-09-11T05:23:26.672870+0000","last_undegraded":"2024-09-11T05:23:26.672870+0000","last_fullsized":"2024-09-11T05:23:26.672870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:07:06.447705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055562500000000002,"stat_sum":{"num_bytes":42188993,"num_objects":72,"num_object_clones":13,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":38,"num_read":5343,"num_read_kb":14813,"num_write":299,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.3","version":"114'414","reported_seq":13248,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.671071+0000","last_change":"2024-09-11T05:23:26.675167+0000","last_active":"2024-09-11T05:23:25.670437+0000","last_peered":"2024-09-11T05:23:23.752861+0000","last_clean":"2024-09-11T05:23:23.752861+0000","last_became_active":"2024-09-11T05:23:17.413234+0000","last_became_peered":"2024-09-11T05:23:17.413234+0000","last_unstale":"2024-09-11T05:23:26.671071+0000","last_undegraded":"2024-09-11T05:23:26.671071+0000","last_fullsized":"2024-09-11T05:23:26.671071+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006739727,"stat_sum":{"num_bytes":61684624,"num_objects":82,"num_object_clones":13,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":131,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":41,"num_read":13146,"num_read_kb":50369,"num_write":382,"num_write_kb":30341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":23309941,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[0],"avail_no_missing":["0","4"],"object_location_counts":[{"shards":"0","objects":82}],"blocked_by":[],"up_primary":6,"acting_primary":0,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"2.2","version":"21'2","reported_seq":213,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672649+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:23:26.672649+0000","last_peered":"2024-09-11T05:23:26.672649+0000","last_clean":"2024-09-11T05:23:26.672649+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:23:26.672649+0000","last_undegraded":"2024-09-11T05:23:26.672649+0000","last_fullsized":"2024-09-11T05:23:26.672649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"114'792","reported_seq":4445,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.670608+0000","last_change":"2024-09-11T05:23:24.664835+0000","last_active":"2024-09-11T05:23:26.670608+0000","last_peered":"2024-09-11T05:23:26.670608+0000","last_clean":"2024-09-11T05:23:26.670608+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:23:26.670608+0000","last_undegraded":"2024-09-11T05:23:26.670608+0000","last_fullsized":"2024-09-11T05:23:26.670608+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:50:13.027976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073167600000000001,"stat_sum":{"num_bytes":49908330,"num_objects":78,"num_object_clones":7,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":42,"num_read":6810,"num_read_kb":33777,"num_write":1073,"num_write_kb":6467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T05:23:24.666183+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:23:24.666183+0000","last_peered":"2024-09-11T05:23:24.666183+0000","last_clean":"2024-09-11T05:23:24.666183+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:23:24.666183+0000","last_undegraded":"2024-09-11T05:23:24.666183+0000","last_fullsized":"2024-09-11T05:23:24.666183+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"114'373","reported_seq":8348,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.670758+0000","last_change":"2024-09-11T05:23:26.672056+0000","last_active":"2024-09-11T05:23:24.670801+0000","last_peered":"2024-09-11T05:23:23.666428+0000","last_clean":"2024-09-11T05:23:23.666428+0000","last_became_active":"2024-09-11T05:23:17.414779+0000","last_became_peered":"2024-09-11T05:23:17.414779+0000","last_unstale":"2024-09-11T05:23:26.670758+0000","last_undegraded":"2024-09-11T05:23:26.670758+0000","last_fullsized":"2024-09-11T05:23:26.670758+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036413719999999999,"stat_sum":{"num_bytes":32416451,"num_objects":84,"num_object_clones":12,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":43,"num_read":8116,"num_read_kb":22492,"num_write":368,"num_write_kb":7369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":5211547,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0],"avail_no_missing":["0","4"],"object_location_counts":[{"shards":"0","objects":84}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.669109+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:23:26.669109+0000","last_peered":"2024-09-11T05:23:26.669109+0000","last_clean":"2024-09-11T05:23:26.669109+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:23:26.669109+0000","last_undegraded":"2024-09-11T05:23:26.669109+0000","last_fullsized":"2024-09-11T05:23:26.669109+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"114'678","reported_seq":2412,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.673618+0000","last_change":"2024-09-11T05:23:24.666988+0000","last_active":"2024-09-11T05:23:26.673618+0000","last_peered":"2024-09-11T05:23:26.673618+0000","last_clean":"2024-09-11T05:23:26.673618+0000","last_became_active":"2024-09-11T05:21:42.405781+0000","last_became_peered":"2024-09-11T05:21:42.405781+0000","last_unstale":"2024-09-11T05:23:26.673618+0000","last_undegraded":"2024-09-11T05:23:26.673618+0000","last_fullsized":"2024-09-11T05:23:26.673618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:12:32.410215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087269400000000003,"stat_sum":{"num_bytes":38783477,"num_objects":93,"num_object_clones":12,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":52,"num_read":3990,"num_read_kb":14229,"num_write":874,"num_write_kb":6731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"2.3","version":"19'1","reported_seq":218,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672215+0000","last_change":"2024-09-11T05:22:58.417441+0000","last_active":"2024-09-11T05:23:26.672215+0000","last_peered":"2024-09-11T05:23:26.672215+0000","last_clean":"2024-09-11T05:23:26.672215+0000","last_became_active":"2024-09-11T05:22:58.417171+0000","last_became_peered":"2024-09-11T05:22:58.417171+0000","last_unstale":"2024-09-11T05:23:26.672215+0000","last_undegraded":"2024-09-11T05:23:26.672215+0000","last_fullsized":"2024-09-11T05:23:26.672215+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:32:11.272751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":292,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.669101+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:23:26.669101+0000","last_peered":"2024-09-11T05:23:26.669101+0000","last_clean":"2024-09-11T05:23:26.669101+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:23:26.669101+0000","last_undegraded":"2024-09-11T05:23:26.669101+0000","last_fullsized":"2024-09-11T05:23:26.669101+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"112'350","reported_seq":5356,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.674317+0000","last_change":"2024-09-11T05:23:24.667007+0000","last_active":"2024-09-11T05:23:26.674317+0000","last_peered":"2024-09-11T05:23:26.674317+0000","last_clean":"2024-09-11T05:23:26.674317+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:23:26.674317+0000","last_undegraded":"2024-09-11T05:23:26.674317+0000","last_fullsized":"2024-09-11T05:23:26.674317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:00.877061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081222599999999999,"stat_sum":{"num_bytes":53001072,"num_objects":93,"num_object_clones":13,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":46,"num_read":4942,"num_read_kb":21739,"num_write":326,"num_write_kb":9557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.9","version":"112'603","reported_seq":1896,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T05:23:21.649451+0000","last_change":"2024-09-11T05:23:21.649786+0000","last_active":"2024-09-11T05:23:21.649451+0000","last_peered":"2024-09-11T05:23:21.649451+0000","last_clean":"2024-09-11T05:23:21.649451+0000","last_became_active":"2024-09-11T05:23:16.626510+0000","last_became_peered":"2024-09-11T05:23:16.626510+0000","last_unstale":"2024-09-11T05:23:21.649451+0000","last_undegraded":"2024-09-11T05:23:21.649451+0000","last_fullsized":"2024-09-11T05:23:21.649451+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:27.177586+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054813079999999998,"stat_sum":{"num_bytes":18322498,"num_objects":79,"num_object_clones":8,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":43,"num_read":2516,"num_read_kb":3712,"num_write":789,"num_write_kb":6828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":377,"num_bytes_recovered":3172057,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"}]},{"pgid":"3.a","version":"114'562","reported_seq":3398,"reported_epoch":117,"state":"active+undersized+degraded+remapped","last_fresh":"2024-09-11T05:23:26.695196+0000","last_change":"2024-09-11T05:23:26.695196+0000","last_active":"2024-09-11T05:23:26.695196+0000","last_peered":"2024-09-11T05:23:26.695196+0000","last_clean":"2024-09-11T05:23:23.756068+0000","last_became_active":"2024-09-11T05:23:26.695196+0000","last_became_peered":"2024-09-11T05:23:26.695196+0000","last_unstale":"2024-09-11T05:23:26.695196+0000","last_undegraded":"2024-09-11T05:23:26.675310+0000","last_fullsized":"2024-09-11T05:23:26.673445+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001692685,"stat_sum":{"num_bytes":19768399,"num_objects":73,"num_object_clones":6,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":121,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":44,"num_read":3834,"num_read_kb":17140,"num_write":652,"num_write_kb":3529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":4806292,"num_keys_recovered":91,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6],"avail_no_missing":["6","4"],"object_location_counts":[{"shards":"4,6","objects":73}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.b","version":"114'530","reported_seq":2888,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.674266+0000","last_change":"2024-09-11T05:23:24.667278+0000","last_active":"2024-09-11T05:23:26.674266+0000","last_peered":"2024-09-11T05:23:26.674266+0000","last_clean":"2024-09-11T05:23:26.674266+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:23:26.674266+0000","last_undegraded":"2024-09-11T05:23:26.674266+0000","last_fullsized":"2024-09-11T05:23:26.674266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:14.974155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092522999999999998,"stat_sum":{"num_bytes":25637720,"num_objects":103,"num_object_clones":18,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":60,"num_read":3954,"num_read_kb":10184,"num_write":585,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.c","version":"113'290","reported_seq":1120,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672742+0000","last_change":"2024-09-11T05:23:24.670564+0000","last_active":"2024-09-11T05:23:26.672742+0000","last_peered":"2024-09-11T05:23:26.672742+0000","last_clean":"2024-09-11T05:23:26.672742+0000","last_became_active":"2024-09-11T05:21:42.410098+0000","last_became_peered":"2024-09-11T05:21:42.410098+0000","last_unstale":"2024-09-11T05:23:26.672742+0000","last_undegraded":"2024-09-11T05:23:26.672742+0000","last_fullsized":"2024-09-11T05:23:26.672742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:26.449357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050785700000000001,"stat_sum":{"num_bytes":40189089,"num_objects":59,"num_object_clones":12,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":36,"num_read":752,"num_read_kb":10715,"num_write":302,"num_write_kb":8788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.d","version":"114'680","reported_seq":4384,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.669204+0000","last_change":"2024-09-11T05:23:24.672645+0000","last_active":"2024-09-11T05:23:26.669204+0000","last_peered":"2024-09-11T05:23:26.669204+0000","last_clean":"2024-09-11T05:23:26.669204+0000","last_became_active":"2024-09-11T05:23:11.600054+0000","last_became_peered":"2024-09-11T05:23:11.600054+0000","last_unstale":"2024-09-11T05:23:26.669204+0000","last_undegraded":"2024-09-11T05:23:26.669204+0000","last_fullsized":"2024-09-11T05:23:26.669204+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:30.507862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001936564,"stat_sum":{"num_bytes":47971034,"num_objects":96,"num_object_clones":15,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":48,"num_read":6431,"num_read_kb":38621,"num_write":822,"num_write_kb":8476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":223,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.e","version":"111'439","reported_seq":3774,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.669501+0000","last_change":"2024-09-11T05:23:26.671965+0000","last_active":"2024-09-11T05:23:24.672504+0000","last_peered":"2024-09-11T05:23:23.770520+0000","last_clean":"2024-09-11T05:23:23.770520+0000","last_became_active":"2024-09-11T05:23:16.625280+0000","last_became_peered":"2024-09-11T05:23:16.625280+0000","last_unstale":"2024-09-11T05:23:26.669501+0000","last_undegraded":"2024-09-11T05:23:26.669501+0000","last_fullsized":"2024-09-11T05:23:26.669501+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00116932,"stat_sum":{"num_bytes":21130017,"num_objects":70,"num_object_clones":11,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":130,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":38,"num_read":3489,"num_read_kb":10130,"num_write":479,"num_write_kb":7790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":392,"num_bytes_recovered":5044910,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7],"avail_no_missing":["7","4"],"object_location_counts":[{"shards":"7","objects":70}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.f","version":"114'720","reported_seq":3864,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.669407+0000","last_change":"2024-09-11T05:23:26.672785+0000","last_active":"2024-09-11T05:23:24.670694+0000","last_peered":"2024-09-11T05:23:23.751915+0000","last_clean":"2024-09-11T05:23:23.751915+0000","last_became_active":"2024-09-11T05:23:17.413309+0000","last_became_peered":"2024-09-11T05:23:17.413309+0000","last_unstale":"2024-09-11T05:23:26.669407+0000","last_undegraded":"2024-09-11T05:23:26.669407+0000","last_fullsized":"2024-09-11T05:23:26.669407+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0063303370000000001,"stat_sum":{"num_bytes":40441593,"num_objects":85,"num_object_clones":10,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":51,"num_read":5661,"num_read_kb":19723,"num_write":899,"num_write_kb":3564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":452,"num_bytes_recovered":5547280,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7],"avail_no_missing":["7","4"],"object_location_counts":[{"shards":"7","objects":85}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.10","version":"114'578","reported_seq":2038,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.672269+0000","last_change":"2024-09-11T05:23:24.664839+0000","last_active":"2024-09-11T05:23:26.672269+0000","last_peered":"2024-09-11T05:23:26.672269+0000","last_clean":"2024-09-11T05:23:26.672269+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:23:26.672269+0000","last_undegraded":"2024-09-11T05:23:26.672269+0000","last_fullsized":"2024-09-11T05:23:26.672269+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:22:40.093090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044818000000000001,"stat_sum":{"num_bytes":10655863,"num_objects":89,"num_object_clones":11,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":53,"num_read":3136,"num_read_kb":9779,"num_write":746,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.11","version":"114'379","reported_seq":3067,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.669174+0000","last_change":"2024-09-11T05:23:26.671040+0000","last_active":"2024-09-11T05:23:24.671249+0000","last_peered":"2024-09-11T05:23:23.753245+0000","last_clean":"2024-09-11T05:23:23.753245+0000","last_became_active":"2024-09-11T05:23:18.416241+0000","last_became_peered":"2024-09-11T05:23:18.416241+0000","last_unstale":"2024-09-11T05:23:26.669174+0000","last_undegraded":"2024-09-11T05:23:26.669174+0000","last_fullsized":"2024-09-11T05:23:26.669174+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.0056889899999999997,"stat_sum":{"num_bytes":35599048,"num_objects":65,"num_object_clones":10,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":122,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":38,"num_read":3101,"num_read_kb":8231,"num_write":339,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":5166632,"num_keys_recovered":88,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7],"avail_no_missing":["7","4"],"object_location_counts":[{"shards":"7","objects":65}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"3"}]},{"pgid":"3.12","version":"110'492","reported_seq":6960,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-11T05:23:26.669118+0000","last_change":"2024-09-11T05:23:24.671857+0000","last_active":"2024-09-11T05:23:26.669118+0000","last_peered":"2024-09-11T05:23:26.669118+0000","last_clean":"2024-09-11T05:23:26.669118+0000","last_became_active":"2024-09-11T05:23:19.419941+0000","last_became_peered":"2024-09-11T05:23:19.419941+0000","last_unstale":"2024-09-11T05:23:26.669118+0000","last_undegraded":"2024-09-11T05:23:26.669118+0000","last_fullsized":"2024-09-11T05:23:26.669118+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:36:26.981115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013980119999999999,"stat_sum":{"num_bytes":39809892,"num_objects":92,"num_object_clones":23,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":49,"num_read":7514,"num_read_kb":29120,"num_write":532,"num_write_kb":13715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2f","length":"4"}]},{"pgid":"3.13","version":"114'699","reported_seq":3136,"reported_epoch":117,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T05:23:26.669203+0000","last_change":"2024-09-11T05:23:26.673113+0000","last_active":"2024-09-11T05:23:24.672577+0000","last_peered":"2024-09-11T05:23:23.789131+0000","last_clean":"2024-09-11T05:23:23.789131+0000","last_became_active":"2024-09-11T05:23:17.412364+0000","last_became_peered":"2024-09-11T05:23:17.412364+0000","last_unstale":"2024-09-11T05:23:26.669203+0000","last_undegraded":"2024-09-11T05:23:26.669203+0000","last_fullsized":"2024-09-11T05:23:26.669203+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0089520789999999999,"stat_sum":{"num_bytes":29149309,"num_objects":78,"num_object_clones":10,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":144,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":50,"num_read":4755,"num_read_kb":19712,"num_write":972,"num_write_kb":7631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":386,"num_bytes_recovered":7145393,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7],"avail_no_missing":["7","4"],"object_location_counts":[{"shards":"7","objects":78}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"3"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1143619297,"num_objects":2620,"num_object_clones":375,"num_object_copies":5240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1599,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2620,"num_whiteouts":1449,"num_read":180991,"num_read_kb":668158,"num_write":19291,"num_write_kb":308162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5269,"num_bytes_recovered":160610964,"num_keys_recovered":776,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":277970944,"data_stored":333239972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},"log_size":16740,"ondisk_log_size":16740,"up":64,"acting":52,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94636,"kb_used_data":45396,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94277204,"statfs":{"total":96636764160,"available":96539856896,"internally_reserved":0,"allocated":46485504,"data_stored":49931168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":10044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":10285056,"data_stored":13039864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94260,"kb_used_data":45012,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94277580,"statfs":{"total":96636764160,"available":96540241920,"internally_reserved":0,"allocated":46092288,"data_stored":56275091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":55834574875,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75008,"kb_used_data":43816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94296832,"statfs":{"total":96636764160,"available":96559955968,"internally_reserved":0,"allocated":44867584,"data_stored":51770099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154759,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47832,"kb_used_data":15316,"kb_used_omap":11,"kb_used_meta":32436,"kb_avail":94324008,"statfs":{"total":96636764160,"available":96587784192,"internally_reserved":0,"allocated":15683584,"data_stored":20263478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":33215286},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76612,"kb_used_data":27372,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94295228,"statfs":{"total":96636764160,"available":96558313472,"internally_reserved":0,"allocated":28028928,"data_stored":35381176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107256,"kb_used_data":49696,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94264584,"statfs":{"total":96636764160,"available":96526934016,"internally_reserved":0,"allocated":50888704,"data_stored":60137913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48910336,"data_stored":58889426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26640384,"data_stored":34723038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14323712,"data_stored":19618506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43515904,"data_stored":51140022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46469120,"data_stored":52187601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":44703744,"data_stored":55616953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8900608,"data_stored":12381745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":44507136,"data_stored":48682681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:23:30.505 INFO:tasks.thrashosds.thrasher:Setting 3.9 to [6, 5, 1, 7] 2024-09-11T05:23:30.505 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.9', '6', '5', '1', '7'] 2024-09-11T05:23:30.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.9 6 5 1 7 2024-09-11T05:23:30.506 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:30.598 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:30.598+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:30.647 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:30.648 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:30.648 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:30.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:30.699 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:30.699+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:30.765 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:30.765 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:30.765 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:30.765 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:30.765 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:30.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:30.818 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:30.818+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:30.883 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:30.883 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:30.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:30.883 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:30.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.030577221000001, 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:23:30.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:30.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:23:30.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.027227536000002, 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:23:30.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.895 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.025530576000001, 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:23:30.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:23:30.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:23:30.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.024955095999999, 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 26.022500644000001, 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:23:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:23:30.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:23:30.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130262 3.1f 3.a5f18dbf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.781107110000001, 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061307469000000003, 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.910 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130262 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.32e-07 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100844+0000", 2024-09-11T05:23:30.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100850+0000", 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6380000000000001e-06 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100854+0000", 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162141+0000", 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061286555999999999 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162150+0000", 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5029999999999997e-06 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130325 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.914 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779392690000002, 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060079722000000002, 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130325 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102557+0000", 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102559+0000", 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102566+0000", 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102570+0000", 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162174+0000", 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.059604048999999999 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162636+0000", 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00046200400000000002 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130326 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779373301, 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060097697999999998, 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.919 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130326 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102578+0000", 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9659999999999999e-06 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102584+0000", 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.772e-06 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102589+0000", 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162665+0000", 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060076606999999997 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162674+0000", 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4319999999999999e-06 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130327 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779353935, 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060123397000000002, 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130327 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102596+0000", 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102597+0000", 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.827e-06 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102603+0000", 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102607+0000", 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2679999999999996e-06 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162696+0000", 2024-09-11T05:23:30.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060088849999999999 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162719+0000", 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2285000000000001e-05 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130328 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:30.927 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779335272000001, 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060139489999999997, 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130328 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:30.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102617+0000", 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102624+0000", 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102629+0000", 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162745+0000", 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060116145000000003 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162753+0000", 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.931 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130329 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779313846000001, 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060160739999999997, 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.932 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130329 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102636+0000", 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102642+0000", 2024-09-11T05:23:30.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6989999999999997e-06 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102650+0000", 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3490000000000003e-06 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102655+0000", 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162787+0000", 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060131974999999997 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162796+0000", 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6729999999999998e-06 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.936 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130330 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779286986999999, 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060169009000000002, 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130330 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102663+0000", 2024-09-11T05:23:30.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102665+0000", 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.125e-06 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102671+0000", 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102675+0000", 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162823+0000", 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060147618 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162831+0000", 2024-09-11T05:23:30.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130331 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779256567000001, 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060170659000000001, 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130331 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102695+0000", 2024-09-11T05:23:30.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102702+0000", 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102706+0000", 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7979999999999996e-06 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162855+0000", 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060148733000000003 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162863+0000", 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130332 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779236912000002, 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060183778, 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130332 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102713+0000", 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102715+0000", 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9530000000000002e-06 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102720+0000", 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102726+0000", 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162887+0000", 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060161144999999999 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162896+0000", 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0750000000000004e-06 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.949 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130333 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779217285000001, 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060197321999999998, 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130333 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102734+0000", 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9309999999999998e-06 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102740+0000", 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:23:30.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102744+0000", 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5079999999999999e-06 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162921+0000", 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060176306999999998 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162929+0000", 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6270000000000006e-06 2024-09-11T05:23:30.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130334 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779199455000001, 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060210554999999999, 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.954 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130334 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102752+0000", 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102758+0000", 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:23:30.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102762+0000", 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162952+0000", 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060190180000000003 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162960+0000", 2024-09-11T05:23:30.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1159999999999999e-06 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130335 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779182077000002, 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224879000000002, 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130335 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102769+0000", 2024-09-11T05:23:30.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0549999999999998e-06 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102775+0000", 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102779+0000", 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162984+0000", 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060204437999999999 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162992+0000", 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1669999999999999e-06 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130336 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779164602000002, 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060247271999999998, 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130336 2024-09-11T05:23:30.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.84e-07 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102787+0000", 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9120000000000001e-06 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102792+0000", 2024-09-11T05:23:30.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102797+0000", 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5000000000000001e-06 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163022+0000", 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224969000000003 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163032+0000", 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8649999999999996e-06 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130337 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779146948000001, 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060276431999999998, 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130337 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102803+0000", 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102804+0000", 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102810+0000", 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102815+0000", 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4299999999999999e-06 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163067+0000", 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060252732000000003 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163079+0000", 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1321000000000001e-05 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130338 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 21.779129503, 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060299902000000002, 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:30.972 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130338 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104763+0000", 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001943005 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104768+0000", 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104808+0000", 2024-09-11T05:23:30.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9691000000000003e-05 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104815+0000", 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4549999999999998e-06 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163110+0000", 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.058294374000000003 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:30.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163120+0000", 2024-09-11T05:23:30.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9359999999999994e-06 2024-09-11T05:23:30.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.976 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:30.976 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:30.976 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:30.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:30.978 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:30.977+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:31.078 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:31.078+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:31.126 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:31.126 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:31.126 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:31.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:31.179 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:31.179+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:31.279 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:31.279+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:31.283 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:31.283 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:31.283 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:31.283 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:31.283 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:31.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:31.380 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:31.380+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:31.435 INFO:teuthology.orchestra.run.smithi012.stderr:set 3.9 pg_upmap_items mapping to [6->5,1->7] 2024-09-11T05:23:31.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.559840454000003, 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:23:31.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.559819955000002, 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.454 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.458 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.559797013000001, 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:31.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:23:31.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:23:31.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.559588853999998, 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:23:31.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.467 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.559446319999999, 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:23:31.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.559379419000003, 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:31.476 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.559043084000002, 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:23:31.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558908090999999, 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.484 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558873149999997, 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:23:31.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:31.486 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:23:31.487 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:23:31.488 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558851480000001, 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.489 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.490 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558753426000003, 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:31.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:23:31.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:23:31.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558632430999999, 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:31.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:23:31.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:23:31.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558496865000002, 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:23:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:23:31.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558288359999999, 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.506 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.507 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.508 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.509 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.558101964999999, 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:31.513 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.55800112, 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:23:31.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.557821922999999, 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:23:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.557550890000002, 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.522 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:23:31.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:23:31.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.557501031000001, 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.557347657000001, 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:23:31.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:23:31.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:23:31.533 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.534 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.534 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.534 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:31.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:31.536 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:31.535+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:31.635 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:31.636+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:31.684 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:31.685 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:31.685 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:31.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:31.737 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:31.737+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:31.801 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:31.801 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:31.801 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:31.801 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:31.802 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:31.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:31.851 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:31.851+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:31.937 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:31.937+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.215295556000001, 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:23:31.960 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:23:31.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.215283667999998, 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.965 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:23:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.969 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.215246448000002, 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:23:31.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:23:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.215231666999998, 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.974 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:23:31.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.215220330999998, 2024-09-11T05:23:31.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:23:31.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:23:31.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.214069530000003, 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.983 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:31.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:23:31.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:31.987 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.214055075000005, 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:31.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:23:31.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.214044595000004, 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:23:31.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:31.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:31.996 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.214034127999994, 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:31.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:31.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.214015767999996, 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:23:32.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:23:32.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.211306695999994, 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.007 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:23:32.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:23:32.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.211283695999995, 2024-09-11T05:23:32.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:32.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.015 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.211262332999993, 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.016 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:23:32.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:23:32.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.211240814000007, 2024-09-11T05:23:32.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:23:32.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.024 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.211219886999999, 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.209376149999997, 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.029 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:32.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.209365777000002, 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.037 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.209350748000006, 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 93.209340740000002, 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:23:32.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 24.545072751999999, 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:32.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:23:32.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:23:32.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:32.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:32.051 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:32.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:32.053 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:32.052+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:32.153 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:32.153+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:32.157 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:32.157 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:32.157 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:32.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:32.254 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:32.254+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:32.310 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:32.310 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:32.310 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:32.319 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:32.360 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:32.360+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:32.418 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:23:32.456 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:32.456+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.840344533000007, 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.475 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:23:32.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:23:32.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.838203011999994, 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:23:32.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.838181448, 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:23:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.838167436999996, 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.489 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836342135999999, 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.494 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:23:32.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:23:32.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:32.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836327533000002, 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:23:32.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:23:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836310228000002, 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:32.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.507 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836286118999993, 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:23:32.511 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836258043000001, 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.512 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:32.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:23:32.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836231050999999, 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.517 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:32.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:23:32.521 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836190492, 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:23:32.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.836167105000001, 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:32.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.740181997999997, 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:32.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:23:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.740162437999999, 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:32.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.740143223000004, 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.541 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:23:32.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:23:32.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:32.546 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 93.740122423000003, 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.550 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.856021908000002, 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.551 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:23:32.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:32.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:23:32.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.853032099999993, 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:23:32.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:23:32.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:23:32.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.388435208000004, 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:23:32.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:23:32.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:23:32.573 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.853851320000004, 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:23:32.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:23:32.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:32.580 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:32.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:32.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:32.582+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:32.583 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:32.683 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:32.683+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:32.729 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:32.729 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:32.729 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:32.737 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:32.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:32.784+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:32.880 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:32.881 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:32.881 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:32.881 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:32.881 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:32.885 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:32.885+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:32.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:32.908 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:32.925 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:32.925 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:32.941 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:32.957 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:32.958 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:32.974 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:32.974 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:32.985 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:32.985+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:32.991 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:33.008 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:33.008 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:33.025 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:33.025 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:33.034 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:33.034 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:33.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:33.086 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:33.086+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:33.187 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:33.187 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:33.187 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:33.187+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:33.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:33.288 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:33.288+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:33.339 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:33.339 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:33.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:33.389 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:33.389+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:33.490 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:33.489+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:33.502 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:33.503 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:33.514 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:33.590 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:33.591+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:33.660 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:33.660 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:33.669 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:33.692 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:33.692+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:33.771 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:33.771 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:33.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:33.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:33.793+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:33.883 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:33.884 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:33.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:33.893 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:33.892+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:33.994 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:33.993+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:34.006 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:34.006 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:34.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:34.095 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:34.095+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:34.121 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:34.122 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:34.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:34.215 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:34.215+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:34.278 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:34.278 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:34.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:34.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:34.329+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:34.397 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:34.397+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:34.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:23:34.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:34.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:34.530+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:34.598 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:34.598+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:34.606 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:34.606 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:34.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:34.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:34.700+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:34.764 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:34.764 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:34.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:34.800 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:34.800+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:34.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:34.902+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:34.921 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:34.921 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:34.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:35.002 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:35.002+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:35.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:35.078 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:35.078 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:35.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:35.104 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:35.103+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:35.163 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:35.164 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:35.180 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:35.180 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:35.198 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:35.198 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:35.204 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:35.204+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:35.215 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:35.232 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:35.239 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:35.239 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:35.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:35.239 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:35.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.239 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.239 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349978544000003, 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:23:35.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:23:35.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349958045000001, 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.244 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.245 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:23:35.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.248 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349935103, 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.249 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.253 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349726943999997, 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:23:35.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349584409999999, 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.258 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:23:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349517509000002, 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:23:35.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:23:35.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349181174000002, 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:23:35.267 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:23:35.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:23:35.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349046180999999, 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.272 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:35.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:23:35.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:23:35.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.349011240000003, 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.276 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:35.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:23:35.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.348989570000001, 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:23:35.280 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:23:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.348891516000002, 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:23:35.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:23:35.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.348770520999999, 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.348634955000001, 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:35.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.348426449999998, 2024-09-11T05:23:35.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:23:35.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:35.302 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.348240054999998, 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:23:35.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.306 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.348139209999999, 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:23:35.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:23:35.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.310 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.347960012999998, 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:23:35.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:23:35.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.313 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.347688980000001, 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:23:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.347639121, 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:23:35.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:23:35.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.347485747, 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.323 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:35.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:23:35.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.327 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:35.329 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:35.329 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:35.330 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:35.330 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:35.330 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:35.331 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:35.331 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:35.328+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:35.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:35.429+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:35.463 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:23:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:35.485 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:35.485 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:35.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:35.530 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:35.528+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:35.631 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:35.629+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:35.648 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:35.648 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:35.648 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:35.648 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:35.648 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:35.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:35.731 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:35.730+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:35.767 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.022195886999995, 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:35.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:23:35.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:35.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.772 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.022183999000006, 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:23:35.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:23:35.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.775 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.775 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:23:35.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:23:35.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:23:35.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.022146778999996, 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:23:35.778 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:23:35.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:23:35.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:35.783 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.022131998000006, 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:23:35.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:23:35.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:23:35.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.789 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:35.790 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.022120662000006, 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:23:35.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:23:35.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:23:35.796 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.796 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.796 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.796 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.020969860999998, 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:23:35.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.020955405999999, 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.803 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.020944925999999, 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:23:35.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.808 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.020934459000003, 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:23:35.810 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:23:35.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.020916099000004, 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:23:35.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:23:35.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:23:35.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:23:35.820 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.018207027000003, 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.821 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:23:35.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:35.825 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.018184027000004, 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:35.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.829 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.018162664000002, 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.830 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:23:35.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.834 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.018141145000001, 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:35.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.018120218000007, 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.839 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.016276481000006, 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.844 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:23:35.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.016266107999996, 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.016251079, 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:23:35.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:23:35.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 97.016241070999996, 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:23:35.856 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:23:35.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:23:35.860 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 28.351973083000001, 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:35.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:23:35.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:35.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:35.866 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:35.868 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:35.868 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:35.867+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:35.968 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:35.967+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:35.976 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:35.976 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:35.976 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:35.976 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:35.985 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:36.070 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:36.068+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:36.129 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:36.129 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:36.130 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:36.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:36.179 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:36.179+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:36.271 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:36.270+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.650549663000007, 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.285 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:23:36.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:23:36.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.648408141999994, 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:36.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:23:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.648386578, 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:23:36.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.648372566999996, 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:23:36.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646547265999999, 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:23:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646532663000002, 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:23:36.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:23:36.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:23:36.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:36.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646515358000002, 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:23:36.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646491248999993, 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:23:36.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:36.322 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646463173000001, 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:36.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646436180999999, 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:23:36.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646395622, 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.335 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.646372235000001, 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.550387127999997, 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.340 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.550367567999999, 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:23:36.344 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:23:36.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.550348353000004, 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.349 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:23:36.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.550327553000002, 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.357 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.666227038000002, 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:23:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:23:36.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.663237229999993, 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:23:36.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:23:36.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:23:36.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:23:36.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:23:36.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.198640338000004, 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:23:36.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:36.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:23:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.664056450000004, 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:23:36.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:23:36.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.385 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:36.386 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:36.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:36.386+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:36.487 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:36.486+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:36.536 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:36.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T05:23:36.544 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:36.545 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:36.545 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:36.545 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:36.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:36.596 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:36.595+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:36.689 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:36.689+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:36.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:36.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:36.790+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:36.813 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.215867086000003, 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:23:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.215639589999995, 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:23:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.215384775999993, 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.215015880999999, 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:23:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:23:36.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.214854334999998, 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:23:36.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.214411600000005, 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:23:36.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:23:36.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:23:36.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.212264707000003, 2024-09-11T05:23:36.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:23:36.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.848 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.210234154999995, 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.849 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:36.853 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.210213769999996, 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.993029965000005, 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.858 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:23:36.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.993008940999999, 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:23:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:23:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:23:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:23:36.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:23:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:23:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:23:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:23:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:23:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.992984686, 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.870 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.991305601999997, 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:23:36.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.878 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.991286255999995, 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.879 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:23:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.880 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.991265483999996, 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.884 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:23:36.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.991246074000003, 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:23:36.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:23:36.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.893 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.991225604999997, 2024-09-11T05:23:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.991206715000004, 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:23:36.900 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.904 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.981868922000004, 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.905 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:36.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:23:36.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.981858095999996, 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:23:36.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:36.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:36.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:23:36.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:23:36.915 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.915 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.915 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.915 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:36.915 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:36.915 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:36.917 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:36.917 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:36.915+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:37.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:37.017+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:37.059 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:37.060 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:37.060 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:37.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:37.118 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:37.118+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:37.172 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:37.172 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:37.173 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:37.173 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:37.181 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:37.222 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:37.222+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:37.322 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:37.320+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:37.325 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.693009482999997, 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.330 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692999616999998, 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:23:37.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:23:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692975201000003, 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.335 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:23:37.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:37.339 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692963913, 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:23:37.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692954393999997, 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.348 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692945035999998, 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:23:37.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692931154, 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.353 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.357 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692921587000001, 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.361 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692905756999998, 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.362 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:23:37.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692879998999999, 2024-09-11T05:23:37.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:23:37.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:23:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:23:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692851341999997, 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:23:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692826509, 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:23:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.380 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692808956999997, 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.381 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:23:37.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:23:37.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692798987000003, 2024-09-11T05:23:37.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:23:37.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:23:37.389 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692788798999999, 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.390 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:23:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692779459999997, 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:23:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.399 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692770299999999, 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.400 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:23:37.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692759105999997, 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:23:37.404 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:23:37.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692735165000002, 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:23:37.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:23:37.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.692723549, 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:23:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:23:37.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.417 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:37.418 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:37.418 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:37.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T05:23:37.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:37.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T05:23:37.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:37.439+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:37.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:23:37.524 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:37.522+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:37.570 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:37.570 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:37.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:37.580 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:37.580 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:37.598 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:37.621 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:37.622 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:37.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:37.625+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:37.640 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:37.657 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:37.674 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:37.692 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:37.693 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:37.709 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:37.709 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:37.725 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:37.725 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:37.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:37.763 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:37.763+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:37.826 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:37.826+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:37.837 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:37.838 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:37.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:37.927 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:37.927+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:37.955 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:37.955 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:37.964 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:38.028 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:38.028+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:38.071 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:38.071 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:38.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:38.164 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:38.164+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:38.227 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:38.227 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:38.231 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:38.230+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:38.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:38.332 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:38.331+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:38.384 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:38.384 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:38.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:38.432 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:38.432+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:38.470 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T05:23:38.474 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:23:38.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T05:23:38.509 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:38.509 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:38.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:38.563 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:38.563+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:38.633 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:38.633+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:38.673 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:38.674 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:38.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:38.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:38.735+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:38.790 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:38.791 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:38.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:38.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:38.840+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:38.937 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:38.936+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:38.947 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:38.947 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:38.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:39.038 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:39.038+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:39.063 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:39.063 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:39.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:39.139 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:39.139+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:39.220 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:39.220 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:39.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:39.240 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:39.239+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:39.335 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:39.335 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:39.341 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:39.340+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:39.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:39.441 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:39.441+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:39.460 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T05:23:39.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T05:23:39.542 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:39.542+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:39.584 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:39.584 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:39.594 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:39.680 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:39.678+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:39.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:39.738 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:39.739 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:39.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:39.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:39.766+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:39.845 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:39.845+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:39.865 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:39.891 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:39.891 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:39.896 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:39.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:39.913 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:39.945 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:39.945+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:39.965 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:40.005 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:40.005 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:40.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:40.060 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:40.060+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:40.119 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:40.119 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:40.120 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:40.120 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:40.120 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:40.128 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:40.169 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:40.169+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:40.250 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:40.249+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:40.274 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:40.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.676719564, 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.275 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:23:40.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.676492068, 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:23:40.279 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:23:40.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.676237254, 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:23:40.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:23:40.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.67586835900001, 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.289 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:23:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:23:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.67570681300001, 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:23:40.294 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:23:40.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.675264078, 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:23:40.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:23:40.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.673117185, 2024-09-11T05:23:40.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:40.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.671086633, 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:40.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:23:40.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.671066248, 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:23:40.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:23:40.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.453882443, 2024-09-11T05:23:40.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:23:40.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.321 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.45386141900001, 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:23:40.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.45383716400001, 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:23:40.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:23:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.45215808, 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.331 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:23:40.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.452138734, 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:23:40.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.337 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.452117962, 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:23:40.340 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:23:40.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.344 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.452098552, 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:23:40.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:23:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.452078083, 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:23:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:23:40.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.452059193, 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:23:40.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:40.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.4427214, 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:40.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:23:40.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.442710574, 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:23:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:23:40.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.367 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.368 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.368 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:40.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:40.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:40.369+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:40.470 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:40.470+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:40.488 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T05:23:40.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:23:40.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T05:23:40.525 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:40.525 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:40.525 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:40.525 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:40.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:40.576 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:40.576+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:40.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:40.672+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:40.680 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:40.680 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:40.680 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:40.680 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:40.680 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:40.689 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:40.773 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:40.773+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:40.793 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160833869999998, 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:40.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:23:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160824003999998, 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:23:40.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:23:40.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160799588000003, 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:23:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:23:40.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.1607883, 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.808 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:23:40.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:23:40.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:40.812 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160778780999998, 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:40.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:23:40.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160769422999998, 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:23:40.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:23:40.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160755541, 2024-09-11T05:23:40.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:40.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:23:40.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160745974000001, 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:23:40.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160730143999999, 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:23:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:23:40.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160704385999999, 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:23:40.835 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:23:40.839 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160675728999998, 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.840 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.844 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160650896, 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:40.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:23:40.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160633343999997, 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.849 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:23:40.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160623373999996, 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:23:40.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160613185999999, 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.858 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:23:40.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.862 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160603846999997, 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.863 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:23:40.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160594687, 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:23:40.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:23:40.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160583492999997, 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:23:40.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.876 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160559552000002, 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.877 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:23:40.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.160547936, 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:23:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:23:40.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:40.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:40.886 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:40.886 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:40.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:40.888 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:40.887+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:40.988 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:40.988+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:40.992 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:40.993 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:40.993 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:40.993 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:41.001 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:41.089 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:41.089+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:41.146 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:41.146 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:41.146 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:41.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:41.190 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:41.190+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:41.291 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:41.291+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:41.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 24.651408467, 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:23:41.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:23:41.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.736749855999999, 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.305 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:41.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:23:41.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.640366483000001, 2024-09-11T05:23:41.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:23:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.640210987, 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:23:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:41.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.637404506999999, 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:41.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:41.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.325 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.637379143, 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.326 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:41.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:41.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.637357116, 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:23:41.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.634875767, 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:41.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:23:41.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.634849368000001, 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:23:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.634814178999999, 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.63479238, 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.353 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:41.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:41.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.634771051000001, 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:41.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:23:41.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.634750331999999, 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.364 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:41.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:23:41.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.630486487999999, 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:41.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:41.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.630440796999999, 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.374 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:41.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.379 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.630400859000002, 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:41.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:23:41.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.630198453999999, 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:41.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.630175584, 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.390 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:41.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:23:41.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.630155948999999, 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:23:41.395 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:41.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:41.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.400 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.623263503, 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:41.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:41.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:41.406 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:41.406 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:41.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:41.408 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:41.407+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:23:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T05:23:41.508 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:41.508+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:41.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T05:23:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:41.531 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:41.531 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:41.541 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:41.625 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:41.625+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:41.698 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:41.698 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:41.698 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:41.698 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:41.698 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:41.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:41.749 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:41.748+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:41.810 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:41.810+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:41.857 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 45.317583646999999, 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.858 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.860 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:41.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.860 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.860 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.860 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:41.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:41.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.864 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:41.864 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:41.864 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.666754277000003, 2024-09-11T05:23:41.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:41.864 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.864 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:41.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:41.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:41.870 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.009128390999997, 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:41.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:41.874 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.875 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.875 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:41.875 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:41.875 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.009103320999998, 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:41.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:41.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.009075209000002, 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.881 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:41.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.009048942, 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:41.885 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:41.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.009017311000001, 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:41.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:41.894 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.008992853000002, 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:41.898 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 37.008966379999997, 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.899 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:41.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:41.903 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824607747000002, 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824587596999997, 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:41.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:23:41.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824567578, 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.913 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:23:41.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:41.917 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824547827000004, 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:23:41.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824528446999999, 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.922 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:41.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.926 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824510400000001, 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:23:41.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824492212000003, 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:23:41.931 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:23:41.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.935 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824473247999997, 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.936 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824452968999999, 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:23:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:23:41.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:23:41.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824416182, 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.945 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:23:41.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:23:41.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 32.824381010000003, 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:41.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:41.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:23:41.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:41.953 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:41.954 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:41.955 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:41.955+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:41.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:41.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:42.056 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:42.055+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:42.107 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:42.107 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:42.107 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:42.107 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:42.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:42.140 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:42.141 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:42.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:42.157+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:42.157 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:42.173 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:42.174 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:42.190 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:42.191 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:42.207 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:42.223 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:42.224 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:42.225 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:42.225 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:42.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:42.242 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:42.242 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:42.258 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:42.258+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:42.349 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:42.349 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:42.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:42.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:42.359+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:42.416 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T05:23:42.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T05:23:42.460 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:42.459+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:42.480 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:42.480 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:42.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:42.561 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:42.561+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:42.615 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:42.615 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:42.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:42.662 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:42.661+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:42.732 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:42.732 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:42.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:42.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:42.785+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:42.848 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:42.848 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:42.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:42.898 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:42.898+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:42.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:42.964+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:43.004 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.005 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:43.065 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:43.065+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:43.161 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.161 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:43.165+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:43.169 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:43.266 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:43.266+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:43.286 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.286 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:43.367 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:43.366+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:43.400 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.400 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:43.467 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:43.468+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:43.506 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:23:43.515 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T05:23:43.535 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T05:23:43.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:23:43.558 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.558 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:43.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:43.577+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:43.669 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:43.668+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:43.677 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.677 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.686 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:43.770 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:43.770+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:43.830 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.830 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.839 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:43.871 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:43.871+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:43.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:23:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:23:43.898 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-11T05:23:43.560102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":753494913,"num_objects":2136,"num_object_clones":241,"num_object_copies":4272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2136,"num_whiteouts":1340,"num_read":184731,"num_read_kb":671358,"num_write":20184,"num_write_kb":310766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7005,"num_bytes_recovered":206067436,"num_keys_recovered":1059,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17913,"ondisk_log_size":17913,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":569672,"kb_used_data":222812,"kb_used_omap":20,"kb_used_meta":344363,"kb_avail":660033208,"statfs":{"total":676457349120,"available":675874004992,"internally_reserved":0,"allocated":228159488,"data_stored":275220314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21025,"internal_metadata":352628191},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-104282596,"num_objects":-191,"num_object_clones":-57,"num_object_copies":-382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-191,"num_whiteouts":-54,"num_read":1168,"num_read_kb":999,"num_write":257,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000553"},"pg_stats":[{"pgid":"3.1f","version":"132'654","reported_seq":3821,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.603642+0000","last_change":"2024-09-11T05:23:41.497008+0000","last_active":"2024-09-11T05:23:41.603642+0000","last_peered":"2024-09-11T05:23:41.603642+0000","last_clean":"2024-09-11T05:23:41.603642+0000","last_became_active":"2024-09-11T05:21:42.406554+0000","last_became_peered":"2024-09-11T05:21:42.406554+0000","last_unstale":"2024-09-11T05:23:41.603642+0000","last_undegraded":"2024-09-11T05:23:41.603642+0000","last_fullsized":"2024-09-11T05:23:41.603642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:04:11.029220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00187963,"stat_sum":{"num_bytes":35633912,"num_objects":72,"num_object_clones":13,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":39,"num_read":5074,"num_read_kb":21953,"num_write":681,"num_write_kb":10343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1e","version":"132'504","reported_seq":6767,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.491602+0000","last_change":"2024-09-11T05:23:41.491602+0000","last_active":"2024-09-11T05:23:41.491602+0000","last_peered":"2024-09-11T05:23:41.491602+0000","last_clean":"2024-09-11T05:23:41.491602+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:23:41.491602+0000","last_undegraded":"2024-09-11T05:23:41.491602+0000","last_fullsized":"2024-09-11T05:23:41.491602+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:00:14.831894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012822039999999999,"stat_sum":{"num_bytes":23972719,"num_objects":69,"num_object_clones":7,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":33,"num_read":7781,"num_read_kb":24598,"num_write":583,"num_write_kb":13409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1d","version":"132'587","reported_seq":4284,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.574605+0000","last_change":"2024-09-11T05:23:41.498207+0000","last_active":"2024-09-11T05:23:41.574605+0000","last_peered":"2024-09-11T05:23:41.574605+0000","last_clean":"2024-09-11T05:23:41.574605+0000","last_became_active":"2024-09-11T05:23:29.422589+0000","last_became_peered":"2024-09-11T05:23:29.422589+0000","last_unstale":"2024-09-11T05:23:41.574605+0000","last_undegraded":"2024-09-11T05:23:41.574605+0000","last_fullsized":"2024-09-11T05:23:41.574605+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:10:31.643821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069744200000000005,"stat_sum":{"num_bytes":8286931,"num_objects":62,"num_object_clones":6,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":43,"num_read":4667,"num_read_kb":11351,"num_write":682,"num_write_kb":4816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":7593093,"num_keys_recovered":57,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1c","version":"132'686","reported_seq":5502,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.568176+0000","last_change":"2024-09-11T05:23:41.497932+0000","last_active":"2024-09-11T05:23:41.568176+0000","last_peered":"2024-09-11T05:23:41.568176+0000","last_clean":"2024-09-11T05:23:41.568176+0000","last_became_active":"2024-09-11T05:23:28.420506+0000","last_became_peered":"2024-09-11T05:23:28.420506+0000","last_unstale":"2024-09-11T05:23:41.568176+0000","last_undegraded":"2024-09-11T05:23:41.568176+0000","last_fullsized":"2024-09-11T05:23:41.568176+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:52.645732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044298100000000001,"stat_sum":{"num_bytes":11089197,"num_objects":62,"num_object_clones":10,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":39,"num_read":5928,"num_read_kb":17747,"num_write":761,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":8649105,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1b","version":"131'732","reported_seq":4749,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.495408+0000","last_change":"2024-09-11T05:23:41.495711+0000","last_active":"2024-09-11T05:23:41.495408+0000","last_peered":"2024-09-11T05:23:41.495408+0000","last_clean":"2024-09-11T05:23:41.495408+0000","last_became_active":"2024-09-11T05:23:29.422326+0000","last_became_peered":"2024-09-11T05:23:29.422326+0000","last_unstale":"2024-09-11T05:23:41.495408+0000","last_undegraded":"2024-09-11T05:23:41.495408+0000","last_fullsized":"2024-09-11T05:23:41.495408+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:05.182604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067202600000000005,"stat_sum":{"num_bytes":16679663,"num_objects":67,"num_object_clones":9,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":45,"num_read":4532,"num_read_kb":11884,"num_write":890,"num_write_kb":11550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":495,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1a","version":"132'288","reported_seq":6525,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.590972+0000","last_change":"2024-09-11T05:23:41.509232+0000","last_active":"2024-09-11T05:23:41.590972+0000","last_peered":"2024-09-11T05:23:41.590972+0000","last_clean":"2024-09-11T05:23:41.590972+0000","last_became_active":"2024-09-11T05:23:28.419730+0000","last_became_peered":"2024-09-11T05:23:28.419730+0000","last_unstale":"2024-09-11T05:23:41.590972+0000","last_undegraded":"2024-09-11T05:23:41.590972+0000","last_fullsized":"2024-09-11T05:23:41.590972+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:57:48.860821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069843200000000002,"stat_sum":{"num_bytes":14710358,"num_objects":51,"num_object_clones":2,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":33,"num_read":5537,"num_read_kb":38821,"num_write":250,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":15189073,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.19","version":"132'281","reported_seq":3592,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.508630+0000","last_change":"2024-09-11T05:23:41.508630+0000","last_active":"2024-09-11T05:23:41.508630+0000","last_peered":"2024-09-11T05:23:41.508630+0000","last_clean":"2024-09-11T05:23:41.508630+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:23:41.508630+0000","last_undegraded":"2024-09-11T05:23:41.508630+0000","last_fullsized":"2024-09-11T05:23:41.508630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:51:09.231609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047887199999999998,"stat_sum":{"num_bytes":24642844,"num_objects":59,"num_object_clones":4,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":39,"num_read":3056,"num_read_kb":14644,"num_write":257,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.18","version":"132'785","reported_seq":11642,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.491615+0000","last_change":"2024-09-11T05:23:41.491615+0000","last_active":"2024-09-11T05:23:41.491615+0000","last_peered":"2024-09-11T05:23:41.491615+0000","last_clean":"2024-09-11T05:23:41.491615+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:23:41.491615+0000","last_undegraded":"2024-09-11T05:23:41.491615+0000","last_fullsized":"2024-09-11T05:23:41.491615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:00.136376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001439201,"stat_sum":{"num_bytes":30282318,"num_objects":66,"num_object_clones":6,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":42,"num_read":14063,"num_read_kb":34648,"num_write":1142,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.17","version":"132'660","reported_seq":4888,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.498519+0000","last_change":"2024-09-11T05:23:41.498519+0000","last_active":"2024-09-11T05:23:41.498519+0000","last_peered":"2024-09-11T05:23:41.498519+0000","last_clean":"2024-09-11T05:23:41.498519+0000","last_became_active":"2024-09-11T05:23:19.420246+0000","last_became_peered":"2024-09-11T05:23:19.420246+0000","last_unstale":"2024-09-11T05:23:41.498519+0000","last_undegraded":"2024-09-11T05:23:41.498519+0000","last_fullsized":"2024-09-11T05:23:41.498519+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:01.533667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000913601,"stat_sum":{"num_bytes":18954826,"num_objects":68,"num_object_clones":9,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":47,"num_read":6372,"num_read_kb":20126,"num_write":664,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.16","version":"131'628","reported_seq":12976,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497654+0000","last_change":"2024-09-11T05:23:41.497928+0000","last_active":"2024-09-11T05:23:41.497654+0000","last_peered":"2024-09-11T05:23:41.497654+0000","last_clean":"2024-09-11T05:23:41.497654+0000","last_became_active":"2024-09-11T05:23:10.602439+0000","last_became_peered":"2024-09-11T05:23:10.602439+0000","last_unstale":"2024-09-11T05:23:41.497654+0000","last_undegraded":"2024-09-11T05:23:41.497654+0000","last_fullsized":"2024-09-11T05:23:41.497654+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:11.471770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044649000000000002,"stat_sum":{"num_bytes":28801269,"num_objects":69,"num_object_clones":6,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":41,"num_read":13503,"num_read_kb":32544,"num_write":794,"num_write_kb":18281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.15","version":"132'469","reported_seq":3779,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.546503+0000","last_change":"2024-09-11T05:23:41.546503+0000","last_active":"2024-09-11T05:23:41.546503+0000","last_peered":"2024-09-11T05:23:41.546503+0000","last_clean":"2024-09-11T05:23:41.546503+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:23:41.546503+0000","last_undegraded":"2024-09-11T05:23:41.546503+0000","last_fullsized":"2024-09-11T05:23:41.546503+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:11.829562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184704,"stat_sum":{"num_bytes":22631144,"num_objects":63,"num_object_clones":3,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":44,"num_read":4354,"num_read_kb":20010,"num_write":422,"num_write_kb":6821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.14","version":"132'515","reported_seq":5495,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.568113+0000","last_change":"2024-09-11T05:23:41.545797+0000","last_active":"2024-09-11T05:23:41.568113+0000","last_peered":"2024-09-11T05:23:41.568113+0000","last_clean":"2024-09-11T05:23:41.568113+0000","last_became_active":"2024-09-11T05:23:28.424264+0000","last_became_peered":"2024-09-11T05:23:28.424264+0000","last_unstale":"2024-09-11T05:23:41.568113+0000","last_undegraded":"2024-09-11T05:23:41.568113+0000","last_fullsized":"2024-09-11T05:23:41.568113+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:01.554200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076006999999999995,"stat_sum":{"num_bytes":17366883,"num_objects":63,"num_object_clones":6,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":41,"num_read":5231,"num_read_kb":23236,"num_write":588,"num_write_kb":15655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":459,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490171+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:23:41.490171+0000","last_peered":"2024-09-11T05:23:41.490171+0000","last_clean":"2024-09-11T05:23:41.490171+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:23:41.490171+0000","last_undegraded":"2024-09-11T05:23:41.490171+0000","last_fullsized":"2024-09-11T05:23:41.490171+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"132'586","reported_seq":7463,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.571335+0000","last_change":"2024-09-11T05:23:41.495312+0000","last_active":"2024-09-11T05:23:41.571335+0000","last_peered":"2024-09-11T05:23:41.571335+0000","last_clean":"2024-09-11T05:23:41.571335+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:23:41.571335+0000","last_undegraded":"2024-09-11T05:23:41.571335+0000","last_fullsized":"2024-09-11T05:23:41.571335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:00.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052860299999999999,"stat_sum":{"num_bytes":43939530,"num_objects":72,"num_object_clones":7,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":47,"num_read":8634,"num_read_kb":23075,"num_write":587,"num_write_kb":13682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.6","version":"0'0","reported_seq":251,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.508242+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:23:41.508242+0000","last_peered":"2024-09-11T05:23:41.508242+0000","last_clean":"2024-09-11T05:23:41.508242+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:23:41.508242+0000","last_undegraded":"2024-09-11T05:23:41.508242+0000","last_fullsized":"2024-09-11T05:23:41.508242+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"132'539","reported_seq":4307,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.544480+0000","last_change":"2024-09-11T05:23:41.492097+0000","last_active":"2024-09-11T05:23:41.544480+0000","last_peered":"2024-09-11T05:23:41.544480+0000","last_clean":"2024-09-11T05:23:41.544480+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:23:41.544480+0000","last_undegraded":"2024-09-11T05:23:41.544480+0000","last_fullsized":"2024-09-11T05:23:41.544480+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:12.718968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013157500000000001,"stat_sum":{"num_bytes":33469444,"num_objects":67,"num_object_clones":9,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":42,"num_read":5322,"num_read_kb":21543,"num_write":457,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490004+0000","last_change":"2024-09-11T05:22:20.600569+0000","last_active":"2024-09-11T05:23:41.490004+0000","last_peered":"2024-09-11T05:23:41.490004+0000","last_clean":"2024-09-11T05:23:41.490004+0000","last_became_active":"2024-09-11T05:22:20.600190+0000","last_became_peered":"2024-09-11T05:22:20.600190+0000","last_unstale":"2024-09-11T05:23:41.490004+0000","last_undegraded":"2024-09-11T05:23:41.490004+0000","last_fullsized":"2024-09-11T05:23:41.490004+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:24.527563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"132'444","reported_seq":1860,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.509045+0000","last_change":"2024-09-11T05:23:41.509045+0000","last_active":"2024-09-11T05:23:41.509045+0000","last_peered":"2024-09-11T05:23:41.509045+0000","last_clean":"2024-09-11T05:23:41.509045+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:23:41.509045+0000","last_undegraded":"2024-09-11T05:23:41.509045+0000","last_fullsized":"2024-09-11T05:23:41.509045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:32.291100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070628900000000003,"stat_sum":{"num_bytes":21858800,"num_objects":82,"num_object_clones":8,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":47,"num_read":1875,"num_read_kb":19588,"num_write":458,"num_write_kb":10413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.508226+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:23:41.508226+0000","last_peered":"2024-09-11T05:23:41.508226+0000","last_clean":"2024-09-11T05:23:41.508226+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:23:41.508226+0000","last_undegraded":"2024-09-11T05:23:41.508226+0000","last_fullsized":"2024-09-11T05:23:41.508226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"132'356","reported_seq":5433,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.498415+0000","last_change":"2024-09-11T05:23:41.498415+0000","last_active":"2024-09-11T05:23:41.498415+0000","last_peered":"2024-09-11T05:23:41.498415+0000","last_clean":"2024-09-11T05:23:41.498415+0000","last_became_active":"2024-09-11T05:21:42.409551+0000","last_became_peered":"2024-09-11T05:21:42.409551+0000","last_unstale":"2024-09-11T05:23:41.498415+0000","last_undegraded":"2024-09-11T05:23:41.498415+0000","last_fullsized":"2024-09-11T05:23:41.498415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:43.332225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086410899999999995,"stat_sum":{"num_bytes":24347841,"num_objects":59,"num_object_clones":10,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":35,"num_read":5343,"num_read_kb":14813,"num_write":306,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.3","version":"132'484","reported_seq":13488,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.584227+0000","last_change":"2024-09-11T05:23:41.490671+0000","last_active":"2024-09-11T05:23:41.584227+0000","last_peered":"2024-09-11T05:23:41.584227+0000","last_clean":"2024-09-11T05:23:41.584227+0000","last_became_active":"2024-09-11T05:23:28.422618+0000","last_became_peered":"2024-09-11T05:23:28.422618+0000","last_unstale":"2024-09-11T05:23:41.584227+0000","last_undegraded":"2024-09-11T05:23:41.584227+0000","last_fullsized":"2024-09-11T05:23:41.584227+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:50:00.834044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000434332,"stat_sum":{"num_bytes":42594341,"num_objects":68,"num_object_clones":9,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":37,"num_read":13241,"num_read_kb":50458,"num_write":444,"num_write_kb":30383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.2","version":"21'2","reported_seq":244,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497525+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:23:41.497525+0000","last_peered":"2024-09-11T05:23:41.497525+0000","last_clean":"2024-09-11T05:23:41.497525+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:23:41.497525+0000","last_undegraded":"2024-09-11T05:23:41.497525+0000","last_fullsized":"2024-09-11T05:23:41.497525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"132'808","reported_seq":4556,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.606431+0000","last_change":"2024-09-11T05:23:41.508948+0000","last_active":"2024-09-11T05:23:41.606431+0000","last_peered":"2024-09-11T05:23:41.606431+0000","last_clean":"2024-09-11T05:23:41.606431+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:23:41.606431+0000","last_undegraded":"2024-09-11T05:23:41.606431+0000","last_fullsized":"2024-09-11T05:23:41.606431+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:04.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069863499999999997,"stat_sum":{"num_bytes":12426590,"num_objects":62,"num_object_clones":3,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":38,"num_read":6814,"num_read_kb":33779,"num_write":1081,"num_write_kb":6467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T05:23:40.492960+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:23:40.492960+0000","last_peered":"2024-09-11T05:23:40.492960+0000","last_clean":"2024-09-11T05:23:40.492960+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:23:40.492960+0000","last_undegraded":"2024-09-11T05:23:40.492960+0000","last_fullsized":"2024-09-11T05:23:40.492960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"132'412","reported_seq":8883,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497067+0000","last_change":"2024-09-11T05:23:41.497067+0000","last_active":"2024-09-11T05:23:41.497067+0000","last_peered":"2024-09-11T05:23:41.497067+0000","last_clean":"2024-09-11T05:23:41.497067+0000","last_became_active":"2024-09-11T05:23:28.421503+0000","last_became_peered":"2024-09-11T05:23:28.421503+0000","last_unstale":"2024-09-11T05:23:41.497067+0000","last_undegraded":"2024-09-11T05:23:41.497067+0000","last_fullsized":"2024-09-11T05:23:41.497067+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:10.475569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018511210000000001,"stat_sum":{"num_bytes":28484101,"num_objects":66,"num_object_clones":7,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":38,"num_read":8388,"num_read_kb":22726,"num_write":392,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.544821+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:23:41.544821+0000","last_peered":"2024-09-11T05:23:41.544821+0000","last_clean":"2024-09-11T05:23:41.544821+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:23:41.544821+0000","last_undegraded":"2024-09-11T05:23:41.544821+0000","last_fullsized":"2024-09-11T05:23:41.544821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"131'709","reported_seq":2546,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490439+0000","last_change":"2024-09-11T05:23:41.491200+0000","last_active":"2024-09-11T05:23:41.490439+0000","last_peered":"2024-09-11T05:23:41.490439+0000","last_clean":"2024-09-11T05:23:41.490439+0000","last_became_active":"2024-09-11T05:21:42.405781+0000","last_became_peered":"2024-09-11T05:21:42.405781+0000","last_unstale":"2024-09-11T05:23:41.490439+0000","last_undegraded":"2024-09-11T05:23:41.490439+0000","last_fullsized":"2024-09-11T05:23:41.490439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:15.806116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001260352,"stat_sum":{"num_bytes":36044786,"num_objects":84,"num_object_clones":10,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":50,"num_read":4052,"num_read_kb":14277,"num_write":904,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.3","version":"19'1","reported_seq":249,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497432+0000","last_change":"2024-09-11T05:22:58.417441+0000","last_active":"2024-09-11T05:23:41.497432+0000","last_peered":"2024-09-11T05:23:41.497432+0000","last_clean":"2024-09-11T05:23:41.497432+0000","last_became_active":"2024-09-11T05:22:58.417171+0000","last_became_peered":"2024-09-11T05:22:58.417171+0000","last_unstale":"2024-09-11T05:23:41.497432+0000","last_undegraded":"2024-09-11T05:23:41.497432+0000","last_fullsized":"2024-09-11T05:23:41.497432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:32:11.272751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":322,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.544708+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:23:41.544708+0000","last_peered":"2024-09-11T05:23:41.544708+0000","last_clean":"2024-09-11T05:23:41.544708+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:23:41.544708+0000","last_undegraded":"2024-09-11T05:23:41.544708+0000","last_fullsized":"2024-09-11T05:23:41.544708+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"132'370","reported_seq":5471,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.565493+0000","last_change":"2024-09-11T05:23:41.492063+0000","last_active":"2024-09-11T05:23:41.565493+0000","last_peered":"2024-09-11T05:23:41.565493+0000","last_clean":"2024-09-11T05:23:41.565493+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:23:41.565493+0000","last_undegraded":"2024-09-11T05:23:41.565493+0000","last_fullsized":"2024-09-11T05:23:41.565493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:15.950198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001633607,"stat_sum":{"num_bytes":33324742,"num_objects":75,"num_object_clones":9,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":44,"num_read":4942,"num_read_kb":21739,"num_write":338,"num_write_kb":9557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.9","version":"131'628","reported_seq":2300,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T05:23:40.500417+0000","last_change":"2024-09-11T05:23:40.501393+0000","last_active":"2024-09-11T05:23:40.500417+0000","last_peered":"2024-09-11T05:23:40.500417+0000","last_clean":"2024-09-11T05:23:40.500417+0000","last_became_active":"2024-09-11T05:23:28.421572+0000","last_became_peered":"2024-09-11T05:23:28.421572+0000","last_unstale":"2024-09-11T05:23:40.500417+0000","last_undegraded":"2024-09-11T05:23:40.500417+0000","last_fullsized":"2024-09-11T05:23:40.500417+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:54.670263+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.0082336690000000008,"stat_sum":{"num_bytes":16088700,"num_objects":66,"num_object_clones":5,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":41,"num_read":2560,"num_read_kb":3742,"num_write":809,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":510,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"23","length":"9"}]},{"pgid":"3.a","version":"132'612","reported_seq":3871,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490511+0000","last_change":"2024-09-11T05:23:41.490511+0000","last_active":"2024-09-11T05:23:41.490511+0000","last_peered":"2024-09-11T05:23:41.490511+0000","last_clean":"2024-09-11T05:23:41.490511+0000","last_became_active":"2024-09-11T05:23:28.422788+0000","last_became_peered":"2024-09-11T05:23:28.422788+0000","last_unstale":"2024-09-11T05:23:41.490511+0000","last_undegraded":"2024-09-11T05:23:41.490511+0000","last_fullsized":"2024-09-11T05:23:41.490511+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:37.976626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000344519,"stat_sum":{"num_bytes":13460484,"num_objects":62,"num_object_clones":4,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":42,"num_read":4040,"num_read_kb":17317,"num_write":695,"num_write_kb":3540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.b","version":"132'550","reported_seq":3001,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490872+0000","last_change":"2024-09-11T05:23:41.490872+0000","last_active":"2024-09-11T05:23:41.490872+0000","last_peered":"2024-09-11T05:23:41.490872+0000","last_clean":"2024-09-11T05:23:41.490872+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:23:41.490872+0000","last_undegraded":"2024-09-11T05:23:41.490872+0000","last_fullsized":"2024-09-11T05:23:41.490872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:44.400830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091800099999999999,"stat_sum":{"num_bytes":22150894,"num_objects":86,"num_object_clones":12,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":57,"num_read":3954,"num_read_kb":10184,"num_write":593,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.c","version":"131'316","reported_seq":1244,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497981+0000","last_change":"2024-09-11T05:23:41.498168+0000","last_active":"2024-09-11T05:23:41.497981+0000","last_peered":"2024-09-11T05:23:41.497981+0000","last_clean":"2024-09-11T05:23:41.497981+0000","last_became_active":"2024-09-11T05:21:42.410098+0000","last_became_peered":"2024-09-11T05:21:42.410098+0000","last_unstale":"2024-09-11T05:23:41.497981+0000","last_undegraded":"2024-09-11T05:23:41.497981+0000","last_fullsized":"2024-09-11T05:23:41.497981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:14:21.038200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070761200000000004,"stat_sum":{"num_bytes":11434750,"num_objects":46,"num_object_clones":7,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":33,"num_read":783,"num_read_kb":10739,"num_write":319,"num_write_kb":8792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.d","version":"131'705","reported_seq":4503,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.545637+0000","last_change":"2024-09-11T05:23:41.545862+0000","last_active":"2024-09-11T05:23:41.545637+0000","last_peered":"2024-09-11T05:23:41.545637+0000","last_clean":"2024-09-11T05:23:41.545637+0000","last_became_active":"2024-09-11T05:23:11.600054+0000","last_became_peered":"2024-09-11T05:23:11.600054+0000","last_unstale":"2024-09-11T05:23:41.545637+0000","last_undegraded":"2024-09-11T05:23:41.545637+0000","last_fullsized":"2024-09-11T05:23:41.545637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:33.201649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082672500000000005,"stat_sum":{"num_bytes":41764133,"num_objects":74,"num_object_clones":7,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":43,"num_read":6434,"num_read_kb":38622,"num_write":831,"num_write_kb":8476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":223,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.e","version":"132'454","reported_seq":4178,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.605866+0000","last_change":"2024-09-11T05:23:41.546131+0000","last_active":"2024-09-11T05:23:41.605866+0000","last_peered":"2024-09-11T05:23:41.605866+0000","last_clean":"2024-09-11T05:23:41.605866+0000","last_became_active":"2024-09-11T05:23:28.420566+0000","last_became_peered":"2024-09-11T05:23:28.420566+0000","last_unstale":"2024-09-11T05:23:41.605866+0000","last_undegraded":"2024-09-11T05:23:41.605866+0000","last_fullsized":"2024-09-11T05:23:41.605866+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:12:48.766887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001014963,"stat_sum":{"num_bytes":18912491,"num_objects":60,"num_object_clones":9,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":36,"num_read":3559,"num_read_kb":10189,"num_write":491,"num_write_kb":7795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":522,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.f","version":"132'748","reported_seq":4295,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.546179+0000","last_change":"2024-09-11T05:23:41.546179+0000","last_active":"2024-09-11T05:23:41.546179+0000","last_peered":"2024-09-11T05:23:41.546179+0000","last_clean":"2024-09-11T05:23:41.546179+0000","last_became_active":"2024-09-11T05:23:29.422139+0000","last_became_peered":"2024-09-11T05:23:29.422139+0000","last_unstale":"2024-09-11T05:23:41.546179+0000","last_undegraded":"2024-09-11T05:23:41.546179+0000","last_fullsized":"2024-09-11T05:23:41.546179+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:22:22.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096026300000000005,"stat_sum":{"num_bytes":15947409,"num_objects":68,"num_object_clones":5,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":46,"num_read":5699,"num_read_kb":19750,"num_write":919,"num_write_kb":3569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":595,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.10","version":"132'610","reported_seq":2171,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.587190+0000","last_change":"2024-09-11T05:23:41.490476+0000","last_active":"2024-09-11T05:23:41.587190+0000","last_peered":"2024-09-11T05:23:41.587190+0000","last_clean":"2024-09-11T05:23:41.587190+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:23:41.587190+0000","last_undegraded":"2024-09-11T05:23:41.587190+0000","last_fullsized":"2024-09-11T05:23:41.587190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:12.170830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034712600000000001,"stat_sum":{"num_bytes":7371248,"num_objects":68,"num_object_clones":6,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":48,"num_read":3174,"num_read_kb":9806,"num_write":769,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.11","version":"132'395","reported_seq":3435,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.545514+0000","last_change":"2024-09-11T05:23:41.545514+0000","last_active":"2024-09-11T05:23:41.545514+0000","last_peered":"2024-09-11T05:23:41.545514+0000","last_clean":"2024-09-11T05:23:41.545514+0000","last_became_active":"2024-09-11T05:23:28.422654+0000","last_became_peered":"2024-09-11T05:23:28.422654+0000","last_unstale":"2024-09-11T05:23:41.545514+0000","last_undegraded":"2024-09-11T05:23:41.545514+0000","last_fullsized":"2024-09-11T05:23:41.545514+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:03.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052879200000000004,"stat_sum":{"num_bytes":16862515,"num_objects":51,"num_object_clones":6,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":36,"num_read":3101,"num_read_kb":8231,"num_write":347,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":497,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.12","version":"132'529","reported_seq":7161,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.545536+0000","last_change":"2024-09-11T05:23:41.545536+0000","last_active":"2024-09-11T05:23:41.545536+0000","last_peered":"2024-09-11T05:23:41.545536+0000","last_clean":"2024-09-11T05:23:41.545536+0000","last_became_active":"2024-09-11T05:23:19.419941+0000","last_became_peered":"2024-09-11T05:23:19.419941+0000","last_unstale":"2024-09-11T05:23:41.545536+0000","last_undegraded":"2024-09-11T05:23:41.545536+0000","last_fullsized":"2024-09-11T05:23:41.545536+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:29.927343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000540392,"stat_sum":{"num_bytes":33688920,"num_objects":77,"num_object_clones":18,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":45,"num_read":7682,"num_read_kb":29266,"num_write":554,"num_write_kb":13721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.13","version":"132'749","reported_seq":3643,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.566649+0000","last_change":"2024-09-11T05:23:41.546425+0000","last_active":"2024-09-11T05:23:41.566649+0000","last_peered":"2024-09-11T05:23:41.566649+0000","last_clean":"2024-09-11T05:23:41.566649+0000","last_became_active":"2024-09-11T05:23:29.424652+0000","last_became_peered":"2024-09-11T05:23:29.424652+0000","last_unstale":"2024-09-11T05:23:41.566649+0000","last_undegraded":"2024-09-11T05:23:41.566649+0000","last_fullsized":"2024-09-11T05:23:41.566649+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:22.652005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011457049999999999,"stat_sum":{"num_bytes":25680743,"num_objects":68,"num_object_clones":9,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":49,"num_read":4920,"num_read_kb":19852,"num_write":1015,"num_write_kb":7641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":752904526,"num_objects":2132,"num_object_clones":241,"num_object_copies":4264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2132,"num_whiteouts":1340,"num_read":184615,"num_read_kb":671258,"num_write":20023,"num_write_kb":308348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7001,"num_bytes_recovered":204886700,"num_keys_recovered":1059,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260149248,"data_stored":318784189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},"log_size":17793,"ondisk_log_size":17793,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90232,"kb_used_data":36812,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94281608,"statfs":{"total":96636764160,"available":96544366592,"internally_reserved":0,"allocated":37695488,"data_stored":40425001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76652,"kb_used_data":27412,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94295188,"statfs":{"total":96636764160,"available":96558272512,"internally_reserved":0,"allocated":28069888,"data_stored":34709810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83872,"kb_used_data":34628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94287968,"statfs":{"total":96636764160,"available":96550879232,"internally_reserved":0,"allocated":35459072,"data_stored":44636468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":55834574878,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85180,"kb_used_data":34800,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94286660,"statfs":{"total":96636764160,"available":96549539840,"internally_reserved":0,"allocated":35635200,"data_stored":42360993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154762,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52272,"kb_used_data":19804,"kb_used_omap":11,"kb_used_meta":32436,"kb_avail":94319568,"statfs":{"total":96636764160,"available":96583237632,"internally_reserved":0,"allocated":20279296,"data_stored":24690110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":33215286},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79724,"kb_used_data":26320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94292116,"statfs":{"total":96636764160,"available":96555126784,"internally_reserved":0,"allocated":26951680,"data_stored":35297195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101740,"kb_used_data":43036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94270100,"statfs":{"total":96636764160,"available":96532582400,"internally_reserved":0,"allocated":44068864,"data_stored":53100737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41213952,"data_stored":51102011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25366528,"data_stored":34539108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18325504,"data_stored":23572493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33083392,"data_stored":40640492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46469120,"data_stored":52187601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33873920,"data_stored":43878381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26349568,"data_stored":33833402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35467264,"data_stored":39030701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:23:43.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:23:43.971 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:43.971+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:43.983 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:43.983 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:43.992 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:44.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:44.072+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:44.136 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:44.136 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:44.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:44.189 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:44.189+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:44.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:23:44.230 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:23:44.241 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-11T05:23:43.560102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":753494913,"num_objects":2136,"num_object_clones":241,"num_object_copies":4272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2136,"num_whiteouts":1340,"num_read":184731,"num_read_kb":671358,"num_write":20184,"num_write_kb":310766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7005,"num_bytes_recovered":206067436,"num_keys_recovered":1059,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17913,"ondisk_log_size":17913,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":569672,"kb_used_data":222812,"kb_used_omap":20,"kb_used_meta":344363,"kb_avail":660033208,"statfs":{"total":676457349120,"available":675874004992,"internally_reserved":0,"allocated":228159488,"data_stored":275220314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21025,"internal_metadata":352628191},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-104282596,"num_objects":-191,"num_object_clones":-57,"num_object_copies":-382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-191,"num_whiteouts":-54,"num_read":1168,"num_read_kb":999,"num_write":257,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000553"},"pg_stats":[{"pgid":"3.1f","version":"132'654","reported_seq":3821,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.603642+0000","last_change":"2024-09-11T05:23:41.497008+0000","last_active":"2024-09-11T05:23:41.603642+0000","last_peered":"2024-09-11T05:23:41.603642+0000","last_clean":"2024-09-11T05:23:41.603642+0000","last_became_active":"2024-09-11T05:21:42.406554+0000","last_became_peered":"2024-09-11T05:21:42.406554+0000","last_unstale":"2024-09-11T05:23:41.603642+0000","last_undegraded":"2024-09-11T05:23:41.603642+0000","last_fullsized":"2024-09-11T05:23:41.603642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:04:11.029220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00187963,"stat_sum":{"num_bytes":35633912,"num_objects":72,"num_object_clones":13,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":39,"num_read":5074,"num_read_kb":21953,"num_write":681,"num_write_kb":10343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1e","version":"132'504","reported_seq":6767,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.491602+0000","last_change":"2024-09-11T05:23:41.491602+0000","last_active":"2024-09-11T05:23:41.491602+0000","last_peered":"2024-09-11T05:23:41.491602+0000","last_clean":"2024-09-11T05:23:41.491602+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:23:41.491602+0000","last_undegraded":"2024-09-11T05:23:41.491602+0000","last_fullsized":"2024-09-11T05:23:41.491602+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:00:14.831894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012822039999999999,"stat_sum":{"num_bytes":23972719,"num_objects":69,"num_object_clones":7,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":33,"num_read":7781,"num_read_kb":24598,"num_write":583,"num_write_kb":13409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1d","version":"132'587","reported_seq":4284,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.574605+0000","last_change":"2024-09-11T05:23:41.498207+0000","last_active":"2024-09-11T05:23:41.574605+0000","last_peered":"2024-09-11T05:23:41.574605+0000","last_clean":"2024-09-11T05:23:41.574605+0000","last_became_active":"2024-09-11T05:23:29.422589+0000","last_became_peered":"2024-09-11T05:23:29.422589+0000","last_unstale":"2024-09-11T05:23:41.574605+0000","last_undegraded":"2024-09-11T05:23:41.574605+0000","last_fullsized":"2024-09-11T05:23:41.574605+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:10:31.643821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069744200000000005,"stat_sum":{"num_bytes":8286931,"num_objects":62,"num_object_clones":6,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":43,"num_read":4667,"num_read_kb":11351,"num_write":682,"num_write_kb":4816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":7593093,"num_keys_recovered":57,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1c","version":"132'686","reported_seq":5502,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.568176+0000","last_change":"2024-09-11T05:23:41.497932+0000","last_active":"2024-09-11T05:23:41.568176+0000","last_peered":"2024-09-11T05:23:41.568176+0000","last_clean":"2024-09-11T05:23:41.568176+0000","last_became_active":"2024-09-11T05:23:28.420506+0000","last_became_peered":"2024-09-11T05:23:28.420506+0000","last_unstale":"2024-09-11T05:23:41.568176+0000","last_undegraded":"2024-09-11T05:23:41.568176+0000","last_fullsized":"2024-09-11T05:23:41.568176+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:52.645732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044298100000000001,"stat_sum":{"num_bytes":11089197,"num_objects":62,"num_object_clones":10,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":39,"num_read":5928,"num_read_kb":17747,"num_write":761,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":8649105,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1b","version":"131'732","reported_seq":4749,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.495408+0000","last_change":"2024-09-11T05:23:41.495711+0000","last_active":"2024-09-11T05:23:41.495408+0000","last_peered":"2024-09-11T05:23:41.495408+0000","last_clean":"2024-09-11T05:23:41.495408+0000","last_became_active":"2024-09-11T05:23:29.422326+0000","last_became_peered":"2024-09-11T05:23:29.422326+0000","last_unstale":"2024-09-11T05:23:41.495408+0000","last_undegraded":"2024-09-11T05:23:41.495408+0000","last_fullsized":"2024-09-11T05:23:41.495408+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:05.182604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067202600000000005,"stat_sum":{"num_bytes":16679663,"num_objects":67,"num_object_clones":9,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":45,"num_read":4532,"num_read_kb":11884,"num_write":890,"num_write_kb":11550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":495,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.1a","version":"132'288","reported_seq":6525,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.590972+0000","last_change":"2024-09-11T05:23:41.509232+0000","last_active":"2024-09-11T05:23:41.590972+0000","last_peered":"2024-09-11T05:23:41.590972+0000","last_clean":"2024-09-11T05:23:41.590972+0000","last_became_active":"2024-09-11T05:23:28.419730+0000","last_became_peered":"2024-09-11T05:23:28.419730+0000","last_unstale":"2024-09-11T05:23:41.590972+0000","last_undegraded":"2024-09-11T05:23:41.590972+0000","last_fullsized":"2024-09-11T05:23:41.590972+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:57:48.860821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069843200000000002,"stat_sum":{"num_bytes":14710358,"num_objects":51,"num_object_clones":2,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":33,"num_read":5537,"num_read_kb":38821,"num_write":250,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":15189073,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.19","version":"132'281","reported_seq":3592,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.508630+0000","last_change":"2024-09-11T05:23:41.508630+0000","last_active":"2024-09-11T05:23:41.508630+0000","last_peered":"2024-09-11T05:23:41.508630+0000","last_clean":"2024-09-11T05:23:41.508630+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:23:41.508630+0000","last_undegraded":"2024-09-11T05:23:41.508630+0000","last_fullsized":"2024-09-11T05:23:41.508630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:51:09.231609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047887199999999998,"stat_sum":{"num_bytes":24642844,"num_objects":59,"num_object_clones":4,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":39,"num_read":3056,"num_read_kb":14644,"num_write":257,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.18","version":"132'785","reported_seq":11642,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.491615+0000","last_change":"2024-09-11T05:23:41.491615+0000","last_active":"2024-09-11T05:23:41.491615+0000","last_peered":"2024-09-11T05:23:41.491615+0000","last_clean":"2024-09-11T05:23:41.491615+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:23:41.491615+0000","last_undegraded":"2024-09-11T05:23:41.491615+0000","last_fullsized":"2024-09-11T05:23:41.491615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:00.136376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001439201,"stat_sum":{"num_bytes":30282318,"num_objects":66,"num_object_clones":6,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":42,"num_read":14063,"num_read_kb":34648,"num_write":1142,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.17","version":"132'660","reported_seq":4888,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.498519+0000","last_change":"2024-09-11T05:23:41.498519+0000","last_active":"2024-09-11T05:23:41.498519+0000","last_peered":"2024-09-11T05:23:41.498519+0000","last_clean":"2024-09-11T05:23:41.498519+0000","last_became_active":"2024-09-11T05:23:19.420246+0000","last_became_peered":"2024-09-11T05:23:19.420246+0000","last_unstale":"2024-09-11T05:23:41.498519+0000","last_undegraded":"2024-09-11T05:23:41.498519+0000","last_fullsized":"2024-09-11T05:23:41.498519+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:01.533667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000913601,"stat_sum":{"num_bytes":18954826,"num_objects":68,"num_object_clones":9,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":47,"num_read":6372,"num_read_kb":20126,"num_write":664,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.16","version":"131'628","reported_seq":12976,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497654+0000","last_change":"2024-09-11T05:23:41.497928+0000","last_active":"2024-09-11T05:23:41.497654+0000","last_peered":"2024-09-11T05:23:41.497654+0000","last_clean":"2024-09-11T05:23:41.497654+0000","last_became_active":"2024-09-11T05:23:10.602439+0000","last_became_peered":"2024-09-11T05:23:10.602439+0000","last_unstale":"2024-09-11T05:23:41.497654+0000","last_undegraded":"2024-09-11T05:23:41.497654+0000","last_fullsized":"2024-09-11T05:23:41.497654+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:11.471770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044649000000000002,"stat_sum":{"num_bytes":28801269,"num_objects":69,"num_object_clones":6,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":41,"num_read":13503,"num_read_kb":32544,"num_write":794,"num_write_kb":18281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.15","version":"132'469","reported_seq":3779,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.546503+0000","last_change":"2024-09-11T05:23:41.546503+0000","last_active":"2024-09-11T05:23:41.546503+0000","last_peered":"2024-09-11T05:23:41.546503+0000","last_clean":"2024-09-11T05:23:41.546503+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:23:41.546503+0000","last_undegraded":"2024-09-11T05:23:41.546503+0000","last_fullsized":"2024-09-11T05:23:41.546503+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:11.829562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184704,"stat_sum":{"num_bytes":22631144,"num_objects":63,"num_object_clones":3,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":44,"num_read":4354,"num_read_kb":20010,"num_write":422,"num_write_kb":6821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.14","version":"132'515","reported_seq":5495,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.568113+0000","last_change":"2024-09-11T05:23:41.545797+0000","last_active":"2024-09-11T05:23:41.568113+0000","last_peered":"2024-09-11T05:23:41.568113+0000","last_clean":"2024-09-11T05:23:41.568113+0000","last_became_active":"2024-09-11T05:23:28.424264+0000","last_became_peered":"2024-09-11T05:23:28.424264+0000","last_unstale":"2024-09-11T05:23:41.568113+0000","last_undegraded":"2024-09-11T05:23:41.568113+0000","last_fullsized":"2024-09-11T05:23:41.568113+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:01.554200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076006999999999995,"stat_sum":{"num_bytes":17366883,"num_objects":63,"num_object_clones":6,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":41,"num_read":5231,"num_read_kb":23236,"num_write":588,"num_write_kb":15655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":459,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490171+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:23:41.490171+0000","last_peered":"2024-09-11T05:23:41.490171+0000","last_clean":"2024-09-11T05:23:41.490171+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:23:41.490171+0000","last_undegraded":"2024-09-11T05:23:41.490171+0000","last_fullsized":"2024-09-11T05:23:41.490171+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"132'586","reported_seq":7463,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.571335+0000","last_change":"2024-09-11T05:23:41.495312+0000","last_active":"2024-09-11T05:23:41.571335+0000","last_peered":"2024-09-11T05:23:41.571335+0000","last_clean":"2024-09-11T05:23:41.571335+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:23:41.571335+0000","last_undegraded":"2024-09-11T05:23:41.571335+0000","last_fullsized":"2024-09-11T05:23:41.571335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:00.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052860299999999999,"stat_sum":{"num_bytes":43939530,"num_objects":72,"num_object_clones":7,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":47,"num_read":8634,"num_read_kb":23075,"num_write":587,"num_write_kb":13682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.6","version":"0'0","reported_seq":251,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.508242+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:23:41.508242+0000","last_peered":"2024-09-11T05:23:41.508242+0000","last_clean":"2024-09-11T05:23:41.508242+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:23:41.508242+0000","last_undegraded":"2024-09-11T05:23:41.508242+0000","last_fullsized":"2024-09-11T05:23:41.508242+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"132'539","reported_seq":4307,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.544480+0000","last_change":"2024-09-11T05:23:41.492097+0000","last_active":"2024-09-11T05:23:41.544480+0000","last_peered":"2024-09-11T05:23:41.544480+0000","last_clean":"2024-09-11T05:23:41.544480+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:23:41.544480+0000","last_undegraded":"2024-09-11T05:23:41.544480+0000","last_fullsized":"2024-09-11T05:23:41.544480+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:12.718968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013157500000000001,"stat_sum":{"num_bytes":33469444,"num_objects":67,"num_object_clones":9,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":42,"num_read":5322,"num_read_kb":21543,"num_write":457,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490004+0000","last_change":"2024-09-11T05:22:20.600569+0000","last_active":"2024-09-11T05:23:41.490004+0000","last_peered":"2024-09-11T05:23:41.490004+0000","last_clean":"2024-09-11T05:23:41.490004+0000","last_became_active":"2024-09-11T05:22:20.600190+0000","last_became_peered":"2024-09-11T05:22:20.600190+0000","last_unstale":"2024-09-11T05:23:41.490004+0000","last_undegraded":"2024-09-11T05:23:41.490004+0000","last_fullsized":"2024-09-11T05:23:41.490004+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:24.527563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"132'444","reported_seq":1860,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.509045+0000","last_change":"2024-09-11T05:23:41.509045+0000","last_active":"2024-09-11T05:23:41.509045+0000","last_peered":"2024-09-11T05:23:41.509045+0000","last_clean":"2024-09-11T05:23:41.509045+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:23:41.509045+0000","last_undegraded":"2024-09-11T05:23:41.509045+0000","last_fullsized":"2024-09-11T05:23:41.509045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:32.291100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070628900000000003,"stat_sum":{"num_bytes":21858800,"num_objects":82,"num_object_clones":8,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":47,"num_read":1875,"num_read_kb":19588,"num_write":458,"num_write_kb":10413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.508226+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:23:41.508226+0000","last_peered":"2024-09-11T05:23:41.508226+0000","last_clean":"2024-09-11T05:23:41.508226+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:23:41.508226+0000","last_undegraded":"2024-09-11T05:23:41.508226+0000","last_fullsized":"2024-09-11T05:23:41.508226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"132'356","reported_seq":5433,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.498415+0000","last_change":"2024-09-11T05:23:41.498415+0000","last_active":"2024-09-11T05:23:41.498415+0000","last_peered":"2024-09-11T05:23:41.498415+0000","last_clean":"2024-09-11T05:23:41.498415+0000","last_became_active":"2024-09-11T05:21:42.409551+0000","last_became_peered":"2024-09-11T05:21:42.409551+0000","last_unstale":"2024-09-11T05:23:41.498415+0000","last_undegraded":"2024-09-11T05:23:41.498415+0000","last_fullsized":"2024-09-11T05:23:41.498415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:43.332225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086410899999999995,"stat_sum":{"num_bytes":24347841,"num_objects":59,"num_object_clones":10,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":35,"num_read":5343,"num_read_kb":14813,"num_write":306,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.3","version":"132'484","reported_seq":13488,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.584227+0000","last_change":"2024-09-11T05:23:41.490671+0000","last_active":"2024-09-11T05:23:41.584227+0000","last_peered":"2024-09-11T05:23:41.584227+0000","last_clean":"2024-09-11T05:23:41.584227+0000","last_became_active":"2024-09-11T05:23:28.422618+0000","last_became_peered":"2024-09-11T05:23:28.422618+0000","last_unstale":"2024-09-11T05:23:41.584227+0000","last_undegraded":"2024-09-11T05:23:41.584227+0000","last_fullsized":"2024-09-11T05:23:41.584227+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:50:00.834044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000434332,"stat_sum":{"num_bytes":42594341,"num_objects":68,"num_object_clones":9,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":37,"num_read":13241,"num_read_kb":50458,"num_write":444,"num_write_kb":30383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.2","version":"21'2","reported_seq":244,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497525+0000","last_change":"2024-09-11T05:21:34.793970+0000","last_active":"2024-09-11T05:23:41.497525+0000","last_peered":"2024-09-11T05:23:41.497525+0000","last_clean":"2024-09-11T05:23:41.497525+0000","last_became_active":"2024-09-11T05:21:32.777121+0000","last_became_peered":"2024-09-11T05:21:32.777121+0000","last_unstale":"2024-09-11T05:23:41.497525+0000","last_undegraded":"2024-09-11T05:23:41.497525+0000","last_fullsized":"2024-09-11T05:23:41.497525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:16.785277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030588,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"132'808","reported_seq":4556,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.606431+0000","last_change":"2024-09-11T05:23:41.508948+0000","last_active":"2024-09-11T05:23:41.606431+0000","last_peered":"2024-09-11T05:23:41.606431+0000","last_clean":"2024-09-11T05:23:41.606431+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:23:41.606431+0000","last_undegraded":"2024-09-11T05:23:41.606431+0000","last_fullsized":"2024-09-11T05:23:41.606431+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:04.949922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069863499999999997,"stat_sum":{"num_bytes":12426590,"num_objects":62,"num_object_clones":3,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":38,"num_read":6814,"num_read_kb":33779,"num_write":1081,"num_write_kb":6467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T05:23:40.492960+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:23:40.492960+0000","last_peered":"2024-09-11T05:23:40.492960+0000","last_clean":"2024-09-11T05:23:40.492960+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:23:40.492960+0000","last_undegraded":"2024-09-11T05:23:40.492960+0000","last_fullsized":"2024-09-11T05:23:40.492960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"132'412","reported_seq":8883,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497067+0000","last_change":"2024-09-11T05:23:41.497067+0000","last_active":"2024-09-11T05:23:41.497067+0000","last_peered":"2024-09-11T05:23:41.497067+0000","last_clean":"2024-09-11T05:23:41.497067+0000","last_became_active":"2024-09-11T05:23:28.421503+0000","last_became_peered":"2024-09-11T05:23:28.421503+0000","last_unstale":"2024-09-11T05:23:41.497067+0000","last_undegraded":"2024-09-11T05:23:41.497067+0000","last_fullsized":"2024-09-11T05:23:41.497067+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:10.475569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018511210000000001,"stat_sum":{"num_bytes":28484101,"num_objects":66,"num_object_clones":7,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":38,"num_read":8388,"num_read_kb":22726,"num_write":392,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.544821+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:23:41.544821+0000","last_peered":"2024-09-11T05:23:41.544821+0000","last_clean":"2024-09-11T05:23:41.544821+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:23:41.544821+0000","last_undegraded":"2024-09-11T05:23:41.544821+0000","last_fullsized":"2024-09-11T05:23:41.544821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"131'709","reported_seq":2546,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490439+0000","last_change":"2024-09-11T05:23:41.491200+0000","last_active":"2024-09-11T05:23:41.490439+0000","last_peered":"2024-09-11T05:23:41.490439+0000","last_clean":"2024-09-11T05:23:41.490439+0000","last_became_active":"2024-09-11T05:21:42.405781+0000","last_became_peered":"2024-09-11T05:21:42.405781+0000","last_unstale":"2024-09-11T05:23:41.490439+0000","last_undegraded":"2024-09-11T05:23:41.490439+0000","last_fullsized":"2024-09-11T05:23:41.490439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:15.806116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001260352,"stat_sum":{"num_bytes":36044786,"num_objects":84,"num_object_clones":10,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":50,"num_read":4052,"num_read_kb":14277,"num_write":904,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"2.3","version":"19'1","reported_seq":249,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497432+0000","last_change":"2024-09-11T05:22:58.417441+0000","last_active":"2024-09-11T05:23:41.497432+0000","last_peered":"2024-09-11T05:23:41.497432+0000","last_clean":"2024-09-11T05:23:41.497432+0000","last_became_active":"2024-09-11T05:22:58.417171+0000","last_became_peered":"2024-09-11T05:22:58.417171+0000","last_unstale":"2024-09-11T05:23:41.497432+0000","last_undegraded":"2024-09-11T05:23:41.497432+0000","last_fullsized":"2024-09-11T05:23:41.497432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:32:11.272751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042239099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":322,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.544708+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:23:41.544708+0000","last_peered":"2024-09-11T05:23:41.544708+0000","last_clean":"2024-09-11T05:23:41.544708+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:23:41.544708+0000","last_undegraded":"2024-09-11T05:23:41.544708+0000","last_fullsized":"2024-09-11T05:23:41.544708+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"132'370","reported_seq":5471,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.565493+0000","last_change":"2024-09-11T05:23:41.492063+0000","last_active":"2024-09-11T05:23:41.565493+0000","last_peered":"2024-09-11T05:23:41.565493+0000","last_clean":"2024-09-11T05:23:41.565493+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:23:41.565493+0000","last_undegraded":"2024-09-11T05:23:41.565493+0000","last_fullsized":"2024-09-11T05:23:41.565493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:15.950198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001633607,"stat_sum":{"num_bytes":33324742,"num_objects":75,"num_object_clones":9,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":44,"num_read":4942,"num_read_kb":21739,"num_write":338,"num_write_kb":9557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.9","version":"131'628","reported_seq":2300,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T05:23:40.500417+0000","last_change":"2024-09-11T05:23:40.501393+0000","last_active":"2024-09-11T05:23:40.500417+0000","last_peered":"2024-09-11T05:23:40.500417+0000","last_clean":"2024-09-11T05:23:40.500417+0000","last_became_active":"2024-09-11T05:23:28.421572+0000","last_became_peered":"2024-09-11T05:23:28.421572+0000","last_unstale":"2024-09-11T05:23:40.500417+0000","last_undegraded":"2024-09-11T05:23:40.500417+0000","last_fullsized":"2024-09-11T05:23:40.500417+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:54.670263+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.0082336690000000008,"stat_sum":{"num_bytes":16088700,"num_objects":66,"num_object_clones":5,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":41,"num_read":2560,"num_read_kb":3742,"num_write":809,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":510,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"23","length":"9"}]},{"pgid":"3.a","version":"132'612","reported_seq":3871,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490511+0000","last_change":"2024-09-11T05:23:41.490511+0000","last_active":"2024-09-11T05:23:41.490511+0000","last_peered":"2024-09-11T05:23:41.490511+0000","last_clean":"2024-09-11T05:23:41.490511+0000","last_became_active":"2024-09-11T05:23:28.422788+0000","last_became_peered":"2024-09-11T05:23:28.422788+0000","last_unstale":"2024-09-11T05:23:41.490511+0000","last_undegraded":"2024-09-11T05:23:41.490511+0000","last_fullsized":"2024-09-11T05:23:41.490511+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:37.976626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000344519,"stat_sum":{"num_bytes":13460484,"num_objects":62,"num_object_clones":4,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":42,"num_read":4040,"num_read_kb":17317,"num_write":695,"num_write_kb":3540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.b","version":"132'550","reported_seq":3001,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.490872+0000","last_change":"2024-09-11T05:23:41.490872+0000","last_active":"2024-09-11T05:23:41.490872+0000","last_peered":"2024-09-11T05:23:41.490872+0000","last_clean":"2024-09-11T05:23:41.490872+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:23:41.490872+0000","last_undegraded":"2024-09-11T05:23:41.490872+0000","last_fullsized":"2024-09-11T05:23:41.490872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:44.400830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091800099999999999,"stat_sum":{"num_bytes":22150894,"num_objects":86,"num_object_clones":12,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":57,"num_read":3954,"num_read_kb":10184,"num_write":593,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.c","version":"131'316","reported_seq":1244,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.497981+0000","last_change":"2024-09-11T05:23:41.498168+0000","last_active":"2024-09-11T05:23:41.497981+0000","last_peered":"2024-09-11T05:23:41.497981+0000","last_clean":"2024-09-11T05:23:41.497981+0000","last_became_active":"2024-09-11T05:21:42.410098+0000","last_became_peered":"2024-09-11T05:21:42.410098+0000","last_unstale":"2024-09-11T05:23:41.497981+0000","last_undegraded":"2024-09-11T05:23:41.497981+0000","last_fullsized":"2024-09-11T05:23:41.497981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:14:21.038200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070761200000000004,"stat_sum":{"num_bytes":11434750,"num_objects":46,"num_object_clones":7,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":33,"num_read":783,"num_read_kb":10739,"num_write":319,"num_write_kb":8792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.d","version":"131'705","reported_seq":4503,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.545637+0000","last_change":"2024-09-11T05:23:41.545862+0000","last_active":"2024-09-11T05:23:41.545637+0000","last_peered":"2024-09-11T05:23:41.545637+0000","last_clean":"2024-09-11T05:23:41.545637+0000","last_became_active":"2024-09-11T05:23:11.600054+0000","last_became_peered":"2024-09-11T05:23:11.600054+0000","last_unstale":"2024-09-11T05:23:41.545637+0000","last_undegraded":"2024-09-11T05:23:41.545637+0000","last_fullsized":"2024-09-11T05:23:41.545637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:33.201649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082672500000000005,"stat_sum":{"num_bytes":41764133,"num_objects":74,"num_object_clones":7,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":43,"num_read":6434,"num_read_kb":38622,"num_write":831,"num_write_kb":8476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":223,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.e","version":"132'454","reported_seq":4178,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.605866+0000","last_change":"2024-09-11T05:23:41.546131+0000","last_active":"2024-09-11T05:23:41.605866+0000","last_peered":"2024-09-11T05:23:41.605866+0000","last_clean":"2024-09-11T05:23:41.605866+0000","last_became_active":"2024-09-11T05:23:28.420566+0000","last_became_peered":"2024-09-11T05:23:28.420566+0000","last_unstale":"2024-09-11T05:23:41.605866+0000","last_undegraded":"2024-09-11T05:23:41.605866+0000","last_fullsized":"2024-09-11T05:23:41.605866+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:12:48.766887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001014963,"stat_sum":{"num_bytes":18912491,"num_objects":60,"num_object_clones":9,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":36,"num_read":3559,"num_read_kb":10189,"num_write":491,"num_write_kb":7795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":522,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.f","version":"132'748","reported_seq":4295,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.546179+0000","last_change":"2024-09-11T05:23:41.546179+0000","last_active":"2024-09-11T05:23:41.546179+0000","last_peered":"2024-09-11T05:23:41.546179+0000","last_clean":"2024-09-11T05:23:41.546179+0000","last_became_active":"2024-09-11T05:23:29.422139+0000","last_became_peered":"2024-09-11T05:23:29.422139+0000","last_unstale":"2024-09-11T05:23:41.546179+0000","last_undegraded":"2024-09-11T05:23:41.546179+0000","last_fullsized":"2024-09-11T05:23:41.546179+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:22:22.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096026300000000005,"stat_sum":{"num_bytes":15947409,"num_objects":68,"num_object_clones":5,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":46,"num_read":5699,"num_read_kb":19750,"num_write":919,"num_write_kb":3569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":595,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.10","version":"132'610","reported_seq":2171,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.587190+0000","last_change":"2024-09-11T05:23:41.490476+0000","last_active":"2024-09-11T05:23:41.587190+0000","last_peered":"2024-09-11T05:23:41.587190+0000","last_clean":"2024-09-11T05:23:41.587190+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:23:41.587190+0000","last_undegraded":"2024-09-11T05:23:41.587190+0000","last_fullsized":"2024-09-11T05:23:41.587190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:12.170830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034712600000000001,"stat_sum":{"num_bytes":7371248,"num_objects":68,"num_object_clones":6,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":48,"num_read":3174,"num_read_kb":9806,"num_write":769,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.11","version":"132'395","reported_seq":3435,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.545514+0000","last_change":"2024-09-11T05:23:41.545514+0000","last_active":"2024-09-11T05:23:41.545514+0000","last_peered":"2024-09-11T05:23:41.545514+0000","last_clean":"2024-09-11T05:23:41.545514+0000","last_became_active":"2024-09-11T05:23:28.422654+0000","last_became_peered":"2024-09-11T05:23:28.422654+0000","last_unstale":"2024-09-11T05:23:41.545514+0000","last_undegraded":"2024-09-11T05:23:41.545514+0000","last_fullsized":"2024-09-11T05:23:41.545514+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:03.476560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052879200000000004,"stat_sum":{"num_bytes":16862515,"num_objects":51,"num_object_clones":6,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":36,"num_read":3101,"num_read_kb":8231,"num_write":347,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":497,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.12","version":"132'529","reported_seq":7161,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.545536+0000","last_change":"2024-09-11T05:23:41.545536+0000","last_active":"2024-09-11T05:23:41.545536+0000","last_peered":"2024-09-11T05:23:41.545536+0000","last_clean":"2024-09-11T05:23:41.545536+0000","last_became_active":"2024-09-11T05:23:19.419941+0000","last_became_peered":"2024-09-11T05:23:19.419941+0000","last_unstale":"2024-09-11T05:23:41.545536+0000","last_undegraded":"2024-09-11T05:23:41.545536+0000","last_fullsized":"2024-09-11T05:23:41.545536+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:29.927343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000540392,"stat_sum":{"num_bytes":33688920,"num_objects":77,"num_object_clones":18,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":45,"num_read":7682,"num_read_kb":29266,"num_write":554,"num_write_kb":13721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]},{"pgid":"3.13","version":"132'749","reported_seq":3643,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:23:41.566649+0000","last_change":"2024-09-11T05:23:41.546425+0000","last_active":"2024-09-11T05:23:41.566649+0000","last_peered":"2024-09-11T05:23:41.566649+0000","last_clean":"2024-09-11T05:23:41.566649+0000","last_became_active":"2024-09-11T05:23:29.424652+0000","last_became_peered":"2024-09-11T05:23:29.424652+0000","last_unstale":"2024-09-11T05:23:41.566649+0000","last_undegraded":"2024-09-11T05:23:41.566649+0000","last_fullsized":"2024-09-11T05:23:41.566649+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:22.652005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011457049999999999,"stat_sum":{"num_bytes":25680743,"num_objects":68,"num_object_clones":9,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":49,"num_read":4920,"num_read_kb":19852,"num_write":1015,"num_write_kb":7641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"22","length":"a"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":752904526,"num_objects":2132,"num_object_clones":241,"num_object_copies":4264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2132,"num_whiteouts":1340,"num_read":184615,"num_read_kb":671258,"num_write":20023,"num_write_kb":308348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7001,"num_bytes_recovered":204886700,"num_keys_recovered":1059,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260149248,"data_stored":318784189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},"log_size":17793,"ondisk_log_size":17793,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90232,"kb_used_data":36812,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94281608,"statfs":{"total":96636764160,"available":96544366592,"internally_reserved":0,"allocated":37695488,"data_stored":40425001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76652,"kb_used_data":27412,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94295188,"statfs":{"total":96636764160,"available":96558272512,"internally_reserved":0,"allocated":28069888,"data_stored":34709810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83872,"kb_used_data":34628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94287968,"statfs":{"total":96636764160,"available":96550879232,"internally_reserved":0,"allocated":35459072,"data_stored":44636468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":55834574878,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85180,"kb_used_data":34800,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94286660,"statfs":{"total":96636764160,"available":96549539840,"internally_reserved":0,"allocated":35635200,"data_stored":42360993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154762,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52272,"kb_used_data":19804,"kb_used_omap":11,"kb_used_meta":32436,"kb_avail":94319568,"statfs":{"total":96636764160,"available":96583237632,"internally_reserved":0,"allocated":20279296,"data_stored":24690110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":33215286},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79724,"kb_used_data":26320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94292116,"statfs":{"total":96636764160,"available":96555126784,"internally_reserved":0,"allocated":26951680,"data_stored":35297195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101740,"kb_used_data":43036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94270100,"statfs":{"total":96636764160,"available":96532582400,"internally_reserved":0,"allocated":44068864,"data_stored":53100737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41213952,"data_stored":51102011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25366528,"data_stored":34539108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18325504,"data_stored":23572493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33083392,"data_stored":40640492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46469120,"data_stored":52187601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33873920,"data_stored":43878381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26349568,"data_stored":33833402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35467264,"data_stored":39030701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:23:44.244 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T05:23:44.244 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:44.244 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T05:23:44.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:23:44.250 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:44.250 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:44.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:44.260 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:44.301 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:44.301+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:44.376 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:44.375+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:44.405 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:44.405 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:44.408 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:44.409 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:44.414 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:44.426 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:44.442 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:44.458 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:44.458 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:44.475 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:44.475 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:44.491 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:44.498 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:44.498+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:44.508 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:23:44.529 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:44.529 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:44.566 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:44.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:145909 3.d 3:b5fd6671:::rbd_header.117960ca2f2d:head [call lock.unlock in=52b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e135)", 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:44.565991+0000", 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00055041699999999999, 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00056636100000000003, 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 145909 2024-09-11T05:23:44.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.565991+0000", 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.565991+0000", 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.565992+0000", 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0200000000000001e-07 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.565996+0000", 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1080000000000003e-06 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.566006+0000", 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6730000000000004e-06 2024-09-11T05:23:44.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.566011+0000", 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2190000000000003e-06 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.566051+0000", 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0028999999999999e-05 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.566101+0000", 2024-09-11T05:23:44.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9728999999999998e-05 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:44.566199+0000", 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8652000000000003e-05 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 1 2024-09-11T05:23:44.571 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:44.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:44.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:44.586+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:44.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:23:44.587 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 135, 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "5fd14db5-8ee9-4e34-bd57-a8040293ab17", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2024-09-11T05:21:12.602514+0000", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2024-09-11T05:23:44.510710+0000", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2024-09-11T05:22:56.527907+0000", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2024-09-11T05:23:24.657382+0000", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5806080, 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "nodeep-scrub", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "noscrub", 2024-09-11T05:23:44.588 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 3, 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:23:44.589 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "luminous", 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "squid", 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_crimson": false, 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": ".mgr", 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:27.582783+0000", 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:23:44.590 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:23:44.591 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "17", 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:23:44.592 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:23:44.593 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:23:44.594 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_max": 32, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.595 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": {} 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 8, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 8, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.25, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 2, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 2, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:23:44.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:31.353652+0000", 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:23:44.597 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:23:44.598 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "21", 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 2, 2024-09-11T05:23:44.599 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 21, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:23:44.600 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:23:44.601 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 1.9900000095367432, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 1.9900000095367432, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:23:44.602 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 1.75, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 1.75, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "pool_client.0", 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:41.109530+0000", 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:23:44.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 32, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 32, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 32, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 32, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 32, 2024-09-11T05:23:44.604 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "135", 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:23:44.605 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 50, 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 135, 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:23:44.606 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:23:44.607 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:23:44.608 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 1.9900000095367432, 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 1.9900000095367432, 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 1.75, 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 1.75, 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2024-09-11T05:23:44.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e628e137-3e68-4084-a084-200022b8da35", 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 0.59844970703125, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 119, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.610 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2024-09-11T05:23:44.611 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2024-09-11T05:23:44.612 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.613 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/2997410357", 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/2997410357", 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/2997410357", 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/2997410357", 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "26db6fe3-81d0-40ae-a4e1-9a7460fabc2c", 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 118, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.616 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.619 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2024-09-11T05:23:44.620 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/852655937", 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/852655937", 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/852655937", 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/852655937", 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "00ff2990-a7cb-48a2-ab03-6739942d65d7", 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 13, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 70, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 87, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 118, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 71, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.622 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.624 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.625 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/2878270387", 2024-09-11T05:23:44.626 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/2878270387", 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/2878270387", 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/2878270387", 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "d1c858fd-7b66-4e1b-aa18-e3fd567e1417", 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:44.627 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 100, 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-09-11T05:23:44.628 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.629 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.630 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:23:44.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/2211289880", 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/2211289880", 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/2211289880", 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/2211289880", 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.633 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "586534a4-d5e3-4af4-a2e5-aa4ec052b582", 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 0, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 0, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 107, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.634 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6800", 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6801", 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.635 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6802", 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6803", 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.636 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6806", 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6807", 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6804", 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6805", 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6801/1639325236", 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6803/1639325236", 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6807/1639325236", 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6805/1639325236", 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "801041dc-7a4c-4776-bfbb-68be37655407", 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.639 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 119, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6816", 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6817", 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.641 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6818", 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6819", 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.642 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6822", 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6823", 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6820", 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6821", 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.644 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6817/2370940838", 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6819/2370940838", 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6823/2370940838", 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6821/2370940838", 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e0820ac1-b43f-486f-9d7b-155b46b33950", 2024-09-11T05:23:44.645 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 118, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6826", 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6827", 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6828", 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6829", 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6832", 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6833", 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6830", 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6831", 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6827/1798055911", 2024-09-11T05:23:44.650 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6829/1798055911", 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6833/1798055911", 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6831/1798055911", 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e22fdfda-9a13-42f2-be4f-f7c6e0ffd324", 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:23:44.651 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 119, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6808", 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6809", 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6810", 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6811", 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6814", 2024-09-11T05:23:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6815", 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6812", 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6813", 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6809/1122624549", 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6811/1122624549", 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6815/1122624549", 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6813/1122624549", 2024-09-11T05:23:44.656 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:44.657 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.912439+0000", 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.788769+0000", 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:23:44.658 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.857319+0000", 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 71 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:44.659 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.926699+0000", 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 65536, 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.752975+0000", 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.660 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.222079+0000", 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.661 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.095040+0000", 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.860946+0000", 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:23:44.662 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [ 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "pgid": "2.5", 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: 3, 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: 6 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_primaries": [], 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2024-09-11T05:23:44.663 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklist": {}, 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "range_blocklist": {}, 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [ 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:23:44.664 INFO:teuthology.orchestra.run.smithi012.stdout: "snaps": [ 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: "begin": 31, 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: "length": 10 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [ 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: "snaps": [ 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:44.665 INFO:teuthology.orchestra.run.smithi012.stdout: "begin": 31, 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "length": 1 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {}, 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode": { 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_enabled": false, 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_bucket_count": 0, 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:23:44.666 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_bucket": 0 2024-09-11T05:23:44.667 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:44.667 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:44.668 INFO:tasks.thrashosds.thrasher:j is {'epoch': 135, 'fsid': '5fd14db5-8ee9-4e34-bd57-a8040293ab17', 'created': '2024-09-11T05:21:12.602514+0000', 'modified': '2024-09-11T05:23:44.510710+0000', 'last_up_change': '2024-09-11T05:22:56.527907+0000', 'last_in_change': '2024-09-11T05:23:24.657382+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:21:27.582783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:21:31.353652+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:21:41.109530+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 50, 'snap_epoch': 135, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}], 'osds': [{'osd': 0, 'uuid': 'e628e137-3e68-4084-a084-200022b8da35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.59844970703125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6808', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6809', 'nonce': 2997410357}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6810', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6811', 'nonce': 2997410357}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6814', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6815', 'nonce': 2997410357}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6812', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6813', 'nonce': 2997410357}]}, 'public_addr': '172.21.15.12:6809/2997410357', 'cluster_addr': '172.21.15.12:6811/2997410357', 'heartbeat_back_addr': '172.21.15.12:6815/2997410357', 'heartbeat_front_addr': '172.21.15.12:6813/2997410357', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '26db6fe3-81d0-40ae-a4e1-9a7460fabc2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6816', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6817', 'nonce': 852655937}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6818', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6819', 'nonce': 852655937}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6822', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6823', 'nonce': 852655937}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6820', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6821', 'nonce': 852655937}]}, 'public_addr': '172.21.15.12:6817/852655937', 'cluster_addr': '172.21.15.12:6819/852655937', 'heartbeat_back_addr': '172.21.15.12:6823/852655937', 'heartbeat_front_addr': '172.21.15.12:6821/852655937', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '00ff2990-a7cb-48a2-ab03-6739942d65d7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 70, 'up_from': 87, 'up_thru': 118, 'down_at': 71, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6824', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6825', 'nonce': 2878270387}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6826', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6827', 'nonce': 2878270387}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6830', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6831', 'nonce': 2878270387}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6828', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 2878270387}]}, 'public_addr': '172.21.15.12:6825/2878270387', 'cluster_addr': '172.21.15.12:6827/2878270387', 'heartbeat_back_addr': '172.21.15.12:6831/2878270387', 'heartbeat_front_addr': '172.21.15.12:6829/2878270387', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'd1c858fd-7b66-4e1b-aa18-e3fd567e1417', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6800', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6801', 'nonce': 2211289880}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6802', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6803', 'nonce': 2211289880}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6806', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6807', 'nonce': 2211289880}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6804', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6805', 'nonce': 2211289880}]}, 'public_addr': '172.21.15.12:6801/2211289880', 'cluster_addr': '172.21.15.12:6803/2211289880', 'heartbeat_back_addr': '172.21.15.12:6807/2211289880', 'heartbeat_front_addr': '172.21.15.12:6805/2211289880', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '586534a4-d5e3-4af4-a2e5-aa4ec052b582', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 1639325236}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 1639325236}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 1639325236}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 1639325236}]}, 'public_addr': '172.21.15.153:6801/1639325236', 'cluster_addr': '172.21.15.153:6803/1639325236', 'heartbeat_back_addr': '172.21.15.153:6807/1639325236', 'heartbeat_front_addr': '172.21.15.153:6805/1639325236', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '801041dc-7a4c-4776-bfbb-68be37655407', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6816', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6817', 'nonce': 2370940838}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6818', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6819', 'nonce': 2370940838}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6822', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6823', 'nonce': 2370940838}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6820', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6821', 'nonce': 2370940838}]}, 'public_addr': '172.21.15.153:6817/2370940838', 'cluster_addr': '172.21.15.153:6819/2370940838', 'heartbeat_back_addr': '172.21.15.153:6823/2370940838', 'heartbeat_front_addr': '172.21.15.153:6821/2370940838', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e0820ac1-b43f-486f-9d7b-155b46b33950', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6826', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6827', 'nonce': 1798055911}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6828', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6829', 'nonce': 1798055911}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 1798055911}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6830', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6831', 'nonce': 1798055911}]}, 'public_addr': '172.21.15.153:6827/1798055911', 'cluster_addr': '172.21.15.153:6829/1798055911', 'heartbeat_back_addr': '172.21.15.153:6833/1798055911', 'heartbeat_front_addr': '172.21.15.153:6831/1798055911', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e22fdfda-9a13-42f2-be4f-f7c6e0ffd324', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6808', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6809', 'nonce': 1122624549}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6810', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6811', 'nonce': 1122624549}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6814', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6815', 'nonce': 1122624549}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6812', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6813', 'nonce': 1122624549}]}, 'public_addr': '172.21.15.153:6809/1122624549', 'cluster_addr': '172.21.15.153:6811/1122624549', 'heartbeat_back_addr': '172.21.15.153:6815/1122624549', 'heartbeat_front_addr': '172.21.15.153:6813/1122624549', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.912439+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.788769+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.857319+0000', 'dead_epoch': 71}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.926699+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.752975+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.222079+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.095040+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.860946+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.5', 'osds': [3, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 10}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:23:44.669 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-11T05:23:44.709 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:44.709+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:44.770 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:44.770 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:44.770 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:44.771 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:44.771 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:44.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:44.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:44.779+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:44.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:44.880+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:44.883 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:44.883 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:44.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:44.883 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:44.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.235780983000001, 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:23:44.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:23:44.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:44.889 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.321122372000001, 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:44.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:44.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.224738998999999, 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.895 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:44.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.899 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.224583503000002, 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.900 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:44.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:23:44.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.221777023000001, 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.906 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:44.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:23:44.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.221751658999999, 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.912 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:44.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:44.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.221729631999999, 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.917 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:44.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:23:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.219248282999999, 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:23:44.922 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:23:44.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.219221884, 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:44.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:23:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.219186695000001, 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.933 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:44.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:44.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:44.938 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.219164895999999, 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:23:44.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.219143567, 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:44.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:23:44.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.219122848000001, 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:44.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:44.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.214859004000001, 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.954 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:44.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:23:44.959 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.214813313000001, 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.960 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:44.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.965 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.214773375, 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.21457097, 2024-09-11T05:23:44.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:44.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.976 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.214548099999998, 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.977 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:23:44.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.214528465000001, 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:44.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.987 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.207636018999999, 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:44.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:44.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:44.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:44.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:23:44.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:23:44.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.993 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:44.993 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:44.993 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:44.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:44.995 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:44.994+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:45.095 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:45.095+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:45.107 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:45.108 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:45.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:45.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:45.196+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:45.224 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:45.225 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:45.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:45.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:45.318+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 48.841810877999997, 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.190981508, 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.533355622000002, 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.533330552000002, 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.53330244, 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.533276172999997, 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.533244541999998, 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.533220084, 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.533193611000002, 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348834977999999, 2024-09-11T05:23:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:23:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348814828000002, 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348794808999997, 2024-09-11T05:23:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:23:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348775058000001, 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348755678000003, 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:23:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348737630999999, 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348719443, 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348700479000001, 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348680199999997, 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:23:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348643412999998, 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.348608241000001, 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:23:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.475 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:45.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:45.476+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:45.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:45.577 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:45.577+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:45.641 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:45.641 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:45.650 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:45.679 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:45.678+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:45.757 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:45.757 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:45.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:45.779 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:45.779+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:45.874 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.02208941, 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.018739725000003, 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:23:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.017042764999999, 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:23:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.016467284999997, 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:23:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 41.014012833000002, 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:23:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130262 3.1f 3.a5f18dbf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.772619298999999, 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061307469000000003, 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130262 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.32e-07 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100844+0000", 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100850+0000", 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6380000000000001e-06 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100854+0000", 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162141+0000", 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061286555999999999 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162150+0000", 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5029999999999997e-06 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130325 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770904879, 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060079722000000002, 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130325 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102557+0000", 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102559+0000", 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102566+0000", 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102570+0000", 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162174+0000", 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.059604048999999999 2024-09-11T05:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162636+0000", 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00046200400000000002 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130326 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770885489999998, 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060097697999999998, 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130326 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102578+0000", 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9659999999999999e-06 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102584+0000", 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.772e-06 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102589+0000", 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:23:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162665+0000", 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060076606999999997 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162674+0000", 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4319999999999999e-06 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130327 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770866124000001, 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060123397000000002, 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130327 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102596+0000", 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102597+0000", 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.827e-06 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102603+0000", 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102607+0000", 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2679999999999996e-06 2024-09-11T05:23:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162696+0000", 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060088849999999999 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162719+0000", 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2285000000000001e-05 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130328 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770847461000002, 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060139489999999997, 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130328 2024-09-11T05:23:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102617+0000", 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102624+0000", 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102629+0000", 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162745+0000", 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060116145000000003 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162753+0000", 2024-09-11T05:23:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130329 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770826034999999, 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060160739999999997, 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130329 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102636+0000", 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102642+0000", 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6989999999999997e-06 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102650+0000", 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3490000000000003e-06 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102655+0000", 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162787+0000", 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060131974999999997 2024-09-11T05:23:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162796+0000", 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6729999999999998e-06 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130330 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770799175999997, 2024-09-11T05:23:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060169009000000002, 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130330 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102663+0000", 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102665+0000", 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.125e-06 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102671+0000", 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102675+0000", 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162823+0000", 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060147618 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162831+0000", 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130331 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770768756000002, 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060170659000000001, 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130331 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102695+0000", 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102702+0000", 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102706+0000", 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7979999999999996e-06 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162855+0000", 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060148733000000003 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162863+0000", 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:23:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130332 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770749101, 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060183778, 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130332 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102713+0000", 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102715+0000", 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9530000000000002e-06 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102720+0000", 2024-09-11T05:23:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102726+0000", 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162887+0000", 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060161144999999999 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162896+0000", 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0750000000000004e-06 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130333 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770729473999999, 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060197321999999998, 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130333 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102734+0000", 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9309999999999998e-06 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102740+0000", 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102744+0000", 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5079999999999999e-06 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162921+0000", 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060176306999999998 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162929+0000", 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6270000000000006e-06 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130334 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770711644000002, 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060210554999999999, 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130334 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102752+0000", 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102758+0000", 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102762+0000", 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162952+0000", 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060190180000000003 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162960+0000", 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1159999999999999e-06 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130335 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770694266, 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224879000000002, 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130335 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102769+0000", 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0549999999999998e-06 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102775+0000", 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102779+0000", 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162984+0000", 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060204437999999999 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162992+0000", 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1669999999999999e-06 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130336 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770676791, 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060247271999999998, 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130336 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.84e-07 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102787+0000", 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9120000000000001e-06 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102792+0000", 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102797+0000", 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5000000000000001e-06 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163022+0000", 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224969000000003 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163032+0000", 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8649999999999996e-06 2024-09-11T05:23:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130337 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770659137000003, 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060276431999999998, 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130337 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102803+0000", 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102804+0000", 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102810+0000", 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102815+0000", 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4299999999999999e-06 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163067+0000", 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060252732000000003 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163079+0000", 2024-09-11T05:23:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1321000000000001e-05 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130338 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 36.770641691999998, 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060299902000000002, 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130338 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104763+0000", 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001943005 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104768+0000", 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104808+0000", 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9691000000000003e-05 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104815+0000", 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4549999999999998e-06 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163110+0000", 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.058294374000000003 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163120+0000", 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9359999999999994e-06 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:45.965 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:45.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:45.967 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:45.966+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:46.068 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:46.068+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:46.074 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:46.074 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:46.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:46.169 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:46.169+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:46.230 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:46.231 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:46.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:46.280 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:46.280+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:46.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:46.370+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:46.387 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.498585634999998, 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:23:46.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.392 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.498565136000003, 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:23:46.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.498542194000002, 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:23:46.398 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:23:46.402 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.498334034999999, 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:46.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.498191501000001, 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.408 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.498124599999997, 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:23:46.412 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:23:46.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.416 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497788264999997, 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:23:46.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.421 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497653272000001, 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:23:46.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497618330999998, 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:23:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:23:46.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:23:46.430 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497596661000003, 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:46.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:23:46.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497498606999997, 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497377612000001, 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.444 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497242045999997, 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:23:46.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.497033541, 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.449 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:46.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:23:46.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:46.453 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.496847146, 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:23:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.457 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.496746301000002, 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:46.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:23:46.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.496567104, 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:23:46.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:46.466 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.496296071000003, 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:23:46.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.470 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.496246212000003, 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:46.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:23:46.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.496092838000003, 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.475 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:46.476 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:23:46.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:23:46.478 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.479 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:46.479 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:46.479 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:46.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:46.481 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:46.479+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:46.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:23:46.545 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:46.581 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:46.581+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:46.642 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:46.643 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:46.643 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:46.643 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:46.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:46.682 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:46.682+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:46.700 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:46.700 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:46.718 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:46.718 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:46.736 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:46.753 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:46.753 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:46.770 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:46.771 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:46.783 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:46.783+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:46.788 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:46.805 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:46.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:46.822 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:46.823 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:46.884 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:46.884+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:46.929 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:46.929 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:46.938 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:46.986 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:46.986+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:47.043 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.044 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.053 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:47.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:47.086+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:47.156 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.156 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:47.187 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:47.187+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:47.268 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.268 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:47.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:47.288+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:47.380 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.380 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:47.389 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:47.388+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:47.418 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:23:47.489 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:47.489+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:47.541 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.542 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.550 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:47.591 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:47.591+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:47.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:47.691+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:47.695 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.695 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:47.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:47.791+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:47.808 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.809 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:47.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:47.892+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:47.922 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:47.922 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:47.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:47.993 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:47.993+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:48.033 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:48.034 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:48.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:48.094 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:48.093+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:48.145 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:48.145 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:48.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:48.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:48.194+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:48.295 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:48.295+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:48.297 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:48.297 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:48.306 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:48.396 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:48.396+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:48.450 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:48.450 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:48.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:48.503 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:48.503+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:48.585 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:48.585 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:48.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:48.598 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:48.597+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:48.699 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:48.699+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:48.747 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:48.747 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:48.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:48.800 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:48.800+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:48.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:48.866 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:48.866 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:48.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:48.901 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:48.901+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:48.977 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:48.994 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:48.995 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:49.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:49.002+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:49.011 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:49.028 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:49.028 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:49.037 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:49.037 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:49.037 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:49.037 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:49.045 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:49.046 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:49.062 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:49.079 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:49.079 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:49.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:49.097 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:49.103 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:49.103+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:49.170 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:49.170 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:49.170 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:49.170 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:49.170 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:49.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:49.205 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:49.204+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:49.287 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 44.435179185000003, 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:49.288 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:23:49.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:23:49.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 44.431829499999999, 2024-09-11T05:23:49.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:23:49.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:49.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:49.300 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 44.430132540000002, 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:23:49.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:23:49.304 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 44.42955706, 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:23:49.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:23:49.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 44.427102607999998, 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:23:49.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130262 3.1f 3.a5f18dbf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.185709074000002, 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061307469000000003, 2024-09-11T05:23:49.315 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130262 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.32e-07 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100844+0000", 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100850+0000", 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6380000000000001e-06 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100854+0000", 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.318 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162141+0000", 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061286555999999999 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162150+0000", 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5029999999999997e-06 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130325 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:49.319 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183994654000003, 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060079722000000002, 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130325 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102557+0000", 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102559+0000", 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102566+0000", 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102570+0000", 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:49.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162174+0000", 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.059604048999999999 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162636+0000", 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00046200400000000002 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130326 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183975265000001, 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060097697999999998, 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130326 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.324 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:49.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102578+0000", 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9659999999999999e-06 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102584+0000", 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.772e-06 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102589+0000", 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162665+0000", 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060076606999999997 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162674+0000", 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4319999999999999e-06 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130327 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183955898999997, 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060123397000000002, 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130327 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102596+0000", 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102597+0000", 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.827e-06 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102603+0000", 2024-09-11T05:23:49.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102607+0000", 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2679999999999996e-06 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162696+0000", 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060088849999999999 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162719+0000", 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2285000000000001e-05 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.332 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130328 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183937235999998, 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060139489999999997, 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130328 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:49.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102617+0000", 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102624+0000", 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102629+0000", 2024-09-11T05:23:49.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162745+0000", 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060116145000000003 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162753+0000", 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130329 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183915810000002, 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060160739999999997, 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130329 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102636+0000", 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102642+0000", 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6989999999999997e-06 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102650+0000", 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3490000000000003e-06 2024-09-11T05:23:49.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102655+0000", 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162787+0000", 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060131974999999997 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162796+0000", 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6729999999999998e-06 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130330 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183888951, 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060169009000000002, 2024-09-11T05:23:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130330 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102663+0000", 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102665+0000", 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.125e-06 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102671+0000", 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102675+0000", 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162823+0000", 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060147618 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162831+0000", 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130331 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183858530999998, 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060170659000000001, 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130331 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.346 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.347 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102695+0000", 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102702+0000", 2024-09-11T05:23:49.348 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102706+0000", 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7979999999999996e-06 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162855+0000", 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060148733000000003 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.349 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162863+0000", 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130332 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183838876000003, 2024-09-11T05:23:49.350 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060183778, 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130332 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:49.351 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102713+0000", 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102715+0000", 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9530000000000002e-06 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102720+0000", 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102726+0000", 2024-09-11T05:23:49.353 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162887+0000", 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060161144999999999 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162896+0000", 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0750000000000004e-06 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130333 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183819249000003, 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060197321999999998, 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130333 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.355 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.356 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102734+0000", 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9309999999999998e-06 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102740+0000", 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:23:49.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102744+0000", 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5079999999999999e-06 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162921+0000", 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060176306999999998 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.358 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162929+0000", 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6270000000000006e-06 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130334 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183801418999998, 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060210554999999999, 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.359 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130334 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102752+0000", 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.361 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102758+0000", 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102762+0000", 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162952+0000", 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060190180000000003 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.362 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162960+0000", 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1159999999999999e-06 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130335 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183784041000003, 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224879000000002, 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.363 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130335 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102769+0000", 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0549999999999998e-06 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.365 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102775+0000", 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102779+0000", 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162984+0000", 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060204437999999999 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.366 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162992+0000", 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1669999999999999e-06 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130336 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183766566000003, 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060247271999999998, 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.367 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130336 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.84e-07 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102787+0000", 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9120000000000001e-06 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.369 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102792+0000", 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102797+0000", 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5000000000000001e-06 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163022+0000", 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224969000000003 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.370 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163032+0000", 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8649999999999996e-06 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130337 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183748911999999, 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060276431999999998, 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.371 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130337 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.372 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102803+0000", 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102804+0000", 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.373 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102810+0000", 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102815+0000", 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4299999999999999e-06 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163067+0000", 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060252732000000003 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163079+0000", 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1321000000000001e-05 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130338 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 40.183731467000001, 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060299902000000002, 2024-09-11T05:23:49.375 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130338 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104763+0000", 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001943005 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104768+0000", 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104808+0000", 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9691000000000003e-05 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.378 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104815+0000", 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4549999999999998e-06 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163110+0000", 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.058294374000000003 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163120+0000", 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9359999999999994e-06 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.379 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.380 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.380 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:49.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:49.382 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:49.381+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:49.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:23:49.509 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:49.509+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:49.531 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:49.532 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:49.532 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:49.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:49.584 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:49.584+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:49.669 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:49.669 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:49.669 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-11T05:23:49.670 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T05:23:49.670 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T05:23:49.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-11T05:23:49.684 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:49.684+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:49.710 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:49.712 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:49.712 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:49.712 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:49.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T05:23:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:49.803 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:49.803+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:49.868 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:49.868 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:49.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:49.868 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:49.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.868 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.978825667000002, 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:23:49.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.871 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.978805168000001, 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.873 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:23:49.876 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.978782226, 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.878 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:49.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.880 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.882 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.978574066999997, 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.883 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:23:49.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:23:49.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.978431532999998, 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:23:49.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.890 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.892 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.978364632000002, 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:23:49.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.978028297000002, 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.900 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.901 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977893303999998, 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:23:49.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977858363000003, 2024-09-11T05:23:49.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:23:49.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977836693, 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:23:49.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:23:49.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:49.915 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977738639000002, 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:23:49.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:23:49.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:23:49.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:23:49.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:23:49.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.921 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977617643999999, 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:49.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:23:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977482078000001, 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:23:49.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:49.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:49.930 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977273572999998, 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:49.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.934 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.977087177999998, 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.936 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.938 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.976986332999999, 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:23:49.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.976807135999998, 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:23:49.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.946 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.976536103000001, 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:23:49.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:23:49.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.976486244, 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:23:49.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.97633287, 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:49.955 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:23:49.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:49.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:49.959 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:49.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:49.961 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:49.960+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:50.062 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:50.061+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:50.109 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:50.109 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:50.118 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:50.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:50.162+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:50.225 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:50.225 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:50.225 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:50.226 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:50.226 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:50.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:50.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:50.275+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:50.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:50.365+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:50.383 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:50.383 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:50.383 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:50.383 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:50.383 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.383 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.638518116, 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.384 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:23:50.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.386 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.387 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.638506228, 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.389 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.638469008, 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.638454227, 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:23:50.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.401 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.638442891, 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:23:50.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:23:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.63729209, 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.410 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.637277635, 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:23:50.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.637267155, 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.415 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:23:50.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.418 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:50.419 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.63725668799999, 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:50.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:23:50.423 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.637238328, 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.424 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:23:50.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.63452925599999, 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.430 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.432 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.434 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.63450625599999, 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.438 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.63448489300001, 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:23:50.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:23:50.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.63446337400001, 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:23:50.443 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:23:50.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.447 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.634442447, 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:23:50.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.63259871, 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:23:50.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:23:50.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.632588337, 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:23:50.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.460 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.632573308, 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:23:50.463 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 111.6325633, 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:50.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.467 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 42.968295312000002, 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:50.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:23:50.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:23:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:23:50.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.475 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:50.475 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:50.475 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:50.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:50.477 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:50.476+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:23:50.577 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:50.577+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:50.595 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:50.595 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:50.595 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:50.604 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:50.678 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:50.678+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:50.748 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:50.748 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:50.748 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:50.749 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:50.757 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:50.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:50.779+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:50.862 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:50.862 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.228217822, 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.863 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:23:50.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:50.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.22607630100001, 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:23:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.226054737, 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.872 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.22604072599999, 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.877 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.224215425, 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:23:50.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.886 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:50.887 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.224200822, 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.888 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:50.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:23:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:23:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.893 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.224183517, 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.894 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:50.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:23:50.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:23:50.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.22415940800001, 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.224131332, 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:23:50.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:23:50.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:23:50.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:50.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.22410434, 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:50.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.224063781, 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:23:50.914 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.224040394, 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:23:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:23:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:23:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:23:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:23:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.128055287, 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:23:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:23:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.128035727, 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:23:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.128016512, 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:23:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:23:50.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:23:50.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.940 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.941 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:50.941 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:50.941 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.127995712, 2024-09-11T05:23:50.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:23:50.941 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.942 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.942 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.942 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.942 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.942 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.942 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:23:50.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.943 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:50.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:23:50.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:23:50.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:23:50.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.243895197000001, 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:23:50.948 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:23:50.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:23:50.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:23:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:23:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:23:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.240905389000005, 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:23:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:23:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.776308497000002, 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:50.965 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:23:50.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:23:50.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:23:50.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:50.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 84.241724609000002, 2024-09-11T05:23:50.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:23:50.973 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:50.973 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:50.973 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:50.973 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.012 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.013 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.013 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:23:51.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.013 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:51.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:51.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:23:51.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:23:51.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:23:51.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:23:51.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:23:51.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:23:51.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:23:51.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:23:51.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:23:51.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:23:51.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:51.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:23:51.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:23:51.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:23:51.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:23:51.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:51.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:23:51.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:23:51.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:23:51.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:23:51.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:51.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:23:51.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:23:51.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:23:51.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:23:51.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:23:51.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:23:51.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:23:51.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:23:51.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.027 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.028 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:51.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:51.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:51.030+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:51.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:51.131 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:51.130+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:51.146 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:51.232 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:51.231+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:51.245 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:51.246 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:51.263 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:51.279 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:51.279 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:51.295 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:51.296 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:51.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:51.312 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:51.312 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:51.333 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:51.333+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:51.434 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:51.434+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36136 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1677312~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.847452002, 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061404727999999999, 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.445 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36136 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596532+0000", 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596732+0000", 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020047199999999999 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596739+0000", 2024-09-11T05:23:51.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1500000000000002e-06 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596747+0000", 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6520000000000006e-06 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596751+0000", 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657759+0000", 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061007711999999999 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657831+0000", 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1440999999999996e-05 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657937+0000", 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105945 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36137 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1689600~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.847224506, 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061392633000000002, 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36137 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596759+0000", 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596954+0000", 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194184 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596962+0000", 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8610000000000004e-06 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596970+0000", 2024-09-11T05:23:51.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5800000000000003e-06 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.596974+0000", 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.657981+0000", 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061006577999999999 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658059+0000", 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8348000000000003e-05 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658152+0000", 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2752999999999998e-05 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36139 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1714176~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.846969692, 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061397765999999999, 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36139 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597014+0000", 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597181+0000", 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016726299999999999 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597185+0000", 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6389999999999998e-06 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597193+0000", 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597204+0000", 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1491000000000001e-05 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658298+0000", 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061093524000000003 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658340+0000", 2024-09-11T05:23:51.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2225999999999999e-05 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658412+0000", 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1760000000000004e-05 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36142 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1751040~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:51.459 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.84660079699999, 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483425000000001, 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36142 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597383+0000", 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597509+0000", 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012559499999999999 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597512+0000", 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597521+0000", 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3889999999999994e-06 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597535+0000", 2024-09-11T05:23:51.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3458999999999999e-05 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658739+0000", 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061204806 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658779+0000", 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9604999999999998e-05 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658866+0000", 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7372000000000003e-05 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36143 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1763328~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.84643925100001, 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061526233999999999, 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.464 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36143 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597545+0000", 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597930+0000", 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038563200000000001 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597934+0000", 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9419999999999997e-06 2024-09-11T05:23:51.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597947+0000", 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2680000000000001e-05 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597955+0000", 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7160000000000003e-06 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658897+0000", 2024-09-11T05:23:51.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060942569000000002 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.658953+0000", 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5717999999999997e-05 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659071+0000", 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117977 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36145 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1787904~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.845996516, 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061483703000000001, 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36145 2024-09-11T05:23:51.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.597987+0000", 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599925+0000", 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019375009999999999 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599929+0000", 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3749999999999996e-06 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599941+0000", 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.165e-05 2024-09-11T05:23:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.599948+0000", 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0079999999999996e-06 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659269+0000", 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059320732000000001 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659353+0000", 2024-09-11T05:23:51.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4418000000000004e-05 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.659471+0000", 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000118019 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36156 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 1927168~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:51.473 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.843849623, 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061478261999999999, 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36156 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:51.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.600134+0000", 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601925+0000", 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017909 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601929+0000", 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2309999999999998e-06 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601939+0000", 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7289999999999995e-06 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.601944+0000", 2024-09-11T05:23:51.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1449999999999999e-06 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661429+0000", 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059484565000000003 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661509+0000", 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0519999999999995e-05 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.661612+0000", 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010317199999999999 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36166 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2050048~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.841819071, 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061500239999999998, 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.478 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36166 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602165+0000", 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.03e-07 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602167+0000", 2024-09-11T05:23:51.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0269999999999998e-06 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602173+0000", 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9320000000000001e-06 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602178+0000", 2024-09-11T05:23:51.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7360000000000001e-06 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663550+0000", 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061372400000000001 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663594+0000", 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4233999999999997e-05 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663665+0000", 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0507999999999996e-05 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36167 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2062336~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.841798686, 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061718026000000002, 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36167 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.602185+0000", 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603926+0000", 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017405389999999999 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603929+0000", 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:23:51.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603936+0000", 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.603940+0000", 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3209999999999998e-06 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663719+0000", 2024-09-11T05:23:51.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059779651000000003 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663801+0000", 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1510999999999999e-05 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.663903+0000", 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102193 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39009 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2962432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.624614881, 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061389193000000002, 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.488 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39009 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819369+0000", 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819371+0000", 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819377+0000", 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819383+0000", 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1160000000000004e-06 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880590+0000", 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061206826999999998 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880665+0000", 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5290000000000006e-05 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880758+0000", 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2675000000000003e-05 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39010 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2974720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.62459385699999, 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061514763, 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39010 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819390+0000", 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.84e-07 2024-09-11T05:23:51.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819392+0000", 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9989999999999998e-06 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819403+0000", 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0603e-05 2024-09-11T05:23:51.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819408+0000", 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880798+0000", 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061390440999999997 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880840+0000", 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2042999999999997e-05 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880905+0000", 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4245000000000006e-05 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39011 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2987008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:51.497 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.62456960199999, 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061705530000000001, 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39011 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.819414+0000", 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820924+0000", 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001509987 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820928+0000", 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8800000000000001e-06 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820938+0000", 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0077e-05 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.820945+0000", 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.880947+0000", 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060001890000000002 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881025+0000", 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7893999999999997e-05 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.881120+0000", 2024-09-11T05:23:51.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5185000000000004e-05 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39018 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3073024~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.62289051800001, 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061511071, 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.502 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39018 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821093+0000", 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821094+0000", 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821096+0000", 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.181e-06 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821102+0000", 2024-09-11T05:23:51.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2310000000000001e-06 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821107+0000", 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6349999999999997e-06 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882481+0000", 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061374300999999999 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882542+0000", 2024-09-11T05:23:51.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0767999999999998e-05 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882604+0000", 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2578999999999998e-05 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39019 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3085312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.622871172, 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061625955000000003, 2024-09-11T05:23:51.506 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39019 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821113+0000", 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.01e-07 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821115+0000", 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0169999999999999e-06 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821122+0000", 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2819999999999999e-06 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821127+0000", 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882634+0000", 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061507195000000001 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882680+0000", 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5513999999999998e-05 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882739+0000", 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8867999999999999e-05 2024-09-11T05:23:51.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39020 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3097600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.6228504, 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061720278000000003, 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39020 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821133+0000", 2024-09-11T05:23:51.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821134+0000", 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3000000000000001e-07 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821136+0000", 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821142+0000", 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0900000000000001e-06 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821147+0000", 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6909999999999996e-06 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882764+0000", 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061617153000000001 2024-09-11T05:23:51.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882803+0000", 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8770999999999999e-05 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882854+0000", 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0732999999999997e-05 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39021 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3109888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.62283099, 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061828568, 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39021 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821153+0000", 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821155+0000", 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821161+0000", 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821167+0000", 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5099999999999998e-06 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882879+0000", 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061711927 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882927+0000", 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8266000000000002e-05 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.882981+0000", 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4605000000000003e-05 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39022 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3122176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.62281052100001, 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061930898999999998, 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39022 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821173+0000", 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821174+0000", 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821176+0000", 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821182+0000", 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821186+0000", 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3669999999999999e-06 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883006+0000", 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061819842 2024-09-11T05:23:51.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883040+0000", 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4548999999999997e-05 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883104+0000", 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3769999999999994e-05 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39023 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 3134464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.622791631, 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062025696999999998, 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39023 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821192+0000", 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821193+0000", 2024-09-11T05:23:51.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821195+0000", 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821200+0000", 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.821205+0000", 2024-09-11T05:23:51.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883129+0000", 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061923709 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883167+0000", 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8167999999999998e-05 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.883218+0000", 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1088999999999998e-05 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39251 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2762752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.613453838, 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061427435000000002, 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39251 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830530+0000", 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3900000000000001e-07 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830531+0000", 2024-09-11T05:23:51.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-06 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830534+0000", 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830538+0000", 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3749999999999999e-06 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891799+0000", 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061260799999999997 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891866+0000", 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7593000000000001e-05 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.891957+0000", 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1204000000000003e-05 2024-09-11T05:23:51.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:39252 3.16 3:69e6be49:::rbd_data.1179c3639760.0000000000000000:9 [read 2775040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 112.613443012, 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061559748999999997, 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:51.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 39252 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.830541+0000", 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831925+0000", 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013846310000000001 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831930+0000", 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831939+0000", 2024-09-11T05:23:51.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6710000000000005e-06 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.831954+0000", 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4968e-05 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892004+0000", 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060050072000000003 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892042+0000", 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8714999999999998e-05 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.892101+0000", 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8281e-05 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:51.538 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:51.539 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:51.540 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:51.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:51.541 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:51.539+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:51.548 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:51.548 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:51.571 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:51.640 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:51.640+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:51.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:51.741 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:51.741+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:51.842 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:51.842+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:51.843 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:51.843 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:51.852 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:51.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:51.943+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:51.964 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:52.044 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:52.043+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:52.068 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.069 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.077 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:52.145 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:52.145+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:52.221 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.221 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:52.273 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:52.273+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:52.332 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.332 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:52.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:52.385+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:52.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:52.448+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:52.472 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.472 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:52.548 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:52.548+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:52.568 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:23:52.631 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.631 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:52.649 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:52.648+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:52.749 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:52.749+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:52.750 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.750 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:52.850 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:52.850+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:52.869 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.869 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:52.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:52.952+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:52.985 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:52.985 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:52.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:53.079 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:53.079+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:53.141 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:53.141 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:53.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:53.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:53.191+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:53.255 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:53.254+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:53.299 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:53.299 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:53.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:53.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:53.356+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:53.416 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:53.416 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:53.420 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:23:53.428 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:53.456 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:23:53.456+0000 7fc69a181640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33099) UID: 0 2024-09-11T05:23:53.557 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:53.557+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:53.584 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:53.591 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:53.591 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:53.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:53.658 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:53.658+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:53.711 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:53.711 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:53.730 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:53.730 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:53.747 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:53.748 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:53.754 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:53.754 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:53.759 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:53.759+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:53.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:53.764 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:53.765 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:53.783 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:53.784 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:53.800 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5: {} 2024-09-11T05:23:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:23:53.817 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:53.835 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:53.835 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:53.872 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:53.873 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:53.873 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:53.873 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:53.873 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:53.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:53.873+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:53.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:53.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:53.967+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.28605976999999, 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:23:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:23:54.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.035 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.28604788200001, 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.036 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:23:54.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.040 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.286010662, 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:23:54.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:23:54.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.28599588100001, 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.046 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:23:54.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.28598454500001, 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:23:54.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:23:54.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.284833744, 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.055 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:23:54.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.284819289, 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:23:54.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.284808809, 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.064 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:23:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.284798342, 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.072 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.284779982, 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:23:54.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:23:54.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:54.077 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:54.078 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.28207091, 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:54.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:23:54.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.28204791, 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:23:54.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:23:54.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.282026547, 2024-09-11T05:23:54.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:23:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.282005028, 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:23:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.28198410100001, 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.280140364, 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:23:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.280129991, 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.280114962, 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 115.280104954, 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:23:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.615836966000003, 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:23:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:23:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:23:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:23:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:54.124 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:54.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:54.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:54.126+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:54.226 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:54.227+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:54.231 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:54.232 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:54.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:54.328 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:54.327+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:54.343 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:54.344 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:54.344 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:54.344 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:54.344 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:54.352 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:54.436 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:54.436+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:54.506 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:54.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:54.507 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:54.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.507 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.507 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:54.507 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.87165843699999, 2024-09-11T05:23:54.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:23:54.508 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.509 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.509 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:23:54.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.509 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:54.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:54.514 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.86951691599999, 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:23:54.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:54.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:23:54.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.869495352, 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.520 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.869481341, 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:23:54.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:23:54.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:23:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.86765604, 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:23:54.530 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:23:54.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:23:54.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:23:54.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:23:54.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:23:54.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:23:54.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:54.536 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.867641437, 2024-09-11T05:23:54.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:23:54.537 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.537 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.537 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.537 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.537 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:54.542 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.867624132, 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.543 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:23:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.86760002299999, 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:23:54.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.867571947, 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:23:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:23:54.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.867544955, 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:23:54.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.867504396, 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:23:54.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:23:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.566 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.867481009, 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.771495902, 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:23:54.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:23:54.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.577 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.577 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:54.577 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.771476342, 2024-09-11T05:23:54.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:23:54.577 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.577 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.577 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:23:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.77145712700001, 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:23:54.582 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:23:54.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:23:54.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:23:54.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.587 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 115.771436327, 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.588 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:23:54.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:23:54.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.887335812000003, 2024-09-11T05:23:54.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:23:54.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:23:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:23:54.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:23:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:23:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:23:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:23:54.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.603 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.884346003999994, 2024-09-11T05:23:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:23:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:54.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:23:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:23:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:23:54.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:23:54.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 88.419749112000005, 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:23:54.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:23:54.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:54.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:54.621 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 87.885165224000005, 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:54.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:23:54.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:23:54.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:54.628 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:54.629 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:54.630 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:23:54.630 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:54.629+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:54.730 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:54.730+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:54.775 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:54.775 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:54.775 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:54.775 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:54.782 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:54.782 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:23:54.783 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 3, 4, 5, 6, 7, 2] 2024-09-11T05:23:54.783 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T05:23:54.783 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:23:54.784 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:23:54.833 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:54.832+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:54.834 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T05:23:54.834 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2024-09-11T05:23:54.834 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:23:54.834 DEBUG:teuthology.orchestra.run.smithi153:> type ceph-objectstore-tool 2024-09-11T05:23:54.879 INFO:teuthology.orchestra.run.smithi153.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-11T05:23:54.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T05:23:54.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:23:54.891 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T05:23:54.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2024-09-11T05:23:54.933 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:54.933+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:55.021 INFO:teuthology.orchestra.run.smithi153.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-11T05:23:55.024 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T05:23:55.024 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:55.068 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:55.067+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:55.127 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:55.127 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:55.127 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:23:55.127 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:55.135 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:55.135+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:55.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:55.236 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:55.235+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:55.280 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:55.281 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:55.281 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:55.281 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:55.281 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:55.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:55.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:55.337+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:55.436 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:23:55.437 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:55.437+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:55.440 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:55.440 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:55.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:55.440 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:55.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.440 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:23:55.441 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:55.441 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.792660521000002, 2024-09-11T05:23:55.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:23:55.441 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.441 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:23:55.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.449 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.878001910000002, 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:55.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.781618537, 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:55.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:55.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.781463041000002, 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:55.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.778656560999998, 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:55.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.778631197000003, 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.470 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:55.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.778609170000003, 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:55.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:55.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:23:55.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.776127821000003, 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.481 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:23:55.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.776101421999996, 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:23:55.486 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:55.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:23:55.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.776066233000002, 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.492 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:55.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:55.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.776044433999999, 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.497 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:55.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:23:55.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.776023105, 2024-09-11T05:23:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:23:55.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.776002386000002, 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.508 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:55.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.771738542000001, 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.513 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:55.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.518 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.771692850999997, 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:23:55.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.771652912999997, 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:55.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:55.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:23:55.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.771450508000001, 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.529 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:55.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.771427637999999, 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.534 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.771408002999998, 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:55.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.764515557000003, 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.545 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:55.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:55.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:55.550 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:55.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:55.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:55.551+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:55.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:55.652+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:55.661 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:55.661 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:55.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:55.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:55.754+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:55.819 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:55.819 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:55.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:55.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:23:55.854 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:55.853+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:55.955 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:55.955+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:55.980 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 59.440053847000001, 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.789224476999998, 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.131598590999999, 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.131573521, 2024-09-11T05:23:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.131545408999997, 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.131519142000002, 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.131487511000003, 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.131463052999997, 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 51.131436579999999, 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.947077946999997, 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:23:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.947057796999999, 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:23:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:23:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.947037778000002, 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:23:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:23:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:23:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.947018026999999, 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:23:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.946998647000001, 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:23:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.946980600000003, 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:23:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.946962411999998, 2024-09-11T05:23:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:23:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.946943447999999, 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:23:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:23:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.946923169000002, 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:23:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.946886382000002, 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:23:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:23:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 46.946851209999998, 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:23:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:23:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:56.074 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:56.076 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:56.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:56.077 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:56.077 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:56.078 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:56.078 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:56.079 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:56.079 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:23:56.079 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:56.075+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:56.079 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:56.079 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:56.094 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:56.098 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:23:56.098 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:23:56.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:56.176+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:56.188 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:56.188 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:56.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:56.278 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:56.277+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:56.343 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:56.343 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:56.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:56.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:56.397+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:56.431 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:23:56.469 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:56.469 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:56.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:56.480 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:56.479+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:56.580 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:56.579+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:56.627 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:56.627 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:56.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:56.680 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:56.680+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:56.689 INFO:teuthology.orchestra.run.smithi153.stdout:3.d 2024-09-11T05:23:56.689 INFO:teuthology.orchestra.run.smithi153.stdout:3.c 2024-09-11T05:23:56.689 INFO:teuthology.orchestra.run.smithi153.stdout:3.1f 2024-09-11T05:23:56.689 INFO:teuthology.orchestra.run.smithi153.stdout:3.1c 2024-09-11T05:23:56.689 INFO:teuthology.orchestra.run.smithi153.stdout:3.17 2024-09-11T05:23:56.689 INFO:teuthology.orchestra.run.smithi153.stdout:3.16 2024-09-11T05:23:56.689 INFO:teuthology.orchestra.run.smithi153.stdout:3.5 2024-09-11T05:23:56.690 INFO:teuthology.orchestra.run.smithi153.stdout:3.1d 2024-09-11T05:23:56.690 INFO:teuthology.orchestra.run.smithi153.stdout:2.3 2024-09-11T05:23:56.690 INFO:teuthology.orchestra.run.smithi153.stdout:3.2 2024-09-11T05:23:56.690 INFO:teuthology.orchestra.run.smithi153.stdout:2.2 2024-09-11T05:23:56.744 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:56.744 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:56.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:56.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:56.797+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:56.860 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:56.860 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:56.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:23:56.882 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:56.882+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:56.983 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:56.983+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:57.018 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.018 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:23:57.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:57.084+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:57.134 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.134 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.142 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:23:57.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:57.184+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:57.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op export --pgid 3.2 --file /var/log/ceph/exp.3.2.5 2024-09-11T05:23:57.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:57.285+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:57.290 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.291 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:23:57.386 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:57.386+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:57.406 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.406 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.415 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:23:57.487 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:57.486+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:23:57.587 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:57.587+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:57.640 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.640 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.648 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:23:57.689 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:57.689+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:57.789 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:23:57.789+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:23:57.792 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.792 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:23:57.890 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:57.889+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:57.906 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:57.906 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:57.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:23:58.000 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:58.000+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:58.065 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:58.065 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:58.073 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:23:58.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:58.092+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:58.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:23:58.193 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:58.193+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:58.217 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:23:58.218 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:23:58.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:23:58.237 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:23:58.237 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:23:58.254 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:23:58.254 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:23:58.270 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:23:58.270 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:23:58.286 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:23:58.287 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:23:58.294 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:23:58.294+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:23:58.304 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:23:58.304 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:23:58.305 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:23:58.322 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:23:58.322 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:23:58.339 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:23:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:23:58.343 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:23:58.344 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:23:58.371 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:23:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:23:58.371 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:23:58.371 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:58.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:23:58.424 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:58.424+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:58.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:23:58.490 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:23:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:23:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:23:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:23:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.490 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.842468490000002, 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:23:58.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:23:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:23:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:23:58.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.927809879000002, 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.497 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.831426506, 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:58.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:23:58.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:23:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:23:58.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:23:58.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.831271010000002, 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:23:58.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.828464529999998, 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.516 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:23:58.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:23:58.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.828439166000003, 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.522 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:58.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:23:58.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.527 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.828417139000003, 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:23:58.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:23:58.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.533 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.825935790000003, 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:23:58.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.825909391000003, 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.539 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:23:58.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.825874202000001, 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.545 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:23:58.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.550 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.825852402999999, 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:23:58.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.556 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.825831074, 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:23:58.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:23:58.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:23:58.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.825810355000002, 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.562 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:23:58.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.567 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.821546511000001, 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.570 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:23:58.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:58.573 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.821500819999997, 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:23:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.821460881999997, 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.579 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:58.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:23:58.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:23:58.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.821258477000001, 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.585 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.586 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:23:58.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:23:58.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:23:58.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.821235606999998, 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.591 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:23:58.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:23:58.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.821215971999997, 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.598 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:23:58.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:23:58.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:23:58.603 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.814323526000003, 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:23:58.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:23:58.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:23:58.609 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:23:58.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:23:58.611 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:58.610+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:58.686 INFO:teuthology.orchestra.run.smithi153.stderr:Exporting 3.2 info 3.2( v 144'722 (0'0,144'722] local-lis/les=22/23 n=73 ec=22/22 lis/c=22/22 les/c/f=23/23/0 sis=22) 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:401c36d8:::rbd_data.1179e5aa145a.000000000000003a:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4022ae04:::rbd_data.11794a93f042.00000000000000fa:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4036c8c6:::rbd_header.1179262aa3d7:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:406e4c51:::rbd_data.1179fd824b6b.0000000000000055:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4096b0c7:::rbd_data.1179e5aa145a.00000000000000b6:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:40caac84:::rbd_id.image_client.0-clone14:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:412c30d0:::rbd_data.11794a93f042.00000000000000a0:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:413de2a5:::rbd_data.117924f913ff.000000000000007d:head# 2024-09-11T05:23:58.704 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:419c350d:::rbd_data.1179fd824b6b.0000000000000065:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:419f40bd:::rbd_object_map.117999c0814c:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:41c22a87:::rbd_data.1179e5aa145a.0000000000000003:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:41cfc5fb:::rbd_data.1179e5aa145a.000000000000010f:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:420499f9:::rbd_data.1179e5aa145a.00000000000000cb:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4231c9db:::rbd_data.11794a93f042.0000000000000128:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:423df339:::rbd_data.11794a93f042.0000000000000109:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4258a167:::rbd_data.11794a93f042.0000000000000004:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4290ed9c:::rbd_object_map.117977dc529b.0000000000000008:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:42b16cd9:::rbd_data.11794a93f042.0000000000000170:head# 2024-09-11T05:23:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:42b73c2f:::rbd_data.1179262aa3d7.000000000000000a:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:42b783f1:::rbd_data.1179e5aa145a.0000000000000112:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:42baa38c:::rbd_data.1179e5aa145a.000000000000005e:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:42fcb477:::rbd_data.1179e5aa145a.000000000000008d:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:43044c1d:::rbd_data.1179fd824b6b.0000000000000049:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:43353756:::rbd_data.1179e5aa145a.0000000000000034:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:43ba4a69:::rbd_data.11794a93f042.000000000000018f:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:43d17149:::rbd_data.117999c0814c.000000000000004c:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:43d7f3b6:::rbd_data.117977dc529b.0000000000000027:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:442735ad:::rbd_data.1179e5aa145a.00000000000000eb:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:442a617c:::rbd_data.1179a8ecd52d.000000000000001c:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4445a1bf:::rbd_data.117960ca2f2d.000000000000001b:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:444a1fdb:::rbd_data.11794a93f042.00000000000000ce:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:445cb147:::rbd_data.1179ab1e2350.000000000000021c:head# 2024-09-11T05:23:58.706 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:445e3c98:::rbd_data.11794a93f042.00000000000000e9:head# 2024-09-11T05:23:58.707 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4465af2d:::rbd_data.11794a93f042.0000000000000022:head# 2024-09-11T05:23:58.707 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:446cc7cb:::rbd_data.1179514eea6e.0000000000000000:f# 2024-09-11T05:23:58.707 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:446cc7cb:::rbd_data.1179514eea6e.0000000000000000:head# 2024-09-11T05:23:58.708 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:447f0287:::rbd_data.1179fd54a524.0000000000000002:11# 2024-09-11T05:23:58.709 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:447f0287:::rbd_data.1179fd54a524.0000000000000002:head# 2024-09-11T05:23:58.712 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:448e4a49:::rbd_data.1179ab1e2350.0000000000000067:head# 2024-09-11T05:23:58.712 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4499f9ef:::rbd_data.1179dbe76e64.000000000000006a:head# 2024-09-11T05:23:58.712 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:44a6727e:::rbd_data.11794a93f042.00000000000000ac:head# 2024-09-11T05:23:58.712 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:44b372e5:::rbd_data.11794a93f042.00000000000001a8:head# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:44bc2781:::rbd_object_map.1179377e61aa:head# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:44d4f983:::rbd_data.11794a93f042.000000000000009e:head# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:44ea90b9:::rbd_data.117924f913ff.0000000000000098:head# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:44f32635:::rbd_data.117924f913ff.0000000000000063:head# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4508380e:::rbd_data.1179ab1e2350.000000000000000c:a# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4508380e:::rbd_data.1179ab1e2350.000000000000000c:head# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4550e1e5:::rbd_id.image_client.0-clone1:head# 2024-09-11T05:23:58.713 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4562e21d:::rbd_data.1179377e61aa.0000000000000072:head# 2024-09-11T05:23:58.716 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4573416f:::rbd_data.1179ab1e2350.00000000000001b8:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:458be745:::rbd_data.1179e5aa145a.0000000000000025:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:45a6c3c0:::rbd_data.11794a93f042.000000000000005d:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:45ca80a8:::rbd_data.11794a93f042.0000000000000195:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:45dd5a80:::rbd_data.1179fd824b6b.0000000000000050:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:45f91b46:::rbd_data.117924f913ff.0000000000000070:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:461cb412:::rbd_data.11794a93f042.0000000000000092:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46280eb5:::rbd_data.1179514eea6e.0000000000000001:f# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46280eb5:::rbd_data.1179514eea6e.0000000000000001:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4677631e:::rbd_data.11795685c968.00000000000000d3:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:467795b2:::rbd_data.11794a93f042.00000000000000aa:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:467b9ac1:::rbd_data.1179e5aa145a.000000000000001d:head# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:469b9437:::rbd_data.117977dc529b.000000000000002e:8# 2024-09-11T05:23:58.717 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:469b9437:::rbd_data.117977dc529b.000000000000002e:head# 2024-09-11T05:23:58.718 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46a9342e:::rbd_data.1179a4106b55.000000000000000b:b# 2024-09-11T05:23:58.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:58.714+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:58.720 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46a9342e:::rbd_data.1179a4106b55.000000000000000b:head# 2024-09-11T05:23:58.720 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46acae0a:::rbd_data.117999c0814c.0000000000000046:head# 2024-09-11T05:23:58.720 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46ae990e:::rbd_data.1179e5aa145a.000000000000009a:head# 2024-09-11T05:23:58.720 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46d47de2:::rbd_data.117924f913ff.000000000000005a:head# 2024-09-11T05:23:58.720 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:46ff37b2:::rbd_data.1179d20f522d.00000000000000a3:head# 2024-09-11T05:23:58.720 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:4785997f:::rbd_data.1179e5aa145a.000000000000001b:head# 2024-09-11T05:23:58.720 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:478acefd:::rbd_data.117977dc529b.0000000000000039:8# 2024-09-11T05:23:58.721 INFO:teuthology.orchestra.run.smithi153.stderr:Read #3:478acefd:::rbd_data.117977dc529b.0000000000000039:head# 2024-09-11T05:23:58.721 INFO:teuthology.orchestra.run.smithi153.stderr:Export successful 2024-09-11T05:23:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:58.721 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:58.721 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:58.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:23:58.815 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:58.815+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:58.876 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:58.876 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:58.876 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:58.876 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:58.877 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:58.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:23:58.928 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:58.928+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:58.993 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:58.993 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:58.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 62.453370444999997, 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:58.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:58.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.802541075000001, 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:58.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:23:59.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.005 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.144915189000002, 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.006 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:23:59.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.144890119000003, 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.012 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.014 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:23:59.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.144862007, 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.016 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.017 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:23:59.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.144835739999998, 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.021 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:23:59.022 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.023 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:23:59.024 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.144804108999999, 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.027 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.028 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.030 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.144779651, 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.031 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:23:59.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.035 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.144753178000002, 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:23:59.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960394545, 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:23:59.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960374395000002, 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.046 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:23:59.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:23:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960354375999998, 2024-09-11T05:23:59.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:59.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960334625000002, 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:23:59.055 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:23:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960315244999997, 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:23:59.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.064 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960297197999999, 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:23:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:23:59.067 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960279010000001, 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.072 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.072 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.072 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:23:59.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.072 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:23:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:23:59.076 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960260046000002, 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:59.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:23:59.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.082 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960239766999997, 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:23:59.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:23:59.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.087 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960202979999998, 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:23:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.092 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 49.960167808000001, 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:23:59.093 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.094 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:23:59.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:23:59.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.098 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:59.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:23:59.100 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:23:59.099+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:23:59.200 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:59.199+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:23:59.241 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --force --op remove --pgid 3.2 2024-09-11T05:23:59.248 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:59.248 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:59.248 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:59.248 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:59.257 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:23:59.325 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:59.325+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:59.365 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:59.365 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:59.366 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:59.366 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:59.366 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:59.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:23:59.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:23:59.418+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:23:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:23:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:59.494 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:23:59.494 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:23:59.494 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:23:59.494 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.494 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.494 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.640657646999998, 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.496 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.497 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:23:59.497 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:23:59.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.497 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:23:59.498 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:23:59.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.498 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.498 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:23:59.499 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:23:59.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.499 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.499 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.499 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:23:59.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:23:59.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.500 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.500 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:23:59.500 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:23:59.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.501 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.501 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:23:59.501 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:23:59.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.502 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:59.502 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:23:59.502 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:23:59.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:59.503 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:23:59.503 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:23:59.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.503 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:59.504 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:23:59.504 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:23:59.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.504 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:59.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:23:59.505 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:23:59.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.505 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.505 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.505 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:23:59.506 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:23:59.506 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.506 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.506 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.507 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.507 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.507 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:59.507 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.637307962000001, 2024-09-11T05:23:59.507 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:23:59.507 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:59.508 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.508 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.508 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:23:59.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.509 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.509 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.509 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.509 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:59.510 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.510 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.510 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.510 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:23:59.511 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.511 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.511 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.511 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:23:59.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:23:59.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.512 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.512 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.512 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:23:59.512 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:23:59.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.513 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.513 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.513 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:23:59.513 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:23:59.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.514 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.514 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:23:59.514 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:23:59.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.514 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.515 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.515 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:23:59.515 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:23:59.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.516 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:23:59.516 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:23:59.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.516 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:59.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:23:59.517 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:23:59.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.517 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.517 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:59.517 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:23:59.518 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:23:59.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.518 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.518 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:59.518 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:23:59.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:23:59.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.519 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:59.519 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:23:59.519 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:23:59.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.520 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.520 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.520 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:23:59.520 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:23:59.520 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.520 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.521 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.521 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.521 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:59.521 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:59.521 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.635611001999997, 2024-09-11T05:23:59.521 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:23:59.522 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.522 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.522 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.522 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:59.523 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.523 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.523 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.523 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:23:59.524 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.524 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.524 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:23:59.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:23:59.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.525 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.525 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.525 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:23:59.525 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:23:59.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.526 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.526 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:23:59.526 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:23:59.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.635035522000003, 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:59.529 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.530 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:23:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:23:59.532 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 54.632581070000001, 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.534 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.536 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:23:59.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:23:59.538 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130262 3.1f 3.a5f18dbf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:59.539 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.391187535999997, 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061307469000000003, 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130262 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.540 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.32e-07 2024-09-11T05:23:59.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100844+0000", 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100850+0000", 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6380000000000001e-06 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.542 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100854+0000", 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162141+0000", 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061286555999999999 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162150+0000", 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5029999999999997e-06 2024-09-11T05:23:59.543 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130325 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389473115999998, 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060079722000000002, 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130325 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102557+0000", 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102559+0000", 2024-09-11T05:23:59.546 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102566+0000", 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102570+0000", 2024-09-11T05:23:59.547 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162174+0000", 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.059604048999999999 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162636+0000", 2024-09-11T05:23:59.548 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00046200400000000002 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130326 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389453727000003, 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060097697999999998, 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130326 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.550 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102578+0000", 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9659999999999999e-06 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102584+0000", 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.772e-06 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102589+0000", 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162665+0000", 2024-09-11T05:23:59.552 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060076606999999997 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162674+0000", 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4319999999999999e-06 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130327 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389434360999999, 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060123397000000002, 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130327 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.554 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102596+0000", 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:23:59.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102597+0000", 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.827e-06 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102603+0000", 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.556 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102607+0000", 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2679999999999996e-06 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162696+0000", 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060088849999999999 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162719+0000", 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2285000000000001e-05 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.557 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130328 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389415698000001, 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060139489999999997, 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.558 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130328 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102617+0000", 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102624+0000", 2024-09-11T05:23:59.560 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102629+0000", 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162745+0000", 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060116145000000003 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.561 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162753+0000", 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130329 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389394271999997, 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060160739999999997, 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130329 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.563 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102636+0000", 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102642+0000", 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6989999999999997e-06 2024-09-11T05:23:59.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102650+0000", 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3490000000000003e-06 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102655+0000", 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.565 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162787+0000", 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060131974999999997 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162796+0000", 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6729999999999998e-06 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130330 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:59.566 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389367413000002, 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060169009000000002, 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130330 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102663+0000", 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102665+0000", 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.125e-06 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102671+0000", 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102675+0000", 2024-09-11T05:23:59.569 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162823+0000", 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060147618 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162831+0000", 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130331 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389336993000001, 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060170659000000001, 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130331 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102695+0000", 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.573 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102702+0000", 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102706+0000", 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7979999999999996e-06 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162855+0000", 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060148733000000003 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162863+0000", 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130332 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389317337999998, 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060183778, 2024-09-11T05:23:59.575 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130332 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:59.576 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102713+0000", 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.577 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102715+0000", 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9530000000000002e-06 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102720+0000", 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102726+0000", 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:23:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162887+0000", 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060161144999999999 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162896+0000", 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0750000000000004e-06 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130333 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389297710999998, 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060197321999999998, 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130333 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.580 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102734+0000", 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9309999999999998e-06 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102740+0000", 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102744+0000", 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5079999999999999e-06 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162921+0000", 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060176306999999998 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162929+0000", 2024-09-11T05:23:59.583 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6270000000000006e-06 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130334 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389279881, 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060210554999999999, 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.584 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130334 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.586 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102752+0000", 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102758+0000", 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102762+0000", 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.587 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162952+0000", 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060190180000000003 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162960+0000", 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1159999999999999e-06 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.588 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130335 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389262502999998, 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224879000000002, 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130335 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:23:59.590 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102769+0000", 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0549999999999998e-06 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102775+0000", 2024-09-11T05:23:59.591 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102779+0000", 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162984+0000", 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060204437999999999 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.592 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162992+0000", 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1669999999999999e-06 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130336 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389245027999998, 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060247271999999998, 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130336 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.594 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.84e-07 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102787+0000", 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9120000000000001e-06 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.595 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102792+0000", 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102797+0000", 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5000000000000001e-06 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.596 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163022+0000", 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224969000000003 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163032+0000", 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8649999999999996e-06 2024-09-11T05:23:59.597 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130337 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389227374000001, 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060276431999999998, 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.598 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130337 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102803+0000", 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102804+0000", 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.600 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102810+0000", 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102815+0000", 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4299999999999999e-06 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163067+0000", 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060252732000000003 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163079+0000", 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1321000000000001e-05 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130338 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 50.389209929000003, 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060299902000000002, 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:23:59.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130338 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.603 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104763+0000", 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001943005 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104768+0000", 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:23:59.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104808+0000", 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9691000000000003e-05 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104815+0000", 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4549999999999998e-06 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:23:59.605 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163110+0000", 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.058294374000000003 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163120+0000", 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9359999999999994e-06 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:23:59.606 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:59.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:23:59.608 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:59.608+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:59.709 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:23:59.709+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:23:59.756 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:59.756 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:59.756 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:23:59.756 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:59.765 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:23:59.810 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:23:59.810+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:23:59.872 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:23:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:23:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:23:59.872 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:23:59.872 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:23:59.880 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:23:59.911 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:23:59.910+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:00.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:00.012+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:00.028 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.139455510000005, 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.029 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.031 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:24:00.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.139435011000003, 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.035 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:24:00.036 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:24:00.037 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.039 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.039 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:24:00.039 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:24:00.039 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.039 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.039 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.139412069000002, 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:24:00.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:24:00.043 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.139203910000006, 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:00.049 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.139061376000001, 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:00.050 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.051 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.052 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:00.054 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138994475000004, 2024-09-11T05:24:00.055 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:24:00.055 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.055 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.055 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.055 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:24:00.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.056 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.056 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.056 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:00.057 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.057 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.057 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.057 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:00.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.058 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.058 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:24:00.058 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:24:00.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.059 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.059 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:24:00.059 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:24:00.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.059 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.060 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.060 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:24:00.060 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:24:00.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.060 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.061 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:24:00.061 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:24:00.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.061 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.061 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.062 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:24:00.062 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:24:00.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.063 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:24:00.063 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:24:00.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.063 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.064 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:24:00.064 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:24:00.064 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.064 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.064 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.065 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.065 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.065 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:00.065 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138658140000004, 2024-09-11T05:24:00.065 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:24:00.066 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.066 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:24:00.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.067 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.067 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.067 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:00.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.068 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.068 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:00.068 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.069 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.069 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:24:00.069 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:24:00.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.070 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.070 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:24:00.070 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:24:00.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.071 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.071 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:24:00.071 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:24:00.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.072 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:24:00.072 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:24:00.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.072 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.072 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:24:00.073 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:24:00.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.073 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.073 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:24:00.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:24:00.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.074 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.074 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:24:00.074 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:24:00.075 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.075 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.075 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.075 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.075 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.076 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:00.076 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138523147000001, 2024-09-11T05:24:00.076 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:24:00.076 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.076 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.077 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.077 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.077 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:24:00.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.078 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.078 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.078 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.078 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:00.078 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.079 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.079 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:00.079 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.080 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:00.080 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:24:00.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.080 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:24:00.081 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:24:00.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.081 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.081 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.081 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:24:00.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:24:00.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.082 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.082 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.082 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:24:00.082 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:24:00.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.083 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138488206000005, 2024-09-11T05:24:00.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:00.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:24:00.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138466535999996, 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.089 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:00.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138368482000004, 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:24:00.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:24:00.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:00.099 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138247487000001, 2024-09-11T05:24:00.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:24:00.100 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.100 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.100 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.100 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:24:00.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.103 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:24:00.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:24:00.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.138111921000004, 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:24:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.137903416, 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:24:00.114 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:24:00.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:24:00.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.137717021, 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:24:00.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.123 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.137616175999995, 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:00.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.128 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.137436979, 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:24:00.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.137165945999996, 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:24:00.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.137116086999995, 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.136962713000003, 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:00.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:00.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:24:00.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:00.145 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:00.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:24:00.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:00.146+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:00.247 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:00.247+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:00.296 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:00.296 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:00.297 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:00.297 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:00.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:24:00.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:24:00.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:00.348+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:00.412 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:00.412 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:00.412 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:00.413 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:00.413 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:00.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:24:00.465 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:00.465+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:00.485 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:24:00.485 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:24:00.503 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:24:00.504 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:24:00.522 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:24:00.522 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:24:00.542 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:24:00.544 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:24:00.546 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:00.546 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:00.549 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:00.549+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:00.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:24:00.561 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:24:00.561 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:24:00.561 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:24:00.578 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:24:00.579 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:24:00.595 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:24:00.596 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:24:00.599 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:24:00.600 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:24:00.650 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:00.650+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:00.663 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:00.663 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:00.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:24:00.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:00.752+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:00.815 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:00.815 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:00.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:24:00.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:00.852+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:00.928 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:00.928 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:00.937 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:24:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: marking collection for removal 2024-09-11T05:24:00.946 INFO:teuthology.orchestra.run.smithi153.stdout:setting '_remove' omap key 2024-09-11T05:24:00.953 INFO:teuthology.orchestra.run.smithi153.stdout:finish_remove_pgs 3.2_head removing 3.2 2024-09-11T05:24:00.953 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:00.953+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:00.960 INFO:teuthology.orchestra.run.smithi153.stdout:Remove successful 2024-09-11T05:24:01.041 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:01.042 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:01.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:24:01.091 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:01.091+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:01.154 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:01.154+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:01.194 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:01.194 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:01.203 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:24:01.287 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:01.287+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:01.356 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:24:01.357 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:01.356+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:01.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:24:01.468 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.2.5 2024-09-11T05:24:01.490 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:01.490+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:01.509 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:01.509 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:01.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:24:01.559 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:01.559+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:01.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:01.659+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:01.661 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:01.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:24:01.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:01.760+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:01.774 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:01.774 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:01.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:24:01.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:01.861+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:01.891 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:01.891 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:01.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:24:01.984 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:01.984+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:02.047 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:02.047 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:02.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:24:02.062 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:02.062+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:02.163 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:02.163+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:02.203 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:02.203 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:02.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:24:02.265 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:02.264+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:02.319 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:02.320 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:02.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:24:02.366 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:02.365+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:24:02.450 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:02.450 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:02.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:24:02.467 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:02.467+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:02.568 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:02.567+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:02.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:24:02.609 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:02.609 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:02.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:24:02.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:02.704+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:02.726 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:24:02.727 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:24:02.744 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:24:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:24:02.760 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:24:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:24:02.769 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:02.769 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:02.769 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:02.769 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:02.769 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:02.769+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:02.776 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:24:02.776 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:24:02.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:24:02.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:02.870+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:02.925 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:02.925 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:02.926 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:02.926 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:02.926 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:02.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:24:02.971 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:02.971+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:02.995 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:24:02.995 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:24:02.995 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:24:03.013 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:24:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:24:03.029 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:24:03.030 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:24:03.033 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:24:03.033 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:24:03.072 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:03.072+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:03.084 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:03.084 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:03.084 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:03.084 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:03.084 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.195062777000004, 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.085 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.086 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.087 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.088 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.195042278000003, 2024-09-11T05:24:03.089 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:03.090 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.091 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.092 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:24:03.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.195019336000001, 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:24:03.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.097 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:03.098 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.194811177000005, 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:03.099 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.100 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:24:03.102 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:24:03.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.104 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.104 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.104 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.194668643, 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.105 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:24:03.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:24:03.107 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.108 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.194601742000003, 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.110 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:24:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.194265407000003, 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:24:03.116 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.117 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.194130414, 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.119 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.120 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.122 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.194095473000004, 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.123 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:24:03.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:24:03.125 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.126 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.194073802999995, 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.128 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:24:03.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:24:03.130 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.131 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.193975749000003, 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.133 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:24:03.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.193854754, 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:24:03.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.138 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:24:03.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.193719188000003, 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:24:03.141 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:24:03.143 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.144 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.145 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.193510683, 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:24:03.147 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.193324287999999, 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:24:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.151 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.153 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.193223442999994, 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.155 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:24:03.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.193044245999999, 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.158 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:24:03.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.162 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.192773212999995, 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.163 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.165 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:24:03.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.192723353999995, 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:24:03.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:24:03.170 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 73.192569980000002, 2024-09-11T05:24:03.171 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:24:03.173 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.174 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.175 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:03.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:24:03.178 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:03.177+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:03.187 INFO:teuthology.orchestra.run.smithi153.stdout:get_pg_num_history pg_num_history pg_num_history(e145 pg_nums {1={15=1},2={18=8},3={22=32}} deleted_pools ) 2024-09-11T05:24:03.187 INFO:teuthology.orchestra.run.smithi153.stdout:Importing pgid 3.2 2024-09-11T05:24:03.187 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:401c36d8:::rbd_data.1179e5aa145a.000000000000003a:head# 2024-09-11T05:24:03.187 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4022ae04:::rbd_data.11794a93f042.00000000000000fa:head# 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4036c8c6:::rbd_header.1179262aa3d7:head# 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:406e4c51:::rbd_data.1179fd824b6b.0000000000000055:head# 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 6=[]:{} 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4096b0c7:::rbd_data.1179e5aa145a.00000000000000b6:head# 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:40caac84:::rbd_id.image_client.0-clone14:head# 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:412c30d0:::rbd_data.11794a93f042.00000000000000a0:head# 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.188 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:413de2a5:::rbd_data.117924f913ff.000000000000007d:head# 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 27=[]:{} 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:419c350d:::rbd_data.1179fd824b6b.0000000000000065:head# 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 6=[]:{} 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:419f40bd:::rbd_object_map.117999c0814c:head# 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:41c22a87:::rbd_data.1179e5aa145a.0000000000000003:head# 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:41cfc5fb:::rbd_data.1179e5aa145a.000000000000010f:head# 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:420499f9:::rbd_data.1179e5aa145a.00000000000000cb:head# 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4231c9db:::rbd_data.11794a93f042.0000000000000128:head# 2024-09-11T05:24:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:423df339:::rbd_data.11794a93f042.0000000000000109:head# 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4258a167:::rbd_data.11794a93f042.0000000000000004:head# 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4290ed9c:::rbd_object_map.117977dc529b.0000000000000008:head# 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:42b16cd9:::rbd_data.11794a93f042.0000000000000170:head# 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:42b73c2f:::rbd_data.1179262aa3d7.000000000000000a:head# 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:42b783f1:::rbd_data.1179e5aa145a.0000000000000112:head# 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:42baa38c:::rbd_data.1179e5aa145a.000000000000005e:head# 2024-09-11T05:24:03.190 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:42fcb477:::rbd_data.1179e5aa145a.000000000000008d:head# 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:43044c1d:::rbd_data.1179fd824b6b.0000000000000049:head# 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 6=[]:{} 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:43353756:::rbd_data.1179e5aa145a.0000000000000034:head# 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:43ba4a69:::rbd_data.11794a93f042.000000000000018f:head# 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:43d17149:::rbd_data.117999c0814c.000000000000004c:head# 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 7=[]:{} 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:43d7f3b6:::rbd_data.117977dc529b.0000000000000027:head# 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 8=[]:{} 2024-09-11T05:24:03.191 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:442735ad:::rbd_data.1179e5aa145a.00000000000000eb:head# 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:442a617c:::rbd_data.1179a8ecd52d.000000000000001c:head# 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 26=[]:{} 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4445a1bf:::rbd_data.117960ca2f2d.000000000000001b:head# 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 1f=[]:{} 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:444a1fdb:::rbd_data.11794a93f042.00000000000000ce:head# 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:445cb147:::rbd_data.1179ab1e2350.000000000000021c:head# 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:445e3c98:::rbd_data.11794a93f042.00000000000000e9:head# 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.192 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4465af2d:::rbd_data.11794a93f042.0000000000000022:head# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:446cc7cb:::rbd_data.1179514eea6e.0000000000000000:f# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:446cc7cb:::rbd_data.1179514eea6e.0000000000000000:head# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:snapset f=[]:{f=[f]} 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:447f0287:::rbd_data.1179fd54a524.0000000000000002:11# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:447f0287:::rbd_data.1179fd54a524.0000000000000002:head# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 11=[]:{11=[11]} 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:448e4a49:::rbd_data.1179ab1e2350.0000000000000067:head# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4499f9ef:::rbd_data.1179dbe76e64.000000000000006a:head# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 18=[]:{} 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:44a6727e:::rbd_data.11794a93f042.00000000000000ac:head# 2024-09-11T05:24:03.193 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:44b372e5:::rbd_data.11794a93f042.00000000000001a8:head# 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:44bc2781:::rbd_object_map.1179377e61aa:head# 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:44d4f983:::rbd_data.11794a93f042.000000000000009e:head# 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:44ea90b9:::rbd_data.117924f913ff.0000000000000098:head# 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 27=[]:{} 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:44f32635:::rbd_data.117924f913ff.0000000000000063:head# 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 27=[]:{} 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4508380e:::rbd_data.1179ab1e2350.000000000000000c:a# 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4508380e:::rbd_data.1179ab1e2350.000000000000000c:head# 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:snapset a=[]:{a=[a]} 2024-09-11T05:24:03.194 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4550e1e5:::rbd_id.image_client.0-clone1:head# 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4562e21d:::rbd_data.1179377e61aa.0000000000000072:head# 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4573416f:::rbd_data.1179ab1e2350.00000000000001b8:head# 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 0=[]:{} 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:458be745:::rbd_data.1179e5aa145a.0000000000000025:head# 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:45a6c3c0:::rbd_data.11794a93f042.000000000000005d:head# 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:45ca80a8:::rbd_data.11794a93f042.0000000000000195:head# 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:45dd5a80:::rbd_data.1179fd824b6b.0000000000000050:head# 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 6=[]:{} 2024-09-11T05:24:03.195 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:45f91b46:::rbd_data.117924f913ff.0000000000000070:head# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 27=[]:{} 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:461cb412:::rbd_data.11794a93f042.0000000000000092:head# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46280eb5:::rbd_data.1179514eea6e.0000000000000001:f# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46280eb5:::rbd_data.1179514eea6e.0000000000000001:head# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:snapset f=[]:{f=[f]} 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4677631e:::rbd_data.11795685c968.00000000000000d3:head# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 28=[]:{} 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:467795b2:::rbd_data.11794a93f042.00000000000000aa:head# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:snapset c=[]:{} 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:467b9ac1:::rbd_data.1179e5aa145a.000000000000001d:head# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:469b9437:::rbd_data.117977dc529b.000000000000002e:8# 2024-09-11T05:24:03.196 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:469b9437:::rbd_data.117977dc529b.000000000000002e:head# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 8=[]:{8=[8]} 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46a9342e:::rbd_data.1179a4106b55.000000000000000b:b# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46a9342e:::rbd_data.1179a4106b55.000000000000000b:head# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:snapset b=[]:{b=[b]} 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46acae0a:::rbd_data.117999c0814c.0000000000000046:head# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 7=[]:{} 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46ae990e:::rbd_data.1179e5aa145a.000000000000009a:head# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46d47de2:::rbd_data.117924f913ff.000000000000005a:head# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 27=[]:{} 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:46ff37b2:::rbd_data.1179d20f522d.00000000000000a3:head# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 30=[]:{} 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:4785997f:::rbd_data.1179e5aa145a.000000000000001b:head# 2024-09-11T05:24:03.197 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 4=[]:{} 2024-09-11T05:24:03.198 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:478acefd:::rbd_data.117977dc529b.0000000000000039:8# 2024-09-11T05:24:03.198 INFO:teuthology.orchestra.run.smithi153.stdout:Write #3:478acefd:::rbd_data.117977dc529b.0000000000000039:head# 2024-09-11T05:24:03.198 INFO:teuthology.orchestra.run.smithi153.stdout:snapset 8=[]:{8=[8]} 2024-09-11T05:24:03.198 INFO:teuthology.orchestra.run.smithi153.stdout:write_pg epoch 145 info 3.2( v 144'722 (0'0,144'722] local-lis/les=22/23 n=73 ec=22/22 lis/c=22/22 les/c/f=23/23/0 sis=22) 2024-09-11T05:24:03.198 INFO:teuthology.orchestra.run.smithi153.stdout:Import successful 2024-09-11T05:24:03.277 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:03.277+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:03.325 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:03.326 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:03.326 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:03.326 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:03.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:24:03.378 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:03.377+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:03.478 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:03.478+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:03.487 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:03.487 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:03.487 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:03.487 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:03.487 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:03.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:24:03.579 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:03.578+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.90302163299999, 2024-09-11T05:24:03.648 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:24:03.649 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.650 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:24:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.652 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.90300974500001, 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.654 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:24:03.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.656 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.902972525, 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:24:03.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.659 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:24:03.661 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.90295774400001, 2024-09-11T05:24:03.662 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:24:03.663 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.664 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:24:03.666 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.90294640800001, 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.667 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:24:03.668 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.669 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.901795607, 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.672 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:24:03.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:24:03.674 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.901781152, 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:24:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.679 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:24:03.680 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.901770672, 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.681 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:24:03.682 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.683 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.901760205, 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:03.687 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:24:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.901741845, 2024-09-11T05:24:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:24:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.899032773, 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:24:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.899009773, 2024-09-11T05:24:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:24:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:24:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.89898841, 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:24:03.708 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.709 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:24:03.710 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.898966891, 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.711 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.712 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.713 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.89894596400001, 2024-09-11T05:24:03.715 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:24:03.716 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.718 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:24:03.719 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.897102227, 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.720 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.721 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:24:03.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:24:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:03.724 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.897091854, 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.726 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.897076825, 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.729 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:24:03.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:24:03.731 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.732 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 124.897066817, 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:03.733 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:24:03.734 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.735 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.736 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 56.232798828999996, 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:03.737 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:03.738 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.739 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:24:03.742 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:24:03.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.743 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:03.743 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:03.743 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:03.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /var/log/ceph/exp.3.2.5 2024-09-11T05:24:03.745 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:03.744+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:03.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:24:03.852 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:03.852+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:03.890 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:03.890 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:03.890 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:03.890 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:03.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:24:03.983 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:03.983+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:04.042 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:04.042 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:04.043 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:04.047 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:04.046+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:04.051 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:24:04.147 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:04.147+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:04.198 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:04.198 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.564128122, 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.199 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:24:04.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:04.203 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.561986601, 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:24:04.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.56196503699999, 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.208 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:24:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:24:04.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.561951026, 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:24:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:04.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:24:04.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:04.218 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.56012572500001, 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:24:04.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:24:04.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.560111122, 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:24:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:24:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:24:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:24:04.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.56009381699999, 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:24:04.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:24:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.560069708, 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.237 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.56004163199999, 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.238 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:24:04.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.56001464000001, 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:04.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.55997408100001, 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.250 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:24:04.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:24:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.55995069399999, 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:24:04.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.259 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.463965587, 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:24:04.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:24:04.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:04.264 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.46394602700001, 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:04.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.463926812, 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.269 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:24:04.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 125.463906012, 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:24:04.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:24:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.579805496999995, 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.278 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:04.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:24:04.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.576815689, 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:24:04.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:24:04.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:24:04.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:24:04.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:04.292 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 98.112218796999997, 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:24:04.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:24:04.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 97.577634908999997, 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.299 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:24:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:24:04.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.305 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:04.307 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:24:04.307 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:04.307+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:04.408 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:04.408+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:04.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:24:04.452 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:04.452 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:04.452 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:04.452 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:04.461 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:24:04.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:04.509+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:04.609 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:04.609+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:04.610 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:04.610 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:04.610 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:04.610 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:04.610 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:04.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:24:04.710 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:04.710+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:04.764 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:04.764 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:04.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131273315000001, 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:24:04.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.769 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131263449000002, 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:24:04.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:24:04.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131239033, 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.775 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:24:04.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:24:04.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131227745000004, 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.780 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:24:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131218226000001, 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:24:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131208868000002, 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.789 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:24:04.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131194985999997, 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:24:04.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131185419000005, 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.798 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:24:04.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:24:04.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131169588999995, 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:24:04.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131143831000003, 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.807 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:24:04.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131115174000001, 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.812 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:04.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131090341000004, 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.816 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:24:04.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131072789000001, 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.821 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:24:04.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:24:04.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131062818999993, 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:24:04.825 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:24:04.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.829 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131052631000003, 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.830 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:04.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131043292000001, 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.834 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:04.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:24:04.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131034131999996, 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:24:04.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:24:04.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.131022938000001, 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:04.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:24:04.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:04.847 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.130998997000006, 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:04.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:24:04.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.130987380999997, 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:24:04.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:04.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:04.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:04.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:04.856 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:04.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:24:04.860 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:04.857+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:04.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:04.958+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:05.002 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:05.002 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:05.002 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:05.002 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:05.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:24:05.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:24:05.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:05.079+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:05.113 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:05.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:05.114 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:05.114 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:05.114 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:05.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:24:05.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:05.159+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:05.164 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:24:05.164 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:24:05.181 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:24:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:24:05.197 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:24:05.197 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:24:05.213 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:24:05.213 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:24:05.228 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:05.228 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:05.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:05.228 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:05.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.580708928999996, 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:24:05.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:24:05.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.233 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.666050318000003, 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:24:05.234 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:05.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:24:05.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.569666945000002, 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.239 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:24:05.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:24:05.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.569511448999997, 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:05.244 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:05.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:24:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.566704969, 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.249 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:24:05.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.566679604999997, 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:24:05.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.259 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.566657577999997, 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:24:05.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.564176228999997, 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.265 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:24:05.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.564149829999998, 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:24:05.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:24:05.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.275 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.564114641000003, 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:24:05.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.280 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.564092842000001, 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.281 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:24:05.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.564071513000002, 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:24:05.286 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:05.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:24:05.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.564050794000003, 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.292 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:24:05.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:24:05.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.559786950000003, 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.297 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:24:05.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:05.302 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.559741258999999, 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:24:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:24:05.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.559701320999999, 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:24:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.559498916000003, 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:24:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.559476046, 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:24:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:24:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:24:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:24:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.559456410999999, 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:24:05.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.329 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.552563964999997, 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:24:05.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:24:05.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:24:05.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:24:05.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.335 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:05.335 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:05.335 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:05.336 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:24:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:24:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:24:05.337 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:24:05.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:24:05.338 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:05.336+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:24:05.338 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:24:05.339 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:24:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:24:05.339 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:24:05.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:05.437+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is set 2024-09-11T05:24:05.500 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:05.501 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:05.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:24:05.537 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:05.537+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:05.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:05.638+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:05.660 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:05.661 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:05.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:24:05.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:05.754+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:05.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:05.818 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:05.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:24:05.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:05.868+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:05.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:05.942+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:05.975 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:05.976 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:05.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:24:06.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:06.068+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:06.131 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:06.131 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:06.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:24:06.181 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:06.181+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:06.245 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:06.245+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:06.288 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:06.288 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:06.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:24:06.347 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:06.346+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:06.404 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:06.405 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:06.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:24:06.458 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:06.458+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:06.537 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:06.537 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:06.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:24:06.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:06.549+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:06.650 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:06.650+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:06.699 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:06.699 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:06.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:24:06.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:06.751+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:06.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:06.852+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:06.856 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:06.856 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:06.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:24:06.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:06.953+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:07.013 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:07.013 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:07.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:24:07.063 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:07.063+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:07.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:07.155+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:07.169 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:07.170 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:07.178 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:24:07.256 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:07.256+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:07.296 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:07.296 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:07.309 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:24:07.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:24:07.394 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:07.394+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:07.455 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:07.456 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:07.458 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:07.458+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:07.464 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:24:07.467 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:24:07.467 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:24:07.488 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:24:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:24:07.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:24:07.506 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:24:07.506 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:24:07.526 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:24:07.526 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:24:07.545 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:24:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:24:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:24:07.559 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:07.559+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:07.566 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:24:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:24:07.584 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:24:07.585 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:24:07.589 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:24:07.590 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:24:07.617 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.98330340999999, 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.618 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:24:07.622 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.98116188899999, 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.623 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:24:07.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.98114032500001, 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.628 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:24:07.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:24:07.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.98112631399999, 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.633 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:24:07.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:24:07.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.979301013, 2024-09-11T05:24:07.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:24:07.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:24:07.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.97928640999999, 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.644 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:24:07.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.97926910499999, 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.649 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:24:07.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:24:07.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.97924499600001, 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.654 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:24:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:24:07.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:24:07.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:24:07.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:24:07.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:07.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.97921692, 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:07.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:24:07.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:24:07.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:24:07.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:24:07.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.97918992800001, 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:24:07.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:24:07.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.979149369, 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.670 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:24:07.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:24:07.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.675 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.979125982, 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.676 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:24:07.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.88314087500001, 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:24:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.88312131500001, 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:24:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:24:07.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.689 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.8831021, 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.690 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:24:07.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 128.88308129999999, 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.695 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:24:07.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:24:07.699 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.998980785, 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.700 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:24:07.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:24:07.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.99599097700001, 2024-09-11T05:24:07.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:24:07.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:24:07.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:24:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:24:07.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:24:07.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 101.531394085, 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:24:07.717 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:24:07.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:24:07.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 100.996810197, 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:07.724 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:07.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:24:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.731 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:07.732 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:07.732 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:07.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:07.733+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:07.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:24:07.835 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:07.834+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:07.877 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:07.878 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:07.878 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:07.878 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:07.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:24:07.971 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:07.970+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:08.031 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:08.031 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:08.031 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:08.031 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:08.031 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:08.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:08.037+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:08.039 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:24:08.138 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:08.137+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552996422000007, 2024-09-11T05:24:08.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:08.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:24:08.190 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552986555999993, 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.191 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:24:08.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552962140000005, 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:24:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552950851999995, 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.204 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552941333000007, 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:24:08.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552931975000007, 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.209 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:24:08.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552918093000002, 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552908525999996, 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:24:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:24:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552892696000001, 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:24:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:24:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552866937999994, 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:24:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552838281000007, 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:24:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552813447999995, 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:24:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:24:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552795896000006, 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:24:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552785925999999, 2024-09-11T05:24:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:24:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552775737999994, 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:24:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552766399000006, 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:24:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552757239000002, 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552746045000006, 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:24:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552722103999997, 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 78.552710488000002, 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:24:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:24:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:24:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.278 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:08.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:24:08.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:08.279+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:08.380 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:08.380+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:08.423 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:08.423 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:08.423 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:08.423 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:08.432 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:24:08.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:08.481+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:08.492 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is set 2024-09-11T05:24:08.544 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:08.544 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:08.544 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:08.544 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:08.544 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:08.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:24:08.582 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:08.582+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:08.660 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.012857893000003, 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.661 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.098199282000003, 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:24:08.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:24:08.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.001815909000001, 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.672 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:24:08.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.001660413000003, 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.677 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:24:08.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.681 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.998853932999999, 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.682 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:24:08.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:24:08.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.998828568999997, 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:24:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:24:08.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.998806541999997, 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.693 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:24:08.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.996325192999997, 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:24:08.698 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:24:08.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:24:08.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:08.703 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.996298793999998, 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:24:08.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.996263605000003, 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.709 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:24:08.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.996241806, 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:24:08.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.996220477000001, 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.720 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:08.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:24:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.996199758000003, 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:24:08.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.991935914000003, 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:24:08.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.991890222999999, 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:24:08.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:24:08.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.991850284999998, 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.741 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:08.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:08.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:24:08.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.991647880000002, 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.748 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:24:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.99162501, 2024-09-11T05:24:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:24:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:24:08.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.991605374999999, 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.759 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:08.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.984712928999997, 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:24:08.764 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:24:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:24:08.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:08.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:08.769 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:08.771 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:24:08.771 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:08.771+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:08.813 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [5] live_osds: [0, 1, 3, 4, 6, 7, 2] 2024-09-11T05:24:08.813 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:24:08.813 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T05:24:08.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:24:08.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:08.871+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:08.880 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:08.880 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:08.880 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:08.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:24:08.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:08.974+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:09.038 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:09.038 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:09.038 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:09.038 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:09.038 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:09.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:24:09.073 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:09.073+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:09.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:09.107 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 159, 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "fsid": "5fd14db5-8ee9-4e34-bd57-a8040293ab17", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "created": "2024-09-11T05:21:12.602514+0000", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "modified": "2024-09-11T05:24:08.484005+0000", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "last_up_change": "2024-09-11T05:23:55.417787+0000", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "last_in_change": "2024-09-11T05:23:24.657382+0000", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_num": 5806080, 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_set": [ 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "nodeep-scrub", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "noscrub", 2024-09-11T05:24:09.108 INFO:teuthology.orchestra.run.smithi012.stdout: "pglog_hardlimit", 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "purged_snapdirs", 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_deletes", 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "sortbitwise" 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_version": 5, 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_snapshot": "", 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_max": 3, 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd": 8, 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min_compat_client": "luminous", 2024-09-11T05:24:09.109 INFO:teuthology.orchestra.run.smithi012.stdout: "require_osd_release": "squid", 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_crimson": false, 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "pools": [ 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 1, 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": ".mgr", 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:27.582783+0000", 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool", 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:24:09.110 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 1, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 1, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 1, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 1, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 1, 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:24:09.111 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "17", 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 0, 2024-09-11T05:24:09.112 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 0, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:24:09.113 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:24:09.114 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "options": { 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_max": 32, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_min": 1 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": {} 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:24:09.115 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 8, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 8, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.25, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 2, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 2, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 2, 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "rbd", 2024-09-11T05:24:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:31.353652+0000", 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:24:09.117 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 8, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 8, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 8, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 8, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 8, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "21", 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 2, 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 21, 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:24:09.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:24:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:24:09.121 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 3, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 3, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.75, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 2.25, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 2.25, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": "pool_client.0", 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "create_time": "2024-09-11T05:21:41.109530+0000", 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 8193, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": 1, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 2, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": 1, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_rule": 0, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:24:09.123 INFO:teuthology.orchestra.run.smithi012.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "is_stretch_pool": false, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "object_hash": 2, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": 32, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num": 32, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_placement_num_target": 32, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_target": 32, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num_pending": 32, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "last_pg_merge_meta": { 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "source_pgid": "0.0", 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "ready_epoch": 0, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_started": 0, 2024-09-11T05:24:09.124 INFO:teuthology.orchestra.run.smithi012.stdout: "last_epoch_clean": 0, 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "source_version": "0'0", 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "target_version": "0'0" 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_change": "159", 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend": "0", 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "auid": 0, 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_seq": 50, 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_epoch": 159, 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_snaps": [], 2024-09-11T05:24:09.125 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps": "[]", 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_bytes": 0, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "quota_max_objects": 0, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tiers": [], 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tier_of": -1, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "read_tier": -1, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "write_tier": -1, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_mode": "none", 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_bytes": 0, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "target_max_objects": 0, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_flush_age": 0, 2024-09-11T05:24:09.126 INFO:teuthology.orchestra.run.smithi012.stdout: "cache_min_evict_age": 0, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profile": "", 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_params": { 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "none" 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_period": 0, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_count": 0, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "use_gmt_hitset": true, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "grade_table": [], 2024-09-11T05:24:09.127 INFO:teuthology.orchestra.run.smithi012.stdout: "stripe_width": 0, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "expected_num_objects": 0, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "fast_read": false, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "options": {}, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "application_metadata": { 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd": {} 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "read_balance": { 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "score_type": "Fair distribution", 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "score_acting": 2.25, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "score_stable": 2.25, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "optimal_score": 0.75, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_acting": 1.690000057220459, 2024-09-11T05:24:09.128 INFO:teuthology.orchestra.run.smithi012.stdout: "raw_score_stable": 1.690000057220459, 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity_weighted": 0.94980621337890625, 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e628e137-3e68-4084-a084-200022b8da35", 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:24:09.129 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 0.59844970703125, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 146, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6808", 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6809", 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6810", 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6811", 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6814", 2024-09-11T05:24:09.132 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6815", 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6812", 2024-09-11T05:24:09.133 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6813", 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2997410357 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6809/2997410357", 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6811/2997410357", 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6815/2997410357", 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6813/2997410357", 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.134 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "26db6fe3-81d0-40ae-a4e1-9a7460fabc2c", 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:24:09.135 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 146, 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6816", 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6817", 2024-09-11T05:24:09.136 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6818", 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.137 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6819", 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6822", 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.138 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6823", 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6820", 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6821", 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 852655937 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6817/852655937", 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6819/852655937", 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6823/852655937", 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6821/852655937", 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "00ff2990-a7cb-48a2-ab03-6739942d65d7", 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 13, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 70, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 87, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 146, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 71, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.141 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6824", 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6825", 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6830", 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6831", 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.144 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2878270387 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.145 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6825/2878270387", 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6827/2878270387", 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6831/2878270387", 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6829/2878270387", 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "d1c858fd-7b66-4e1b-aa18-e3fd567e1417", 2024-09-11T05:24:09.146 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 146, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.147 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6802", 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6803", 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.149 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6806", 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6807", 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6804", 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6805", 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2211289880 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.12:6801/2211289880", 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.12:6803/2211289880", 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.12:6807/2211289880", 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.12:6805/2211289880", 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "586534a4-d5e3-4af4-a2e5-aa4ec052b582", 2024-09-11T05:24:09.154 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 0, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 0, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 107, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6800", 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6801", 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6802", 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6803", 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6806", 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6807", 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6804", 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6805", 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1639325236 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6801/1639325236", 2024-09-11T05:24:09.159 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6803/1639325236", 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6807/1639325236", 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6805/1639325236", 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "801041dc-7a4c-4776-bfbb-68be37655407", 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 0, 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:24:09.160 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 119, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 146, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6816", 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6817", 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6818", 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6819", 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6822", 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6823", 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6820", 2024-09-11T05:24:09.164 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6821", 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2370940838 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6817/2370940838", 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6819/2370940838", 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6823/2370940838", 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6821/2370940838", 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.165 INFO:teuthology.orchestra.run.smithi012.stdout: "exists" 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e0820ac1-b43f-486f-9d7b-155b46b33950", 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 146, 2024-09-11T05:24:09.166 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6826", 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6827", 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6828", 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6829", 2024-09-11T05:24:09.168 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6832", 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6833", 2024-09-11T05:24:09.169 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6830", 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6831", 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1798055911 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6827/1798055911", 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6829/1798055911", 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6833/1798055911", 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6831/1798055911", 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "uuid": "e22fdfda-9a13-42f2-be4f-f7c6e0ffd324", 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "up": 1, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "in": 1, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "weight": 1, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_affinity": 1, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_begin": 0, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "last_clean_end": 0, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "up_from": 13, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "up_thru": 146, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "down_at": 0, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "lost_at": 0, 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addrs": { 2024-09-11T05:24:09.172 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6808", 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6809", 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addrs": { 2024-09-11T05:24:09.173 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6810", 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6811", 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addrs": { 2024-09-11T05:24:09.174 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6814", 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6815", 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addrs": { 2024-09-11T05:24:09.175 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6812", 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.153:6813", 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1122624549 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.176 INFO:teuthology.orchestra.run.smithi012.stdout: "public_addr": "172.21.15.153:6809/1122624549", 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_addr": "172.21.15.153:6811/1122624549", 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_back_addr": "172.21.15.153:6815/1122624549", 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "heartbeat_front_addr": "172.21.15.153:6813/1122624549", 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "state": [ 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "exists", 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "up" 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_xinfo": [ 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 0, 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.177 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.912439+0000", 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 1, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:24:09.178 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.788769+0000", 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 2, 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.857319+0000", 2024-09-11T05:24:09.179 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 71 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 3, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.926699+0000", 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 4, 2024-09-11T05:24:09.180 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 65536, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.752975+0000", 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 5, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.181 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.222079+0000", 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 146 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 6, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:22.095040+0000", 2024-09-11T05:24:09.182 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": 7, 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "down_stamp": "0.000000", 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_probability": 0, 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "laggy_interval": 0, 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "features": 4540701547738038271, 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "old_weight": 0, 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "last_purged_snaps_scrub": "2024-09-11T05:21:21.860946+0000", 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "dead_epoch": 0 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap": [ 2024-09-11T05:24:09.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pgid": "2.5", 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "osds": [ 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: 3, 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: 6 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_items": [], 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_upmap_primaries": [], 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_temp": [], 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "primary_temp": [], 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklist": {}, 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "range_blocklist": {}, 2024-09-11T05:24:09.184 INFO:teuthology.orchestra.run.smithi012.stdout: "erasure_code_profiles": { 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default": { 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-failure-domain": "osd", 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: "k": "2", 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: "m": "1", 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: "plugin": "jerasure", 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: "technique": "reed_sol_van" 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.185 INFO:teuthology.orchestra.run.smithi012.stdout: "removed_snaps_queue": [ 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: "snaps": [ 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: "begin": 8, 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: "length": 13 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: "new_removed_snaps": [ 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: "pool": 3, 2024-09-11T05:24:09.186 INFO:teuthology.orchestra.run.smithi012.stdout: "snaps": [ 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "begin": 8, 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "length": 1 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "new_purged_snaps": [], 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_node_flags": {}, 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "device_class_flags": {}, 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode": { 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_enabled": false, 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_bucket_count": 0, 2024-09-11T05:24:09.187 INFO:teuthology.orchestra.run.smithi012.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:24:09.188 INFO:teuthology.orchestra.run.smithi012.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:24:09.188 INFO:teuthology.orchestra.run.smithi012.stdout: "stretch_mode_bucket": 0 2024-09-11T05:24:09.188 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.188 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:09.190 INFO:tasks.thrashosds.thrasher:j is {'epoch': 159, 'fsid': '5fd14db5-8ee9-4e34-bd57-a8040293ab17', 'created': '2024-09-11T05:21:12.602514+0000', 'modified': '2024-09-11T05:24:08.484005+0000', 'last_up_change': '2024-09-11T05:23:55.417787+0000', 'last_in_change': '2024-09-11T05:23:24.657382+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:21:27.582783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:21:31.353652+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:21:41.109530+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 50, 'snap_epoch': 159, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 0.75, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9498062133789062, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}], 'osds': [{'osd': 0, 'uuid': 'e628e137-3e68-4084-a084-200022b8da35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.59844970703125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 146, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6808', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6809', 'nonce': 2997410357}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6810', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6811', 'nonce': 2997410357}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6814', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6815', 'nonce': 2997410357}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6812', 'nonce': 2997410357}, {'type': 'v1', 'addr': '172.21.15.12:6813', 'nonce': 2997410357}]}, 'public_addr': '172.21.15.12:6809/2997410357', 'cluster_addr': '172.21.15.12:6811/2997410357', 'heartbeat_back_addr': '172.21.15.12:6815/2997410357', 'heartbeat_front_addr': '172.21.15.12:6813/2997410357', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '26db6fe3-81d0-40ae-a4e1-9a7460fabc2c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 146, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6816', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6817', 'nonce': 852655937}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6818', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6819', 'nonce': 852655937}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6822', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6823', 'nonce': 852655937}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6820', 'nonce': 852655937}, {'type': 'v1', 'addr': '172.21.15.12:6821', 'nonce': 852655937}]}, 'public_addr': '172.21.15.12:6817/852655937', 'cluster_addr': '172.21.15.12:6819/852655937', 'heartbeat_back_addr': '172.21.15.12:6823/852655937', 'heartbeat_front_addr': '172.21.15.12:6821/852655937', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '00ff2990-a7cb-48a2-ab03-6739942d65d7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 70, 'up_from': 87, 'up_thru': 146, 'down_at': 71, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6824', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6825', 'nonce': 2878270387}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6826', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6827', 'nonce': 2878270387}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6830', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6831', 'nonce': 2878270387}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6828', 'nonce': 2878270387}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 2878270387}]}, 'public_addr': '172.21.15.12:6825/2878270387', 'cluster_addr': '172.21.15.12:6827/2878270387', 'heartbeat_back_addr': '172.21.15.12:6831/2878270387', 'heartbeat_front_addr': '172.21.15.12:6829/2878270387', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'd1c858fd-7b66-4e1b-aa18-e3fd567e1417', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 146, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6800', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6801', 'nonce': 2211289880}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6802', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6803', 'nonce': 2211289880}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6806', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6807', 'nonce': 2211289880}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6804', 'nonce': 2211289880}, {'type': 'v1', 'addr': '172.21.15.12:6805', 'nonce': 2211289880}]}, 'public_addr': '172.21.15.12:6801/2211289880', 'cluster_addr': '172.21.15.12:6803/2211289880', 'heartbeat_back_addr': '172.21.15.12:6807/2211289880', 'heartbeat_front_addr': '172.21.15.12:6805/2211289880', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '586534a4-d5e3-4af4-a2e5-aa4ec052b582', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 1639325236}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 1639325236}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 1639325236}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 1639325236}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 1639325236}]}, 'public_addr': '172.21.15.153:6801/1639325236', 'cluster_addr': '172.21.15.153:6803/1639325236', 'heartbeat_back_addr': '172.21.15.153:6807/1639325236', 'heartbeat_front_addr': '172.21.15.153:6805/1639325236', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '801041dc-7a4c-4776-bfbb-68be37655407', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 146, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6816', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6817', 'nonce': 2370940838}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6818', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6819', 'nonce': 2370940838}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6822', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6823', 'nonce': 2370940838}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6820', 'nonce': 2370940838}, {'type': 'v1', 'addr': '172.21.15.153:6821', 'nonce': 2370940838}]}, 'public_addr': '172.21.15.153:6817/2370940838', 'cluster_addr': '172.21.15.153:6819/2370940838', 'heartbeat_back_addr': '172.21.15.153:6823/2370940838', 'heartbeat_front_addr': '172.21.15.153:6821/2370940838', 'state': ['exists']}, {'osd': 6, 'uuid': 'e0820ac1-b43f-486f-9d7b-155b46b33950', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 146, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6826', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6827', 'nonce': 1798055911}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6828', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6829', 'nonce': 1798055911}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 1798055911}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6830', 'nonce': 1798055911}, {'type': 'v1', 'addr': '172.21.15.153:6831', 'nonce': 1798055911}]}, 'public_addr': '172.21.15.153:6827/1798055911', 'cluster_addr': '172.21.15.153:6829/1798055911', 'heartbeat_back_addr': '172.21.15.153:6833/1798055911', 'heartbeat_front_addr': '172.21.15.153:6831/1798055911', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e22fdfda-9a13-42f2-be4f-f7c6e0ffd324', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 146, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6808', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6809', 'nonce': 1122624549}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6810', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6811', 'nonce': 1122624549}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6814', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6815', 'nonce': 1122624549}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6812', 'nonce': 1122624549}, {'type': 'v1', 'addr': '172.21.15.153:6813', 'nonce': 1122624549}]}, 'public_addr': '172.21.15.153:6809/1122624549', 'cluster_addr': '172.21.15.153:6811/1122624549', 'heartbeat_back_addr': '172.21.15.153:6815/1122624549', 'heartbeat_front_addr': '172.21.15.153:6813/1122624549', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.912439+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.788769+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.857319+0000', 'dead_epoch': 71}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.926699+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.752975+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.222079+0000', 'dead_epoch': 146}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:22.095040+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:21:21.860946+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.5', 'osds': [3, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 13}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:24:09.190 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 2.5 2024-09-11T05:24:09.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 2.5 2024-09-11T05:24:09.190 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:09.189+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 72.656731198000003, 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.197 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:24:09.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.200 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.201 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 65.005901828000006, 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.203 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:24:09.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:09.206 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.207 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 64.348275942000001, 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.208 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.209 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.210 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:24:09.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 64.348250871999994, 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.213 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.214 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.215 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:24:09.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 64.348222759999999, 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:24:09.217 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:24:09.219 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.220 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.221 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 64.348196493000003, 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.223 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:24:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 64.348164862000004, 2024-09-11T05:24:09.226 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:24:09.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 64.348140404000006, 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.231 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.233 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.235 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 64.348113931, 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:24:09.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.238 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163755297999998, 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:24:09.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.243 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.244 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163735148000001, 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:24:09.247 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.248 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:09.249 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163715129000003, 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:24:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163695378, 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:24:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163675998000002, 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:24:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:24:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163657950999998, 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163639762999999, 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:24:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:24:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163620799, 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163600520000003, 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:24:09.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:24:09.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163563732999997, 2024-09-11T05:24:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:24:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 60.163528561, 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:24:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:09.291 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:09.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:24:09.293 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:09.293+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:09.393 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:09.393+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:09.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:24:09.498 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:09.498+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:09.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:24:09.629 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:09.630 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:09.630 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:09.630+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:09.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:24:09.724 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:24:09.725 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:24:09.725 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:09.724+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:09.742 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:24:09.742 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:24:09.760 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:24:09.760 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:24:09.777 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:24:09.777 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:24:09.792 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:09.792 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:09.794 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:24:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:24:09.794 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:24:09.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:09.796+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:09.801 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:24:09.812 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:24:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:24:09.829 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:24:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:24:09.834 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:24:09.834 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:24:09.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:09.897+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:09.921 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:09.921 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:09.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:24:09.998 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:09.998+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:10.077 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:10.077 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:10.086 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:24:10.099 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:10.098+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:10.194 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:10.194 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:10.199 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:10.199+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:10.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:24:10.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:10.300+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:10.312 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:10.312 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:10.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:24:10.402 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:10.401+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:10.468 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:10.468 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:10.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:24:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:clear 2.5 pg_upmap mapping 2024-09-11T05:24:10.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:10.507+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:10.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:24:10.603 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:10.603+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:10.607 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:10.608 INFO:teuthology.orchestra.run.smithi012.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:10.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:24:10.703 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:10.703+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:10.728 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:10.728 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:10.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:24:10.821 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:10.821+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:10.879 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:10.880 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:10.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:24:10.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:10.905+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:11.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:11.006+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:11.033 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:11.033 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:11.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:24:11.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:11.107+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:11.146 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:11.146 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:11.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:24:11.209 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-11T05:24:11.209+0000 7f7e6d91b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33298) UID: 0 2024-09-11T05:24:11.258 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:11.258 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:11.267 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:24:11.309 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:11.309+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:11.370 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:11.371 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:11.379 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:24:11.423 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:11.423+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:11.484 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:11.638 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:11.640 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:24:11.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:24:11.641 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:11.639+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:11.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:11.741+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:11.783 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:11.784 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:11.792 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:24:11.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:24:11.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:11.879+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:11.895 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-11T05:24:11.895 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:24:11.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:24:11.942 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:11.942+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:11.965 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0: {} 2024-09-11T05:24:11.966 INFO:teuthology.orchestra.run.smithi012.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:24:11.984 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1: {} 2024-09-11T05:24:11.985 INFO:teuthology.orchestra.run.smithi012.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:24:12.001 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2: {} 2024-09-11T05:24:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:24:12.015 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:12.015 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3: {} 2024-09-11T05:24:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:24:12.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:24:12.034 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4: {} 2024-09-11T05:24:12.034 INFO:teuthology.orchestra.run.smithi012.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:24:12.034 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-11T05:24:12.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:12.042+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6: {} 2024-09-11T05:24:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:24:12.069 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7: {} 2024-09-11T05:24:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:24:12.073 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:24:12.074 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:24:12.132 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:12.132 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:12.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:24:12.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:12.143+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:12.244 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:12.243+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:12.250 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 75.710824484, 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:24:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 68.059995114000003, 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:24:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:24:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.402369227999998, 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:24:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.402344158000005, 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:12.268 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.402316045999996, 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:24:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.402289779, 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:24:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:24:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.402258148000001, 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:24:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.402233690000003, 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:24:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.402207216999997, 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:24:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:24:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217848584000002, 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:24:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217828433999998, 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:24:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:24:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217808415, 2024-09-11T05:24:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217788663999997, 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:24:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217769283999999, 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:24:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:24:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217751237000002, 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217733049000003, 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217714084999997, 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:24:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:24:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217693806, 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:24:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217657019000001, 2024-09-11T05:24:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:24:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.217621846999997, 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:24:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:12.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:12.347+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:12.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:24:12.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:12.447+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:12.496 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:12.496 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:12.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:24:12.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:12.548+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:12.649 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:12.649+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:12.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:24:12.749 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-11T05:24:12.749+0000 7f5ea8d8f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33096) UID: 0 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126102 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.964380121000005, 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12619929099999999, 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126102 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851372+0000", 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851373+0000", 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851379+0000", 2024-09-11T05:24:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851390+0000", 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1912999999999999e-05 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.851398+0000", 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0269999999999995e-06 2024-09-11T05:24:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854859+0000", 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.003461006 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854945+0000", 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5434999999999998e-05 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.855311+0000", 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00036573299999999998 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977458+0000", 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.122147557 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977508+0000", 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0315999999999997e-05 2024-09-11T05:24:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977540+0000", 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1621000000000001e-05 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977571+0000", 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1102999999999997e-05 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126103 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.961030436000001, 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.124050641, 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126103 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854722+0000", 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854723+0000", 2024-09-11T05:24:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7209999999999999e-06 2024-09-11T05:24:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854731+0000", 2024-09-11T05:24:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4259999999999997e-06 2024-09-11T05:24:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854743+0000", 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2026e-05 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.854752+0000", 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4809999999999995e-06 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856012+0000", 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012596420000000001 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856119+0000", 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107031 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856352+0000", 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023352600000000001 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977501+0000", 2024-09-11T05:24:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.121148123 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978704+0000", 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0012030179999999999 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978745+0000", 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1711000000000001e-05 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978772+0000", 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6936000000000001e-05 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126102 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:24:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:24:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.959333475999998, 2024-09-11T05:24:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12104983599999999, 2024-09-11T05:24:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856419+0000", 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856420+0000", 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1200000000000001e-06 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856425+0000", 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856442+0000", 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7283e-05 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856450+0000", 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0460000000000006e-06 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977440+0000", 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12099040799999999 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977451+0000", 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0188e-05 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977468+0000", 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7725999999999999e-05 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop_reply(client.4473.0:126103 3.17 e95/22 ondisk, result = 0)", 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.958757996000003, 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.12058411199999999, 2024-09-11T05:24:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856994+0000", 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856995+0000", 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9599999999999999e-07 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.856999+0000", 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0999999999999997e-06 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977209+0000", 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.120210069 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977230+0000", 2024-09-11T05:24:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.126e-05 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977492+0000", 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00026174 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977497+0000", 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1189999999999996e-06 2024-09-11T05:24:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977578+0000", 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1128e-05 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126104 3.17 3:ec09f17e:::rbd_object_map.1179d20f522d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 67.956303543999994, 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.119679996, 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126104 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859449+0000", 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859450+0000", 2024-09-11T05:24:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1489999999999999e-06 2024-09-11T05:24:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859455+0000", 2024-09-11T05:24:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977208+0000", 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.117753315 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977231+0000", 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2966999999999999e-05 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977608+0000", 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037695600000000001 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.977712+0000", 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010356700000000001 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 5", 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978088+0000", 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00037578900000000002 2024-09-11T05:24:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.978953+0000", 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00086535500000000005 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979040+0000", 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7128999999999999e-05 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979094+0000", 2024-09-11T05:24:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3624e-05 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.979129+0000", 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4730000000000001e-05 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130262 3.1f 3.a5f18dbf (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:24:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.714910009999997, 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061307469000000003, 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130262 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:24:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100842+0000", 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.32e-07 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100844+0000", 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8780000000000001e-06 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100850+0000", 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6380000000000001e-06 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.100854+0000", 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:24:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162141+0000", 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061286555999999999 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162150+0000", 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5029999999999997e-06 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130325 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713195589999998, 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060079722000000002, 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130325 2024-09-11T05:24:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102556+0000", 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102557+0000", 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102559+0000", 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102566+0000", 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102570+0000", 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162174+0000", 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.059604048999999999 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162636+0000", 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00046200400000000002 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130326 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713176201000003, 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060097697999999998, 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130326 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102576+0000", 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102578+0000", 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9659999999999999e-06 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102584+0000", 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.772e-06 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102589+0000", 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5730000000000001e-06 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162665+0000", 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060076606999999997 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162674+0000", 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4319999999999999e-06 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130327 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713156834999999, 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060123397000000002, 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130327 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102595+0000", 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102596+0000", 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:24:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102597+0000", 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.827e-06 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102603+0000", 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:24:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102607+0000", 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2679999999999996e-06 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162696+0000", 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060088849999999999 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162719+0000", 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2285000000000001e-05 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130328 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:24:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713138172000001, 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060139489999999997, 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130328 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.871 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.872 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102614+0000", 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102617+0000", 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.873 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102624+0000", 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102629+0000", 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162745+0000", 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060116145000000003 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.874 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162753+0000", 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2050000000000002e-06 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130329 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713116745999997, 2024-09-11T05:24:12.875 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060160739999999997, 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130329 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.876 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102635+0000", 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102636+0000", 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102642+0000", 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6989999999999997e-06 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102650+0000", 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3490000000000003e-06 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102655+0000", 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6609999999999997e-06 2024-09-11T05:24:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162787+0000", 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060131974999999997 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162796+0000", 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6729999999999998e-06 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130330 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713089887000002, 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060169009000000002, 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130330 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102662+0000", 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102663+0000", 2024-09-11T05:24:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102665+0000", 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.125e-06 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102671+0000", 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102675+0000", 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5460000000000002e-06 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162823+0000", 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060147618 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162831+0000", 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1990000000000006e-06 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130331 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713059467000001, 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060170659000000001, 2024-09-11T05:24:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130331 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102693+0000", 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102695+0000", 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2029999999999999e-06 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102702+0000", 2024-09-11T05:24:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102706+0000", 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7979999999999996e-06 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162855+0000", 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060148733000000003 2024-09-11T05:24:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162863+0000", 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130332 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713039811999998, 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060183778, 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130332 2024-09-11T05:24:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102712+0000", 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102713+0000", 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102715+0000", 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9530000000000002e-06 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102720+0000", 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7830000000000004e-06 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102726+0000", 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3909999999999997e-06 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162887+0000", 2024-09-11T05:24:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060161144999999999 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162896+0000", 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0750000000000004e-06 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130333 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713020184999998, 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060197321999999998, 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130333 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102732+0000", 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102734+0000", 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9309999999999998e-06 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102740+0000", 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5890000000000002e-06 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102744+0000", 2024-09-11T05:24:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5079999999999999e-06 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162921+0000", 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060176306999999998 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162929+0000", 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6270000000000006e-06 2024-09-11T05:24:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130334 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.713002355, 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060210554999999999, 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130334 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102750+0000", 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102752+0000", 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102758+0000", 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102762+0000", 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3560000000000003e-06 2024-09-11T05:24:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162952+0000", 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060190180000000003 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162960+0000", 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1159999999999999e-06 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130335 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.712984976999998, 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224879000000002, 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130335 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102767+0000", 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102769+0000", 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0549999999999998e-06 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102775+0000", 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102779+0000", 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162984+0000", 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060204437999999999 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.162992+0000", 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1669999999999999e-06 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130336 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.712967501999998, 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060247271999999998, 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130336 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102785+0000", 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.84e-07 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102787+0000", 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9120000000000001e-06 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102792+0000", 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6420000000000004e-06 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102797+0000", 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5000000000000001e-06 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163022+0000", 2024-09-11T05:24:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060224969000000003 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163032+0000", 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8649999999999996e-06 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130337 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:24:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.712949848000001, 2024-09-11T05:24:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060276431999999998, 2024-09-11T05:24:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130337 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102802+0000", 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102803+0000", 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3600000000000004e-07 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102804+0000", 2024-09-11T05:24:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7570000000000001e-06 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102810+0000", 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102815+0000", 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4299999999999999e-06 2024-09-11T05:24:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163067+0000", 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060252732000000003 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163079+0000", 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1321000000000001e-05 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:130338 3.f 3.df0a042f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 63.712932403000003, 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060299902000000002, 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 130338 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.102820+0000", 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104763+0000", 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001943005 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104768+0000", 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4410000000000001e-06 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104808+0000", 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9691000000000003e-05 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.104815+0000", 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4549999999999998e-06 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163110+0000", 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.058294374000000003 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.163120+0000", 2024-09-11T05:24:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9359999999999994e-06 2024-09-11T05:24:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:12.925 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:12.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:24:12.927 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:12.926+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:13.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:13.027+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:13.075 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:13.075 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:13.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:24:13.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T05:24:13.168+0000 7f504e28f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33284) UID: 0 2024-09-11T05:24:13.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T05:24:13.228+0000 7f631671b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33279) UID: 0 2024-09-11T05:24:13.230 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:13.231 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:13.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:24:13.330 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-11T05:24:13.329+0000 7f2abd7ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33102) UID: 0 2024-09-11T05:24:13.388 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89464 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 837632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.499416832999998, 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869395000000002, 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89464 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888263+0000", 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888264+0000", 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2500000000000001e-07 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888266+0000", 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9810000000000002e-06 2024-09-11T05:24:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888272+0000", 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4019999999999999e-06 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888277+0000", 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7790000000000003e-06 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.927965+0000", 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039688532999999998 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928054+0000", 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8480000000000007e-05 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928133+0000", 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8794999999999994e-05 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89466 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 841728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.499396333999997, 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040049026000000001, 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89466 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888284+0000", 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5600000000000001e-07 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888286+0000", 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1040000000000001e-06 2024-09-11T05:24:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888292+0000", 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0700000000000003e-06 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888297+0000", 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928166+0000", 2024-09-11T05:24:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039869256999999998 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928253+0000", 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6677999999999999e-05 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928333+0000", 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9782000000000003e-05 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89468 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 845824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.499373391999995, 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232129999999998, 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89468 2024-09-11T05:24:13.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.400 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888307+0000", 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.58e-07 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888309+0000", 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888315+0000", 2024-09-11T05:24:13.401 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1600000000000003e-06 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888320+0000", 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0690000000000001e-06 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928364+0000", 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040043850999999998 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928450+0000", 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5284999999999994e-05 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928539+0000", 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9297999999999998e-05 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89470 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 849920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.403 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.499165232999999, 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040232758, 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89470 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.404 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888515+0000", 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888516+0000", 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4799999999999997e-07 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.405 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888520+0000", 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888529+0000", 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2650000000000002e-06 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.406 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888535+0000", 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5780000000000004e-06 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928573+0000", 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040037092000000003 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928661+0000", 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8678999999999996e-05 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.407 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928748+0000", 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.6428999999999995e-05 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89481 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 854016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:13.408 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.499022698999994, 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040320016, 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89481 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.409 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888657+0000", 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888658+0000", 2024-09-11T05:24:13.410 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9800000000000003e-07 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888662+0000", 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6799999999999999e-06 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888674+0000", 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2024999999999999e-05 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.411 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888681+0000", 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0509999999999999e-06 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928795+0000", 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040114495 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928889+0000", 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3739999999999994e-05 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.412 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.928977+0000", 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8326999999999996e-05 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89483 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498955797999997, 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040388221000000002, 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89483 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888724+0000", 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888725+0000", 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8999999999999996e-07 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888728+0000", 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2090000000000001e-06 2024-09-11T05:24:13.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888737+0000", 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.1430000000000004e-06 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.888744+0000", 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4670000000000001e-06 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929006+0000", 2024-09-11T05:24:13.416 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040262688999999997 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929066+0000", 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9446e-05 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929113+0000", 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6576999999999998e-05 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89485 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 862208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498619462999997, 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040179184999999999, 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89485 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889061+0000", 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889062+0000", 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7599999999999996e-07 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889066+0000", 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.707e-06 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889076+0000", 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8689999999999999e-06 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889083+0000", 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0740000000000004e-06 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929145+0000", 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040061586000000003 2024-09-11T05:24:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929196+0000", 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1338000000000002e-05 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929240+0000", 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3735000000000001e-05 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89487 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 866304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498484469999994, 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040199034000000002, 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89487 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889196+0000", 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889201+0000", 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889212+0000", 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1029000000000001e-05 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889219+0000", 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9920000000000001e-06 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929308+0000", 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040089165000000003 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929353+0000", 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5521e-05 2024-09-11T05:24:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929395+0000", 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1278e-05 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89490 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 870400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498449528999998, 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040361414999999998, 2024-09-11T05:24:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89490 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889231+0000", 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5400000000000001e-07 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889234+0000", 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6630000000000002e-06 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889242+0000", 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7619999999999995e-06 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889247+0000", 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0390000000000004e-06 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929429+0000", 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040182573999999999 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929519+0000", 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.9678000000000004e-05 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929592+0000", 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3145000000000005e-05 2024-09-11T05:24:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89492 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 874496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498427859000003, 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040467233999999998, 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89492 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889252+0000", 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889253+0000", 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889254+0000", 2024-09-11T05:24:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4720000000000001e-06 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889258+0000", 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5659999999999998e-06 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889260+0000", 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.734e-06 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929623+0000", 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040362792000000002 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929677+0000", 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4341e-05 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929719+0000", 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2021999999999998e-05 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89494 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 878592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498329804999997, 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040490327, 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89494 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889350+0000", 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889351+0000", 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8100000000000002e-07 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889355+0000", 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.653e-06 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889363+0000", 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5089999999999993e-06 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889369+0000", 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9379999999999997e-06 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929750+0000", 2024-09-11T05:24:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040380704000000003 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929800+0000", 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0083999999999997e-05 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929841+0000", 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0757999999999998e-05 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89496 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 882688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498208809999994, 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.04049225, 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89496 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889471+0000", 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889472+0000", 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:24:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889482+0000", 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0042e-05 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889491+0000", 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.2499999999999995e-06 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889498+0000", 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929875+0000", 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040376659000000002 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929924+0000", 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9700999999999997e-05 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.929964+0000", 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9329999999999998e-05 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89498 3.19 3:9ade69bc:::rbd_data.1179a8ecd52d.0000000000000021:26 [read 886784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.498073243999997, 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040538409999999997, 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89498 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889607+0000", 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2200000000000004e-07 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889612+0000", 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0960000000000003e-06 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889622+0000", 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0512e-05 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889628+0000", 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1009999999999997e-06 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930000+0000", 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040372105999999998 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930076+0000", 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5783000000000003e-05 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930145+0000", 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9190000000000007e-05 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89500 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.497864738999994, 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040366224999999999, 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89500 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889815+0000", 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889816+0000", 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0160000000000001e-06 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889821+0000", 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889833+0000", 2024-09-11T05:24:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1506e-05 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.889840+0000", 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930175+0000", 2024-09-11T05:24:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040334818000000001 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930182+0000", 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0400000000000004e-06 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89502 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.497678343999993, 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040212590999999999, 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89502 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890002+0000", 2024-09-11T05:24:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8400000000000004e-07 2024-09-11T05:24:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890006+0000", 2024-09-11T05:24:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.552e-06 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890013+0000", 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0430000000000002e-06 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890018+0000", 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.074e-06 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930207+0000", 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040189375999999999 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930214+0000", 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.8619999999999997e-06 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89504 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.497577499000002, 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040143336000000002, 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89504 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890103+0000", 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6199999999999997e-07 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890107+0000", 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3759999999999999e-06 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890114+0000", 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.1439999999999997e-06 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890120+0000", 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.088e-06 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930237+0000", 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040117260000000002 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930246+0000", 2024-09-11T05:24:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8060000000000001e-06 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89506 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.497398301999993, 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.040011107999999997, 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89506 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890282+0000", 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890283+0000", 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8599999999999997e-07 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890287+0000", 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1049999999999997e-06 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890295+0000", 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5639999999999997e-06 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890302+0000", 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930283+0000", 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039981116999999997 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930293+0000", 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7359999999999996e-06 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89508 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.497127269000003, 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039773668999999998, 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89508 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890553+0000", 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890554+0000", 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3500000000000005e-07 2024-09-11T05:24:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890558+0000", 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.335e-06 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890569+0000", 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1175000000000001e-05 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890580+0000", 2024-09-11T05:24:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0682e-05 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930320+0000", 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039739872000000002 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930326+0000", 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89510 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.497077410000003, 2024-09-11T05:24:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039758449000000001, 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89510 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890603+0000", 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890607+0000", 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5609999999999999e-06 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890616+0000", 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5699999999999993e-06 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890622+0000", 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3879999999999997e-06 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930353+0000", 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039731331000000002 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930361+0000", 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:89514 3.19 3.3d967b59 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 83.496924035999996, 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039694026, 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 89514 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890756+0000", 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890757+0000", 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:24:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890760+0000", 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.185e-06 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890768+0000", 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3429999999999996e-06 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.890774+0000", 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9150000000000001e-06 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930440+0000", 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.039665628000000001 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:49.930450+0000", 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0343000000000001e-05 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:13.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:24:13.487 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-11T05:24:13.486+0000 7f139e6fc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33104) UID: 0 2024-09-11T05:24:13.587 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T05:24:13.587+0000 7fd41b07a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 51271) UID: 0 2024-09-11T05:24:13.608 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:150678 3.1e 3:7d2cb664:::rbd_data.1179d519140e.0000000000000000:head [delete] snapc 3=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:24:13.607040+0000", 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.00092490499999999995, 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00095028699999999996, 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 150678 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607040+0000", 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607040+0000", 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607042+0000", 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.674e-06 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607049+0000", 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.0369999999999997e-06 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607066+0000", 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7085e-05 2024-09-11T05:24:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607076+0000", 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0114e-05 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607156+0000", 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9989999999999998e-05 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607287+0000", 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00013090199999999999 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607390+0000", 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000102786 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:150682 3.18 3:1f174247:::rbd_data.1179d519140e.0000000000000014:head [delete] snapc 3=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:24:13.607105+0000", 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.00086011499999999995, 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00096852199999999998, 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 150682 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607105+0000", 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607105+0000", 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607105+0000", 2024-09-11T05:24:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7400000000000003e-07 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607109+0000", 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.6990000000000001e-06 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607118+0000", 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0459999999999994e-06 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607125+0000", 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.5939999999999999e-06 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607191+0000", 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6012000000000004e-05 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607317+0000", 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000126465 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607423+0000", 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010587200000000001 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:150683 3.b 3:d285ef49:::rbd_data.1179d519140e.0000000000000018:head [delete] snapc 3=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:24:13.607144+0000", 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.00082081500000000002, 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0010066840000000001, 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 150683 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607144+0000", 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607144+0000", 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607145+0000", 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607148+0000", 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1930000000000002e-06 2024-09-11T05:24:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607156+0000", 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3699999999999995e-06 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607162+0000", 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3840000000000002e-06 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607279+0000", 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011662099999999999 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607390+0000", 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000111239 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607493+0000", 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010217699999999999 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:150685 3.18 3:1e9fbf58:::rbd_data.1179d519140e.0000000000000024:head [delete] snapc 3=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:24:13.607178+0000", 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.00078686399999999997, 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001045835, 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 150685 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607178+0000", 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607178+0000", 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607179+0000", 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6199999999999998e-07 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607182+0000", 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9569999999999998e-06 2024-09-11T05:24:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607190+0000", 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.1550000000000007e-06 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607196+0000", 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0889999999999996e-06 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.608164+0000", 2024-09-11T05:24:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00096805299999999997 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_repop(client.4473.0:150680 3.15 e164/102 3:afaa7528:::rbd_data.1179d519140e.0000000000000005:head v 164'512, mlcod=162'510)", 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:24:13.607458+0000", 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.000507126, 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00082844199999999998, 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607458+0000", 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607458+0000", 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607458+0000", 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607463+0000", 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6809999999999997e-06 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607471+0000", 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9969999999999998e-06 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607483+0000", 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2016e-05 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607587+0000", 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104497 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:24:13.607605+0000", 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7847e-05 2024-09-11T05:24:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T05:24:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 5 2024-09-11T05:24:13.631 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:13.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:24:13.632 INFO:teuthology.orchestra.run.smithi012.stdout:All operations completed A-OK! 2024-09-11T05:24:13.637 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:13.637 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-11T05:24:13.649 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-11T05:24:13.656 INFO:tasks.thrashosds:joining thrashosds 2024-09-11T05:24:13.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:24:13.786 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:13.786 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:13.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:24:13.906 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37805 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3039232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.161252228, 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062994888999999998, 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37805 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743672+0000", 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743673+0000", 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.17e-07 2024-09-11T05:24:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743674+0000", 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743677+0000", 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743679+0000", 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806381+0000", 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062701514 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806437+0000", 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6659000000000001e-05 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806667+0000", 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00022985099999999999 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37806 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3051520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.16124034000001, 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063244229999999999, 2024-09-11T05:24:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37806 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:24:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743684+0000", 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743685+0000", 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9200000000000002e-07 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743686+0000", 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743692+0000", 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7590000000000003e-06 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743697+0000", 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806698+0000", 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063001635 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806737+0000", 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8512e-05 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806928+0000", 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000191662 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37807 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3063808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.16120312000001, 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063576399000000006, 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37807 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743721+0000", 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743722+0000", 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743724+0000", 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.199e-06 2024-09-11T05:24:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743729+0000", 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743732+0000", 2024-09-11T05:24:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.806973+0000", 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063240930000000001 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807057+0000", 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4520999999999999e-05 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807298+0000", 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00024075799999999999 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37808 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3076096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.16118833900001, 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063792563999999996, 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37808 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743736+0000", 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743737+0000", 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743738+0000", 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.2249999999999999e-06 2024-09-11T05:24:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743742+0000", 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743744+0000", 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.633e-06 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807337+0000", 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063592632999999996 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807381+0000", 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4379999999999999e-05 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807529+0000", 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00014744199999999999 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37809 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3088384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.16117700300001, 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063914393, 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37809 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.743748+0000", 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744869+0000", 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0011213460000000001 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744873+0000", 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8820000000000003e-06 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744882+0000", 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.3000000000000007e-06 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744888+0000", 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807558+0000", 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062670374000000001 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807603+0000", 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4135999999999999e-05 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807662+0000", 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9460000000000003e-05 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37810 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3100672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.16002620200001, 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063030642999999997, 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37810 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744898+0000", 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744899+0000", 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8599999999999998e-07 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744901+0000", 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.339e-06 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744906+0000", 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744909+0000", 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807690+0000", 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062780965999999994 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807732+0000", 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1959000000000003e-05 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807929+0000", 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00019745099999999999 2024-09-11T05:24:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37811 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3112960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.160011747, 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063140160000000001, 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37811 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744913+0000", 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744915+0000", 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4670000000000001e-06 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744918+0000", 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.1499999999999999e-06 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744920+0000", 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5150000000000001e-06 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807959+0000", 2024-09-11T05:24:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063038987000000005 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.807998+0000", 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.9167e-05 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808053+0000", 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4654999999999998e-05 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37812 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3125248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.16000126700001, 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063324905000000001, 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37812 2024-09-11T05:24:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744923+0000", 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744924+0000", 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744925+0000", 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744928+0000", 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0709999999999999e-06 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744930+0000", 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.48e-06 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808096+0000", 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063165341999999999 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808173+0000", 2024-09-11T05:24:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7538000000000002e-05 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808248+0000", 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5098000000000005e-05 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37813 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 3137536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.1599908, 2024-09-11T05:24:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063532832999999997, 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37813 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744934+0000", 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0199999999999998e-07 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744936+0000", 2024-09-11T05:24:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.751e-06 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744942+0000", 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744946+0000", 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.4460000000000003e-06 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808287+0000", 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063341039000000002 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808368+0000", 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0717999999999995e-05 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808467+0000", 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8696999999999994e-05 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37899 3.18 3:1cc13212:::rbd_object_map.1179ab1e2350:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.15997243999999, 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.066187377000000006, 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37899 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.744952+0000", 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747484+0000", 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0025321050000000002 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747490+0000", 2024-09-11T05:24:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747503+0000", 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3838e-05 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747511+0000", 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.525e-06 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808498+0000", 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.060987260000000001 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808578+0000", 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9234999999999996e-05 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 0", 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.808979+0000", 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00040107800000000002 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810681+0000", 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0017025740000000001 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811092+0000", 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00041080499999999998 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811114+0000", 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2430999999999999e-05 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811140+0000", 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5130000000000002e-05 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37994 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2155520~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.157263368, 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062980761999999996, 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37994 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747661+0000", 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747662+0000", 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.39e-07 2024-09-11T05:24:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747664+0000", 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3199999999999998e-06 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747672+0000", 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.7209999999999994e-06 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747677+0000", 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9099999999999996e-06 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810504+0000", 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062827692000000004 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810579+0000", 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4760999999999998e-05 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810642+0000", 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2918999999999998e-05 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37995 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2167808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.157240368, 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063262578, 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37995 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747684+0000", 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747685+0000", 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.03e-07 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747687+0000", 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747694+0000", 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747699+0000", 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1240000000000004e-06 2024-09-11T05:24:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810733+0000", 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063034287999999994 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810821+0000", 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8018999999999999e-05 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810947+0000", 2024-09-11T05:24:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012583900000000001 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37996 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2180096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.157219005, 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063438453000000006, 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37996 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747706+0000", 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747708+0000", 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747714+0000", 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.8320000000000002e-06 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747719+0000", 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.810964+0000", 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063245201000000001 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811023+0000", 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.9098000000000002e-05 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811144+0000", 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00012111 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37997 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2192384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.157197486, 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063642274999999998, 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37997 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747727+0000", 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747728+0000", 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747730+0000", 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747736+0000", 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7800000000000003e-06 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747742+0000", 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811179+0000", 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063436887999999997 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811261+0000", 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2467999999999997e-05 2024-09-11T05:24:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811369+0000", 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010836399999999999 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:37998 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2204672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.15717655899999, 2024-09-11T05:24:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063877831999999996, 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 37998 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.747748+0000", 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749483+0000", 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001734714 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749487+0000", 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749498+0000", 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.048e-05 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749508+0000", 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0091e-05 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811411+0000", 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061903487 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811520+0000", 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108628 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.811626+0000", 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00010582999999999999 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38004 3.18 3:18c67c05:::rbd_data.1179c3639760.0000000000000001:9 [read 2278400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.15533282199999, 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063130358999999997, 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38004 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749592+0000", 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749593+0000", 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.4980000000000001e-06 2024-09-11T05:24:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749597+0000", 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.0730000000000001e-06 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749599+0000", 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812544+0000", 2024-09-11T05:24:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.062944899999999998 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812605+0000", 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1366999999999997e-05 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812722+0000", 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000116743 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38005 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.15532244900001, 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063168146999999994, 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38005 2024-09-11T05:24:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749602+0000", 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.16e-07 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749607+0000", 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.78e-06 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749611+0000", 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.0609999999999997e-06 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749614+0000", 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812761+0000", 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063146669000000002 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812770+0000", 2024-09-11T05:24:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38006 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.15530742000001, 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063171526000000006, 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38006 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749617+0000", 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749619+0000", 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.164e-06 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749622+0000", 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.084e-06 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749624+0000", 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.5859999999999999e-06 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812784+0000", 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063159577999999994 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812789+0000", 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.887e-06 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:38007 3.18 3.a03e6318 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 135.15529741200001, 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.063175830000000002, 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 38007 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.749627+0000", 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751482+0000", 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001854935 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751487+0000", 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.831e-06 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751497+0000", 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.5959999999999993e-06 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.751503+0000", 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9299999999999997e-06 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812800+0000", 2024-09-11T05:24:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.061296288999999997 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:21:58.812803+0000", 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2490000000000001e-06 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:128654 3.7 3:e254c8ca:::rbd_header.11798e9b496a:head [watch reconnect cookie 139855074943488 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.491029424000004, 2024-09-11T05:24:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3505269659999999, 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 128654 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413895+0000", 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413897+0000", 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5319999999999999e-06 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413902+0000", 2024-09-11T05:24:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1649999999999997e-06 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413913+0000", 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.1144e-05 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413924+0000", 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0665999999999999e-05 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413979+0000", 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5464000000000003e-05 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:07.413987+0000", 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9920000000000007e-06 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761141+0000", 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3471537419999999 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.761217+0000", 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.6291000000000005e-05 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763025+0000", 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.001807484 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.763128+0000", 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000103816 2024-09-11T05:24:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:08.764422+0000", 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00129367 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:14.003 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:14.004 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:24:14.120 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:14.120 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:14.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:24:14.233 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:14.234 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:14.234 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:14.234 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:14.234 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:14.242 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:24:14.347 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36839 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1847296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.712901225, 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059401823999999999, 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36839 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.632987+0000", 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634924+0000", 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019373680000000001 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634928+0000", 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634936+0000", 2024-09-11T05:24:14.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7549999999999994e-06 2024-09-11T05:24:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.634942+0000", 2024-09-11T05:24:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:24:14.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692071+0000", 2024-09-11T05:24:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057128309000000002 2024-09-11T05:24:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692146+0000", 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5591000000000002e-05 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.692389+0000", 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024254600000000001 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36846 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1933312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.710759704, 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059468910999999999, 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36846 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.354 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635129+0000", 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635131+0000", 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1239999999999999e-06 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635138+0000", 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1110000000000002e-06 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635143+0000", 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694342+0000", 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059198703999999998 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694422+0000", 2024-09-11T05:24:14.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9578000000000003e-05 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694597+0000", 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017569499999999999 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36847 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1945600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.71073813999999, 2024-09-11T05:24:14.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059777327999999998, 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36847 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635150+0000", 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635151+0000", 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635152+0000", 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.885e-06 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635157+0000", 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9590000000000003e-06 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635160+0000", 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694636+0000", 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059475836999999997 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694705+0000", 2024-09-11T05:24:14.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9276000000000006e-05 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694927+0000", 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222053 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36848 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 1957888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:14.363 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.710724129, 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060029476999999998, 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36848 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.635164+0000", 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636928+0000", 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001764215 2024-09-11T05:24:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636933+0000", 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3810000000000001e-06 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636942+0000", 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4730000000000006e-06 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636947+0000", 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694959+0000", 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058012489 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.694999+0000", 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9539999999999998e-05 2024-09-11T05:24:14.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.695194+0000", 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000194642 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36852 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2007040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.708898828, 2024-09-11T05:24:14.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059537050000000001, 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36852 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636989+0000", 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636990+0000", 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636991+0000", 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2929999999999999e-06 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.636996+0000", 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.147e-06 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637000+0000", 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:24:14.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696228+0000", 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059227583 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696300+0000", 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1676999999999998e-05 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696526+0000", 2024-09-11T05:24:14.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022679199999999999 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36853 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.70888422499999, 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059848419, 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.373 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36853 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:14.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637004+0000", 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4699999999999998e-07 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637006+0000", 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5990000000000001e-06 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637011+0000", 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637016+0000", 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6700000000000002e-06 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696557+0000", 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059541231999999999 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696630+0000", 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2762999999999994e-05 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696852+0000", 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000222551 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36854 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2031616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.377 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.70886691999999, 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060155385999999998, 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36854 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:14.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637021+0000", 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637022+0000", 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637024+0000", 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.897e-06 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637032+0000", 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8130000000000002e-06 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637039+0000", 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.117e-06 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696880+0000", 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059841228000000003 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.696960+0000", 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9909999999999999e-05 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697177+0000", 2024-09-11T05:24:14.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021708299999999999 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36855 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2043904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.70884281100001, 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060422525999999997, 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.382 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36855 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637045+0000", 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637046+0000", 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637053+0000", 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8789999999999997e-06 2024-09-11T05:24:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637060+0000", 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637065+0000", 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5430000000000001e-06 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697214+0000", 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060149326000000003 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697289+0000", 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4138000000000001e-05 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697468+0000", 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017937000000000001 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36856 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.708814735, 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060736422999999998, 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.387 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36856 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637074+0000", 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637076+0000", 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2689999999999998e-06 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637085+0000", 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5059999999999995e-06 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637091+0000", 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5610000000000004e-06 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697499+0000", 2024-09-11T05:24:14.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060407882000000003 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697575+0000", 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6013999999999994e-05 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697810+0000", 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023471500000000001 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36857 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2068480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.70878774299999, 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061045224000000002, 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.392 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36857 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637101+0000", 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2e-07 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637103+0000", 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1469999999999999e-06 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637111+0000", 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5499999999999997e-06 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637116+0000", 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3360000000000002e-06 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697839+0000", 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060723303999999999 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.697894+0000", 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4833999999999997e-05 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698146+0000", 2024-09-11T05:24:14.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025163300000000002 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36858 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2080768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.708747184, 2024-09-11T05:24:14.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061273432000000003, 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36858 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637141+0000", 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637142+0000", 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637144+0000", 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4650000000000001e-06 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637152+0000", 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5680000000000002e-06 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637157+0000", 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.169e-06 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698182+0000", 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061025136000000001 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698224+0000", 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2422000000000001e-05 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698415+0000", 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019008499999999999 2024-09-11T05:24:14.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:36859 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 2093056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.708723797, 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061623618999999998, 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 36859 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.637164+0000", 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638926+0000", 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00176202 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638931+0000", 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5800000000000002e-06 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638940+0000", 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4700000000000002e-06 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.638945+0000", 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698469+0000", 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059524011000000002 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698550+0000", 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1868999999999998e-05 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.698788+0000", 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237696 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.406 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37894 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3096576~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.61273868999999, 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059283032999999999, 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37894 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733150+0000", 2024-09-11T05:24:14.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733152+0000", 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1409999999999999e-06 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733158+0000", 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7740000000000001e-06 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733163+0000", 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792144+0000", 2024-09-11T05:24:14.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058981211999999998 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792226+0000", 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1969000000000001e-05 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792433+0000", 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020689499999999999 2024-09-11T05:24:14.411 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37895 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3108864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.61271912999999, 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059577318999999997, 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.412 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37895 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733169+0000", 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733170+0000", 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.82e-07 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733172+0000", 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733178+0000", 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1020000000000002e-06 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733183+0000", 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6779999999999999e-06 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792459+0000", 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059275950000000001 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792535+0000", 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6543000000000002e-05 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792746+0000", 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021134100000000001 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37896 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3121152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.61269991500001, 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059867125, 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37896 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733188+0000", 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733189+0000", 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4700000000000002e-07 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733191+0000", 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.136e-06 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733198+0000", 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2690000000000002e-06 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733203+0000", 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7339999999999999e-06 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792784+0000", 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059580946000000003 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.792864+0000", 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9937000000000004e-05 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793055+0000", 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019165600000000001 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.423 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:37897 3.3 3:c0ae87a8:::rbd_data.1179c3639760.0000000000000002:9 [read 3133440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-11T05:24:14.423 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:14.423 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 135.61267911499999, 2024-09-11T05:24:14.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.060145705000000001, 2024-09-11T05:24:14.423 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 37897 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.733209+0000", 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734926+0000", 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017170880000000001 2024-09-11T05:24:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734931+0000", 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.279e-06 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734945+0000", 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4788e-05 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.734950+0000", 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793093+0000", 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058142501999999999 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793168+0000", 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5025999999999996e-05 2024-09-11T05:24:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:21:58.793355+0000", 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000186842 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74952 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 108.72857860000001, 2024-09-11T05:24:14.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0430314589999998, 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74952 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617310+0000", 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617311+0000", 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3480000000000001e-06 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617316+0000", 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2179999999999998e-06 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617328+0000", 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617353+0000", 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4898000000000001e-05 2024-09-11T05:24:14.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617440+0000", 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6716000000000001e-05 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.617446+0000", 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8529999999999997e-06 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622571+0000", 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051257940000000004 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622583+0000", 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1673e-05 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622627+0000", 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.000043668 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622638+0000", 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0920999999999999e-05 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658005+0000", 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0353668460000001 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658270+0000", 2024-09-11T05:24:14.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026522200000000002 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660341+0000", 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020712920000000002 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74953 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 108.725588792, 2024-09-11T05:24:14.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0402835170000002, 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74953 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620299+0000", 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620300+0000", 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620304+0000", 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9809999999999997e-06 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620314+0000", 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8490000000000001e-06 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620319+0000", 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620372+0000", 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2410000000000001e-05 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.620378+0000", 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1539999999999999e-06 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622606+0000", 2024-09-11T05:24:14.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002228224 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:25.622612+0000", 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622675+0000", 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0000624680000001 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622684+0000", 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1179999999999998e-06 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.658885+0000", 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.036201427 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659002+0000", 2024-09-11T05:24:14.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117144 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 6", 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659458+0000", 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00045589699999999998 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660100+0000", 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00064194299999999996 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660404+0000", 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000304085 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660441+0000", 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6547000000000001e-05 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660583+0000", 2024-09-11T05:24:14.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014219600000000001 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74954 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch ping cookie 139855277332496 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 108.26099189999999, 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5759204850000001, 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.444 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74954 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084896+0000", 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084897+0000", 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084901+0000", 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084907+0000", 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.545e-06 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.084915+0000", 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-06 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085006+0000", 2024-09-11T05:24:14.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0889000000000003e-05 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.085015+0000", 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1689999999999998e-06 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622713+0000", 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.53769840199999996 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622720+0000", 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.844e-06 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659841+0000", 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037121465 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659917+0000", 2024-09-11T05:24:14.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5951000000000005e-05 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660615+0000", 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00069809899999999999 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660682+0000", 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6889000000000003e-05 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660817+0000", 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013448600000000001 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:74955 3.11 3:8f86d401:::rbd_header.1179abd45f42:head [watch reconnect cookie 139855277332496 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 107.72640801199999, 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0428362520000001, 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.451 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 74955 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619480+0000", 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619481+0000", 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1060000000000001e-06 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619503+0000", 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1886e-05 2024-09-11T05:24:14.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619515+0000", 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1751e-05 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619525+0000", 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0115999999999999e-05 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619588+0000", 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3178999999999999e-05 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.619594+0000", 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5910000000000003e-06 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622770+0000", 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031762779999999998 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:26.622779+0000", 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5609999999999999e-06 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.659967+0000", 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0371884739999999 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for rw locks", 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660072+0000", 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105117 2024-09-11T05:24:14.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660842+0000", 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076931899999999997 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.660902+0000", 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0436000000000002e-05 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:27.662316+0000", 2024-09-11T05:24:14.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014144380000000001 2024-09-11T05:24:14.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.458 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:14.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:24:14.546 INFO:teuthology.orchestra.run.smithi012.stderr:noscrub is unset 2024-09-11T05:24:14.563 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:24:14.567 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:14.567 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:14.567 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:14.567 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:14.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:24:14.680 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:14.680 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:14.680 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:14.680 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:14.680 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:14.689 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:24:14.794 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:14.794 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86520 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 97280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161531447000002, 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023459576999999999, 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.795 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86520 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:14.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632004+0000", 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632005+0000", 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1519999999999999e-06 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632008+0000", 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.931e-06 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632011+0000", 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655374+0000", 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023363426999999999 2024-09-11T05:24:14.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655414+0000", 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9304000000000002e-05 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655464+0000", 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0006999999999997e-05 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86521 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 113664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161521581000002, 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023563237000000001, 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86521 2024-09-11T05:24:14.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632014+0000", 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.36e-07 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632015+0000", 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632018+0000", 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2760000000000001e-06 2024-09-11T05:24:14.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632021+0000", 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6620000000000001e-06 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655486+0000", 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023464806000000001 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655526+0000", 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0646999999999999e-05 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655577+0000", 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0630000000000001e-05 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86522 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 121856~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:14.804 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161497165, 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023648901, 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86522 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632038+0000", 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632039+0000", 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.77e-07 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632040+0000", 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4079999999999999e-06 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632043+0000", 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4460000000000001e-06 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632046+0000", 2024-09-11T05:24:14.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.976e-06 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655600+0000", 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023553349000000001 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655638+0000", 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7898999999999997e-05 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655687+0000", 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9446000000000001e-05 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86523 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 130048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161485877000004, 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023748155, 2024-09-11T05:24:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86523 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632050+0000", 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632051+0000", 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8700000000000004e-07 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632054+0000", 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632056+0000", 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:24:14.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655709+0000", 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023652248000000001 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655748+0000", 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9226e-05 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655798+0000", 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9922000000000001e-05 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86524 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 138240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161476358000002, 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023849519999999999, 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.814 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86524 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:14.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632059+0000", 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632060+0000", 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632063+0000", 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9110000000000002e-06 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632066+0000", 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4590000000000001e-06 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655820+0000", 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023754614 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655858+0000", 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7818000000000003e-05 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655909+0000", 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0537000000000001e-05 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86525 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161467000000002, 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023959311, 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86525 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.819 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632068+0000", 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632069+0000", 2024-09-11T05:24:14.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.28e-07 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632073+0000", 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7849999999999999e-06 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632077+0000", 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1159999999999999e-06 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632079+0000", 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.441e-06 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655936+0000", 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023857142000000001 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.655976+0000", 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0272999999999999e-05 2024-09-11T05:24:14.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656028+0000", 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1326000000000003e-05 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86526 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 154624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161453117999997, 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024055330999999999, 2024-09-11T05:24:14.823 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86526 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:14.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632082+0000", 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632083+0000", 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632087+0000", 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632089+0000", 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5179999999999999e-06 2024-09-11T05:24:14.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656049+0000", 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023960170999999999 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656088+0000", 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9103000000000002e-05 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656138+0000", 2024-09-11T05:24:14.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9291e-05 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86527 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 162816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161443551000005, 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024156868000000001, 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.828 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86527 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632092+0000", 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632093+0000", 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4499999999999995e-07 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632098+0000", 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5510000000000001e-06 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632102+0000", 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656158+0000", 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024056351 2024-09-11T05:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656197+0000", 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9081000000000001e-05 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656249+0000", 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1224999999999998e-05 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86528 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161427720999995, 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024249340000000001, 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86528 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632108+0000", 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1899999999999998e-07 2024-09-11T05:24:14.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632110+0000", 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.821e-06 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632116+0000", 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632121+0000", 2024-09-11T05:24:14.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656269+0000", 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024148685999999999 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656307+0000", 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7660000000000002e-05 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656357+0000", 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86529 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.837 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161401963000003, 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024334995000000002, 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86529 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632133+0000", 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632134+0000", 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:24:14.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632136+0000", 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632143+0000", 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8229999999999997e-06 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632148+0000", 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656380+0000", 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024232231 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656418+0000", 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8439000000000002e-05 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656468+0000", 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0214999999999999e-05 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86530 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 195584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161373306000002, 2024-09-11T05:24:14.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024413870000000001, 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86530 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632162+0000", 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632169+0000", 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632174+0000", 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632182+0000", 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6330000000000002e-06 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656488+0000", 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024305887000000002 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656527+0000", 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8578000000000002e-05 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656576+0000", 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9143e-05 2024-09-11T05:24:14.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86531 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 187392~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161348473000004, 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024499086999999999, 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.847 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86531 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:14.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632187+0000", 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632191+0000", 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.126e-06 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632196+0000", 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5090000000000004e-06 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632201+0000", 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1919999999999996e-06 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656598+0000", 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024396596 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656635+0000", 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7761e-05 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656686+0000", 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0578999999999998e-05 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.851 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86532 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 203776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161330921000001, 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024591406999999999, 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86532 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632204+0000", 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632205+0000", 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:24:14.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632206+0000", 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632209+0000", 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.326e-06 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632212+0000", 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656708+0000", 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024496637000000002 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656746+0000", 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8306999999999998e-05 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656796+0000", 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9400000000000001e-05 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86533 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161320950999993, 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024696059999999999, 2024-09-11T05:24:14.856 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86533 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632214+0000", 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632215+0000", 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632216+0000", 2024-09-11T05:24:14.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632219+0000", 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632222+0000", 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4600000000000002e-06 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656818+0000", 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024596138 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656856+0000", 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8408000000000002e-05 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656910+0000", 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4292999999999997e-05 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.860 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86534 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161310763000003, 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02480504, 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.861 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86534 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632225+0000", 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632226+0000", 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4399999999999998e-07 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632229+0000", 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.942e-06 2024-09-11T05:24:14.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632231+0000", 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4360000000000001e-06 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656942+0000", 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024710438000000001 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.656980+0000", 2024-09-11T05:24:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7931e-05 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657030+0000", 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0130000000000003e-05 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86535 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:14.865 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161301424000001, 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024915386000000001, 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86535 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:14.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632234+0000", 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632235+0000", 2024-09-11T05:24:14.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8200000000000008e-07 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632238+0000", 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.83e-06 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632240+0000", 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3290000000000001e-06 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657054+0000", 2024-09-11T05:24:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0248138 2024-09-11T05:24:14.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657096+0000", 2024-09-11T05:24:14.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2070999999999998e-05 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657149+0000", 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3170000000000001e-05 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86536 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 228352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161292263999997, 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025018902999999999, 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86536 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632243+0000", 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.04e-07 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632244+0000", 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632247+0000", 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632250+0000", 2024-09-11T05:24:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:24:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657175+0000", 2024-09-11T05:24:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.024925808000000001 2024-09-11T05:24:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657213+0000", 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7533000000000001e-05 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657262+0000", 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.914e-05 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86537 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 244736~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161281070000001, 2024-09-11T05:24:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.02512553, 2024-09-11T05:24:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86537 2024-09-11T05:24:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632254+0000", 2024-09-11T05:24:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632255+0000", 2024-09-11T05:24:14.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:24:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632260+0000", 2024-09-11T05:24:14.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8199999999999996e-06 2024-09-11T05:24:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632266+0000", 2024-09-11T05:24:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9519999999999999e-06 2024-09-11T05:24:14.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632271+0000", 2024-09-11T05:24:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.361e-06 2024-09-11T05:24:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657285+0000", 2024-09-11T05:24:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025013603999999998 2024-09-11T05:24:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657325+0000", 2024-09-11T05:24:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0898e-05 2024-09-11T05:24:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657380+0000", 2024-09-11T05:24:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4400000000000001e-05 2024-09-11T05:24:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86538 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 252928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161257129000006, 2024-09-11T05:24:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025213757999999999, 2024-09-11T05:24:14.891 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.892 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86538 2024-09-11T05:24:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632278+0000", 2024-09-11T05:24:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632279+0000", 2024-09-11T05:24:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:24:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632280+0000", 2024-09-11T05:24:14.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.505e-06 2024-09-11T05:24:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632284+0000", 2024-09-11T05:24:14.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1910000000000002e-06 2024-09-11T05:24:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632287+0000", 2024-09-11T05:24:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7470000000000001e-06 2024-09-11T05:24:14.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657405+0000", 2024-09-11T05:24:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025117901000000002 2024-09-11T05:24:14.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657442+0000", 2024-09-11T05:24:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7129000000000003e-05 2024-09-11T05:24:14.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657492+0000", 2024-09-11T05:24:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9994000000000003e-05 2024-09-11T05:24:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.901 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:86539 3.11 3:891e3b25:::rbd_data.11798e1cec5d.000000000000003e:25 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-11T05:24:14.902 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 85.161245512999997, 2024-09-11T05:24:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025316088, 2024-09-11T05:24:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:14.903 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 86539 2024-09-11T05:24:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632290+0000", 2024-09-11T05:24:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:24:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632291+0000", 2024-09-11T05:24:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0470000000000001e-06 2024-09-11T05:24:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:14.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632294+0000", 2024-09-11T05:24:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:24:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.632301+0000", 2024-09-11T05:24:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6239999999999996e-06 2024-09-11T05:24:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657511+0000", 2024-09-11T05:24:14.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.025209928 2024-09-11T05:24:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657552+0000", 2024-09-11T05:24:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1118999999999997e-05 2024-09-11T05:24:14.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:22:49.657606+0000", 2024-09-11T05:24:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4097000000000001e-05 2024-09-11T05:24:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.912 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:14.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:14.913 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:14.915 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:24:15.019 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:15.019 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:15.019 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:15.019 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:15.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:24:15.131 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-11T05:24:15.132 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-11T05:24:15.132 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:15.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:24:15.247 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:15.247 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-11T05:24:15.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-11T05:24:15.247 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-11T05:24:15.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:134963 3.13 3:c9458f8f:::rbd_object_map.1179d2968232.0000000000000032:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.59913925, 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76893172499999995, 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 134963 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646343+0000", 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646345+0000", 2024-09-11T05:24:15.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2699999999999999e-06 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646349+0000", 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9670000000000003e-06 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646356+0000", 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5900000000000002e-06 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646360+0000", 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2640000000000002e-06 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646409+0000", 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8202999999999999e-05 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:16.646419+0000", 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0715e-05 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414769+0000", 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76834931100000003 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.414907+0000", 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000138181 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.415275+0000", 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000368224 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4213.0:8 3.11 3:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.684480639, 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.856796153, 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.253 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4213", 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.153:0/1769947648", 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 8 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561002+0000", 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561004+0000", 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.903e-06 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561013+0000", 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8680000000000005e-06 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561027+0000", 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4517e-05 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561036+0000", 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9930000000000001e-06 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561089+0000", 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2682999999999997e-05 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.561095+0000", 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9290000000000003e-06 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417710+0000", 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.85661471 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.417798+0000", 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8549999999999998e-05 2024-09-11T05:24:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136018 3.11 3:89696401:::rbd_data.11798e9b496a.000000000000002e:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.588097265999998, 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76087698100000001, 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.258 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136018 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657385+0000", 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657386+0000", 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657403+0000", 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6932e-05 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657411+0000", 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6449999999999994e-06 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657417+0000", 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8409999999999996e-06 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657495+0000", 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7887999999999997e-05 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657502+0000", 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3900000000000004e-06 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418191+0000", 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76068890300000003 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418262+0000", 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0982999999999994e-05 2024-09-11T05:24:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136028 3.11 3:88f130b7:::rbd_data.11798e9b496a.0000000000000038:head [sparse-read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.58794177, 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76085595699999997, 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136028 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657541+0000", 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657543+0000", 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.154e-06 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657549+0000", 2024-09-11T05:24:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657554+0000", 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657662+0000", 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107963 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.657669+0000", 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0439999999999998e-06 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418294+0000", 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.76062516999999996 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418397+0000", 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102742 2024-09-11T05:24:15.267 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136169 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 0~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.585135289999997, 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75821662300000003, 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.268 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136169 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660347+0000", 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660348+0000", 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660350+0000", 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.007e-06 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660356+0000", 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6390000000000003e-06 2024-09-11T05:24:15.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660362+0000", 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660882+0000", 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00052048600000000002 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660889+0000", 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0469999999999996e-06 2024-09-11T05:24:15.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418413+0000", 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75752385200000005 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418499+0000", 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6225999999999997e-05 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418564+0000", 2024-09-11T05:24:15.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4771999999999996e-05 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136170 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 90112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.585109926000001, 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75837728599999998, 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.273 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136170 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660373+0000", 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7e-07 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660375+0000", 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.407e-06 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660383+0000", 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1300000000000003e-06 2024-09-11T05:24:15.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660388+0000", 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1610000000000002e-06 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660915+0000", 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000527674 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660928+0000", 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2373e-05 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418595+0000", 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75766750599999999 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418677+0000", 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1358000000000003e-05 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418750+0000", 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3306999999999995e-05 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136171 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.585087899000001, 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75850936599999996, 2024-09-11T05:24:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136171 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.279 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660395+0000", 2024-09-11T05:24:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.72e-07 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660397+0000", 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1579999999999999e-06 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660403+0000", 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7080000000000002e-06 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660407+0000", 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.425e-06 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660949+0000", 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054203699999999999 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.660955+0000", 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:24:15.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418777+0000", 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.757821984 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418823+0000", 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5775999999999997e-05 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418904+0000", 2024-09-11T05:24:15.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1376000000000002e-05 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136280 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 73728~3694] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.582606550000001, 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75624342200000005, 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.284 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136280 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662876+0000", 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662879+0000", 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.52e-06 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662886+0000", 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662891+0000", 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1529999999999996e-06 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662992+0000", 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100846 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663000+0000", 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2120000000000003e-06 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.418942+0000", 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75594229899999998 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419020+0000", 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7377000000000001e-05 2024-09-11T05:24:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419120+0000", 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9998e-05 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136281 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 163840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.582580151000002, 2024-09-11T05:24:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644070299999999, 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136281 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662902+0000", 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662903+0000", 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662909+0000", 2024-09-11T05:24:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.105e-06 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662916+0000", 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4760000000000001e-06 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662929+0000", 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2445e-05 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663025+0000", 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6557000000000004e-05 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663032+0000", 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0979999999999999e-06 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419153+0000", 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75612093199999997 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419258+0000", 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105084 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419343+0000", 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5578e-05 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136282 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 253952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.582544962, 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75658832799999998, 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136282 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662938+0000", 2024-09-11T05:24:15.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662941+0000", 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662947+0000", 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662953+0000", 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.327e-06 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663066+0000", 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000113473 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663080+0000", 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3573e-05 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419389+0000", 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75630961699999999 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419461+0000", 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2045000000000006e-05 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419526+0000", 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4519999999999999e-05 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136299 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 24576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.582523162999998, 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75671071700000003, 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136299 2024-09-11T05:24:15.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662959+0000", 2024-09-11T05:24:15.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662960+0000", 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662962+0000", 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0540000000000002e-06 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662969+0000", 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662974+0000", 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663105+0000", 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013167300000000001 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663112+0000", 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419557+0000", 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75644508300000002 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419615+0000", 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8316999999999997e-05 2024-09-11T05:24:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419670+0000", 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5248999999999999e-05 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136300 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.582501833999999, 2024-09-11T05:24:15.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.756862586, 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136300 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662981+0000", 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.15e-07 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662983+0000", 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0600000000000002e-06 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662990+0000", 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5549999999999999e-06 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.662995+0000", 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663136+0000", 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014056999999999999 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663142+0000", 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419699+0000", 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75655736100000004 2024-09-11T05:24:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419775+0000", 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6217999999999994e-05 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419843+0000", 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8103999999999997e-05 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136301 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.582481115, 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75695448399999998, 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136301 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663002+0000", 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.91e-07 2024-09-11T05:24:15.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663004+0000", 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663010+0000", 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663016+0000", 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2400000000000004e-06 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663165+0000", 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014903299999999999 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.663171+0000", 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419869+0000", 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75669725399999999 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419913+0000", 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4768000000000002e-05 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419956+0000", 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2672000000000001e-05 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.315 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136333 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 40960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.578217271, 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75288796300000005, 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136333 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667265+0000", 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667266+0000", 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9899999999999999e-07 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667271+0000", 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6820000000000002e-06 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667285+0000", 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4137e-05 2024-09-11T05:24:15.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667293+0000", 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9470000000000003e-06 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667349+0000", 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6382000000000003e-05 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0849999999999999e-05 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.419987+0000", 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75262663600000002 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420064+0000", 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6607999999999996e-05 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420153+0000", 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9821999999999995e-05 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136335 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 131072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.578171580000003, 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295849100000001, 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.321 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136335 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667311+0000", 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667312+0000", 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667314+0000", 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.616e-06 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667321+0000", 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2749999999999998e-06 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667327+0000", 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4709999999999998e-06 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667393+0000", 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6297000000000006e-05 2024-09-11T05:24:15.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667401+0000", 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6809999999999998e-06 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420179+0000", 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75277844599999999 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420227+0000", 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7528999999999998e-05 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420270+0000", 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2688999999999997e-05 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136337 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:15.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.578131642000002, 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309504100000002, 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136337 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667351+0000", 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8800000000000003e-07 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667353+0000", 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.917e-06 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667360+0000", 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667365+0000", 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667425+0000", 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9744000000000003e-05 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667433+0000", 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7440000000000007e-06 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420301+0000", 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75286792400000002 2024-09-11T05:24:15.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420378+0000", 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7188999999999996e-05 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420446+0000", 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8164000000000007e-05 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136385 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 8192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.577929236999999, 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75301497500000003, 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136385 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667553+0000", 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667554+0000", 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:24:15.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667556+0000", 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0320000000000002e-06 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667561+0000", 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7270000000000004e-06 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667567+0000", 2024-09-11T05:24:15.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0520000000000001e-06 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667606+0000", 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9084000000000001e-05 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667613+0000", 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420470+0000", 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75285739900000004 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420516+0000", 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6109000000000002e-05 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420568+0000", 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2169999999999997e-05 2024-09-11T05:24:15.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136386 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 98304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.577906366999997, 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75316376200000001, 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.337 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136386 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667576+0000", 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.338 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667577+0000", 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667579+0000", 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667585+0000", 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0719999999999996e-06 2024-09-11T05:24:15.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667590+0000", 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667637+0000", 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.689e-05 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667642+0000", 2024-09-11T05:24:15.340 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7470000000000002e-06 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420598+0000", 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75295535000000002 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420673+0000", 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5168999999999998e-05 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420740+0000", 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7106000000000004e-05 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136387 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.577886732000003, 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.753252213, 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136387 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667596+0000", 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667598+0000", 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.024e-06 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667604+0000", 2024-09-11T05:24:15.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8239999999999996e-06 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667610+0000", 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7810000000000002e-06 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667666+0000", 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6115000000000001e-05 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.667673+0000", 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420765+0000", 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.75309192700000005 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420808+0000", 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.295e-05 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.420848+0000", 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0466999999999997e-05 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4473.0:136770 3.11 3:88f02d75:::rbd_data.1179d20f522d.000000000000009d:30 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108)", 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.570994286000001, 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.746837105, 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-11T05:24:15.347 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4473", 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 136770 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-11T05:24:15.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674488+0000", 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674489+0000", 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5599999999999995e-07 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674491+0000", 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.057e-06 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674497+0000", 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674502+0000", 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0069999999999997e-06 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674552+0000", 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9688000000000003e-05 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:17.674557+0000", 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421181+0000", 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.74662347299999998 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421256+0000", 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5474000000000003e-05 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-11T05:24:15.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-11T05:23:18.421325+0000", 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9263000000000004e-05 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-11T05:24:15.352 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:15.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:24:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: "num_ops": 0 2024-09-11T05:24:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:15.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:24:15.533 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-11T05:24:15.534 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-09-11T05:24:15.534 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T05:24:15.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T05:24:15.537 INFO:tasks.ceph.osd.5:Started 2024-09-11T05:24:15.537 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:24:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:nodeep-scrub is unset 2024-09-11T05:24:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:15.584 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [], 2024-09-11T05:24:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: "complaint_time": 30, 2024-09-11T05:24:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: "num_blocked_ops": 0 2024-09-11T05:24:15.585 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:15.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:no valid command found; 10 closest matches: 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:0 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:1 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:abort 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:assert 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:config diff 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:config diff get 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:config get 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:config help [] 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:config set ... 2024-09-11T05:24:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:admin_socket: invalid command 2024-09-11T05:24:15.640 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T05:24:15.640 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-11T05:24:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "size": 20, 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 600, 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "ops": [ 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:118316 3.9 3.1f6c6249 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 79.202651799999998, 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86954671900000002, 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "reached pg", 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 118316 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538768+0000", 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538770+0000", 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.435e-06 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538776+0000", 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538783+0000", 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.538790+0000", 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.7850000000000003e-06 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.541993+0000", 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0032024750000000002 2024-09-11T05:24:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for peered", 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:56.542003+0000", 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.0421999999999999e-05 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408294+0000", 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.86629060499999999 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:22:57.408315+0000", 2024-09-11T05:24:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1375000000000001e-05 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:125325 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 71.551822430000001, 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.017460036000000002, 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 125325 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189598+0000", 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189599+0000", 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3880000000000001e-06 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189606+0000", 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.075e-06 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189621+0000", 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.5016e-05 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189630+0000", 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.0499999999999997e-06 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189682+0000", 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.1233000000000002e-05 2024-09-11T05:24:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.189737+0000", 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.5037000000000002e-05 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "waiting for subops from 6", 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.192891+0000", 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.0031540779999999998 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206978+0000", 2024-09-11T05:24:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014087799 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "op_commit", 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.206992+0000", 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.399e-05 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "commit_sent", 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207026+0000", 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3249e-05 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.207058+0000", 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.2121e-05 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126084 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 884736~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.894196543999996, 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010687087, 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126084 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847224+0000", 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847226+0000", 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3309999999999998e-06 2024-09-11T05:24:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847234+0000", 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3309999999999998e-06 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847240+0000", 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.421e-06 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857715+0000", 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010474406 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857799+0000", 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3955000000000005e-05 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857911+0000", 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000112217 2024-09-11T05:24:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126085 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 909312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.894171474000004, 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010874139999999999, 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126085 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847249+0000", 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847251+0000", 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.0870000000000001e-06 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847260+0000", 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8990000000000007e-06 2024-09-11T05:24:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847269+0000", 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.7790000000000001e-06 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.857950+0000", 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010681357000000001 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858025+0000", 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.4473000000000003e-05 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858123+0000", 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8109999999999994e-05 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126086 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 933888~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.894143361999994, 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011083216, 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126086 2024-09-11T05:24:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847277+0000", 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847279+0000", 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.154e-06 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847288+0000", 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5920000000000001e-06 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847294+0000", 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.392e-06 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858166+0000", 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010871331999999999 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858249+0000", 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.3542999999999996e-05 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858360+0000", 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000110784 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126087 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 958464~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.894117094999999, 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011276604000000001, 2024-09-11T05:24:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126087 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847303+0000", 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847304+0000", 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4199999999999995e-07 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847306+0000", 2024-09-11T05:24:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.3470000000000001e-06 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847319+0000", 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.3247e-05 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847325+0000", 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.3850000000000001e-06 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858400+0000", 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011075026999999999 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858475+0000", 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.504e-05 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858580+0000", 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000104916 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126088 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 983040~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.894085464, 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011480812, 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126088 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847335+0000", 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.7100000000000002e-07 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847338+0000", 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.458e-06 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847347+0000", 2024-09-11T05:24:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.8789999999999992e-06 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847352+0000", 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858622+0000", 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011269664 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858707+0000", 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.4919000000000005e-05 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858816+0000", 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000109038 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126089 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1007616~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.894061006000001, 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011670534, 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126089 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847359+0000", 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847360+0000", 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847362+0000", 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847371+0000", 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7739999999999999e-06 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847378+0000", 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6939999999999998e-06 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858855+0000", 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011477129000000001 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.858935+0000", 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.9903999999999999e-05 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859030+0000", 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4500999999999995e-05 2024-09-11T05:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:126090 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 1032192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 70.894034532999996, 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011865518, 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 126090 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847386+0000", 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.08e-07 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847388+0000", 2024-09-11T05:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 2.328e-06 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847397+0000", 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.5620000000000004e-06 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.847403+0000", 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0079999999999999e-06 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859061+0000", 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011657712000000001 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859143+0000", 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.2336000000000006e-05 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:04.859251+0000", 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000108164 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129738 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 8192~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709675899999993, 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007517, 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129738 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031744+0000", 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031745+0000", 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031747+0000", 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8640000000000001e-06 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031753+0000", 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3940000000000001e-06 2024-09-11T05:24:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031758+0000", 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0579999999999997e-06 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042429+0000", 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.010671514 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042535+0000", 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000105175 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042752+0000", 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000217161 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129739 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 32768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709655749999996, 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011329525999999999, 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129739 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031764+0000", 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031765+0000", 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.77e-07 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031767+0000", 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.81e-06 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031773+0000", 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.6900000000000003e-06 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031778+0000", 2024-09-11T05:24:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9320000000000004e-06 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042786+0000", 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011007747 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.042883+0000", 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.7077000000000006e-05 2024-09-11T05:24:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043094+0000", 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000210893 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129740 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709635731000006, 2024-09-11T05:24:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011667982, 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129740 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031784+0000", 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031785+0000", 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031787+0000", 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.855e-06 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031793+0000", 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031798+0000", 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043125+0000", 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011327258999999999 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043222+0000", 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.6779000000000003e-05 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043452+0000", 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023058700000000001 2024-09-11T05:24:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129741 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 81920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709615979999995, 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01201903, 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129741 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031804+0000", 2024-09-11T05:24:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031805+0000", 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031807+0000", 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.9300000000000002e-06 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031813+0000", 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.4339999999999997e-06 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031818+0000", 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.8999999999999997e-06 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043494+0000", 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.011675767 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043588+0000", 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.4171000000000004e-05 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043823+0000", 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00023544700000000001 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129742 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 106496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709596599999998, 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012420089, 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129742 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031824+0000", 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:24:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031826+0000", 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7099999999999999e-06 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031832+0000", 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.161e-06 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031836+0000", 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.566e-06 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043859+0000", 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012022870999999999 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.043967+0000", 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000107835 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044244+0000", 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00027658700000000001 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129743 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 131072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709578553, 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012807277000000001, 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129743 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031842+0000", 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031844+0000", 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031850+0000", 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.1290000000000001e-06 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031854+0000", 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.5979999999999999e-06 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044281+0000", 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012426232000000001 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044394+0000", 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000113684 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044649+0000", 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00025452100000000001 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129744 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 155648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709560365000002, 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013159808, 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129744 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031860+0000", 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.39e-07 2024-09-11T05:24:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031862+0000", 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.7060000000000001e-06 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031868+0000", 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.2169999999999999e-06 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031873+0000", 2024-09-11T05:24:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.7929999999999997e-06 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044716+0000", 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.012843105 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.044829+0000", 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00011315999999999999 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045020+0000", 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000190488 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129745 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 180224~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709541400999996, 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013521281, 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129745 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031879+0000", 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.5999999999999999e-07 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031881+0000", 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:24:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031888+0000", 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.3200000000000002e-06 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031893+0000", 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045058+0000", 2024-09-11T05:24:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013164495 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045158+0000", 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000100457 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045400+0000", 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000241921 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129746 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709521121999998, 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013818986, 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129746 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031899+0000", 2024-09-11T05:24:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031901+0000", 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.8530000000000001e-06 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031907+0000", 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.0410000000000003e-06 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031913+0000", 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045432+0000", 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013519700000000001 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045539+0000", 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000106308 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045718+0000", 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017928 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129747 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709484334999999, 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.01408527, 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129747 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031936+0000", 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031937+0000", 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.5000000000000002e-07 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031940+0000", 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 3.7450000000000001e-06 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031952+0000", 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 1.207e-05 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031959+0000", 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 6.9430000000000003e-06 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045751+0000", 2024-09-11T05:24:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.013791151 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.045849+0000", 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.8908999999999998e-05 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046021+0000", 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.000171702 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "description": "osd_op(client.4473.0:129748 3.13 3:ccedfa8f:::rbd_data.117966066e90.000000000000000a:2f [read 253952~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "initiated_at": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 66.709449163000002, 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014351014, 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "continuous": false, 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type_data": { 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flag_point": "started", 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client_info": { 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client": "client.4473", 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "client_addr": "172.21.15.12:0/388737218", 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tid": 129748 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: "events": [ 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "initiated", 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "header_read", 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031971+0000", 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "throttled", 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031972+0000", 2024-09-11T05:24:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "all_read", 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031980+0000", 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 8.0790000000000001e-06 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "dispatched", 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031987+0000", 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "queued_for_pg", 2024-09-11T05:24:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.031992+0000", 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 5.0529999999999997e-06 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "reached_pg", 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046052+0000", 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.014059752999999999 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "started", 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046151+0000", 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 9.9660999999999993e-05 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T05:24:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: "event": "done", 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: "time": "2024-09-11T05:23:09.046322+0000", 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: "duration": 0.00017073699999999999 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T05:24:15.839 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:16.960 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:24:16.959+0000 7f654bc0d640 -1 Falling back to public interface 2024-09-11T05:24:20.523 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:24:20.522+0000 7f654bc0d640 -1 osd.5 145 log_to_monitors true 2024-09-11T05:24:20.602 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-11T05:24:20.601+0000 7f653f419640 -1 osd.5 145 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:24:20.641 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:24:20.746 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-11T05:24:20.746 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-11T05:24:20.747 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-11T05:24:20.747 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-11T05:24:20.755 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-11T05:24:20.755 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-11T05:24:20.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-11T05:24:21.073 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T05:24:21.072+0000 7f4182606640 -1 mon.a@0(leader).osd e167 definitely_dead 0 2024-09-11T05:24:21.585 INFO:teuthology.orchestra.run.smithi012.stderr:marked in osd.4. 2024-09-11T05:24:21.608 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-11T05:24:21.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-11T05:24:21.728 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a: {} 2024-09-11T05:24:21.729 INFO:teuthology.orchestra.run.smithi012.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:24:21.739 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b: {} 2024-09-11T05:24:21.739 INFO:teuthology.orchestra.run.smithi012.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:24:21.747 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c: {} 2024-09-11T05:24:21.747 INFO:teuthology.orchestra.run.smithi012.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:24:21.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T05:24:22.424 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T05:24:22.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-11T05:24:23.427 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-11T05:24:23.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T05:24:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T05:24:24.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-11T05:24:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-11T05:24:25.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T05:24:26.434 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T05:24:26.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-11T05:24:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-11T05:24:27.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T05:24:28.612 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T05:24:28.629 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-11T05:24:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-11T05:24:29.629 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T05:24:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T05:24:30.638 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-11T05:24:31.627 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-11T05:24:31.645 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T05:24:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T05:24:32.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-11T05:24:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-11T05:24:33.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T05:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T05:24:34.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-11T05:24:35.654 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-11T05:24:35.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T05:24:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T05:24:36.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-11T05:24:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-11T05:24:37.687 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-11T05:24:37.688 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-11T05:24:37.688 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-11T05:24:37.688 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-11T05:24:37.688 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T05:24:37.688 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:24:37.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:37.984 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":184,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:24:37.661431+0000","last_up_change":"2024-09-11T05:24:21.584312+0000","last_in_change":"2024-09-11T05:24:21.584312+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:21:27.582783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:21:31.353652+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T05:21:41.109530+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":50,"snap_epoch":164,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6809","nonce":2997410357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6811","nonce":2997410357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6815","nonce":2997410357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6813","nonce":2997410357}]},"public_addr":"172.21.15.12:6809/2997410357","cluster_addr":"172.21.15.12:6811/2997410357","heartbeat_back_addr":"172.21.15.12:6815/2997410357","heartbeat_front_addr":"172.21.15.12:6813/2997410357","state":["exists","up"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6817","nonce":852655937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6819","nonce":852655937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6823","nonce":852655937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6821","nonce":852655937}]},"public_addr":"172.21.15.12:6817/852655937","cluster_addr":"172.21.15.12:6819/852655937","heartbeat_back_addr":"172.21.15.12:6823/852655937","heartbeat_front_addr":"172.21.15.12:6821/852655937","state":["exists","up"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":70,"up_from":87,"up_thru":170,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6825","nonce":2878270387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6827","nonce":2878270387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6831","nonce":2878270387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6829","nonce":2878270387}]},"public_addr":"172.21.15.12:6825/2878270387","cluster_addr":"172.21.15.12:6827/2878270387","heartbeat_back_addr":"172.21.15.12:6831/2878270387","heartbeat_front_addr":"172.21.15.12:6829/2878270387","state":["exists","up"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6801","nonce":2211289880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6803","nonce":2211289880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6807","nonce":2211289880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6805","nonce":2211289880}]},"public_addr":"172.21.15.12:6801/2211289880","cluster_addr":"172.21.15.12:6803/2211289880","heartbeat_back_addr":"172.21.15.12:6807/2211289880","heartbeat_front_addr":"172.21.15.12:6805/2211289880","state":["exists","up"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6801","nonce":1639325236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6803","nonce":1639325236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6807","nonce":1639325236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6805","nonce":1639325236}]},"public_addr":"172.21.15.153:6801/1639325236","cluster_addr":"172.21.15.153:6803/1639325236","heartbeat_back_addr":"172.21.15.153:6807/1639325236","heartbeat_front_addr":"172.21.15.153:6805/1639325236","state":["exists","up"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":145,"up_from":168,"up_thru":172,"down_at":146,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6817","nonce":44707044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6819","nonce":44707044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6823","nonce":44707044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6821","nonce":44707044}]},"public_addr":"172.21.15.153:6817/44707044","cluster_addr":"172.21.15.153:6819/44707044","heartbeat_back_addr":"172.21.15.153:6823/44707044","heartbeat_front_addr":"172.21.15.153:6821/44707044","state":["exists","up"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6827","nonce":1798055911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6829","nonce":1798055911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6833","nonce":1798055911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6831","nonce":1798055911}]},"public_addr":"172.21.15.153:6827/1798055911","cluster_addr":"172.21.15.153:6829/1798055911","heartbeat_back_addr":"172.21.15.153:6833/1798055911","heartbeat_front_addr":"172.21.15.153:6831/1798055911","state":["exists","up"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6809","nonce":1122624549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6811","nonce":1122624549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6815","nonce":1122624549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6813","nonce":1122624549}]},"public_addr":"172.21.15.153:6809/1122624549","cluster_addr":"172.21.15.153:6811/1122624549","heartbeat_back_addr":"172.21.15.153:6815/1122624549","heartbeat_front_addr":"172.21.15.153:6813/1122624549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.912439+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.788769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.857319+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.926699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.752975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.222079+0000","dead_epoch":146},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.095040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.860946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:24:37.998 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T05:24:37.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:24:38.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:38.287 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":184,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:24:37.661431+0000","last_up_change":"2024-09-11T05:24:21.584312+0000","last_in_change":"2024-09-11T05:24:21.584312+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:21:27.582783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:21:31.353652+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T05:21:41.109530+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":50,"snap_epoch":164,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6809","nonce":2997410357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6811","nonce":2997410357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6815","nonce":2997410357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6813","nonce":2997410357}]},"public_addr":"172.21.15.12:6809/2997410357","cluster_addr":"172.21.15.12:6811/2997410357","heartbeat_back_addr":"172.21.15.12:6815/2997410357","heartbeat_front_addr":"172.21.15.12:6813/2997410357","state":["exists","up"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6817","nonce":852655937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6819","nonce":852655937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6823","nonce":852655937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6821","nonce":852655937}]},"public_addr":"172.21.15.12:6817/852655937","cluster_addr":"172.21.15.12:6819/852655937","heartbeat_back_addr":"172.21.15.12:6823/852655937","heartbeat_front_addr":"172.21.15.12:6821/852655937","state":["exists","up"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":70,"up_from":87,"up_thru":170,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6825","nonce":2878270387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6827","nonce":2878270387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6831","nonce":2878270387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6829","nonce":2878270387}]},"public_addr":"172.21.15.12:6825/2878270387","cluster_addr":"172.21.15.12:6827/2878270387","heartbeat_back_addr":"172.21.15.12:6831/2878270387","heartbeat_front_addr":"172.21.15.12:6829/2878270387","state":["exists","up"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6801","nonce":2211289880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6803","nonce":2211289880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6807","nonce":2211289880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6805","nonce":2211289880}]},"public_addr":"172.21.15.12:6801/2211289880","cluster_addr":"172.21.15.12:6803/2211289880","heartbeat_back_addr":"172.21.15.12:6807/2211289880","heartbeat_front_addr":"172.21.15.12:6805/2211289880","state":["exists","up"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6801","nonce":1639325236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6803","nonce":1639325236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6807","nonce":1639325236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6805","nonce":1639325236}]},"public_addr":"172.21.15.153:6801/1639325236","cluster_addr":"172.21.15.153:6803/1639325236","heartbeat_back_addr":"172.21.15.153:6807/1639325236","heartbeat_front_addr":"172.21.15.153:6805/1639325236","state":["exists","up"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":145,"up_from":168,"up_thru":172,"down_at":146,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6817","nonce":44707044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6819","nonce":44707044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6823","nonce":44707044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6821","nonce":44707044}]},"public_addr":"172.21.15.153:6817/44707044","cluster_addr":"172.21.15.153:6819/44707044","heartbeat_back_addr":"172.21.15.153:6823/44707044","heartbeat_front_addr":"172.21.15.153:6821/44707044","state":["exists","up"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6827","nonce":1798055911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6829","nonce":1798055911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6833","nonce":1798055911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6831","nonce":1798055911}]},"public_addr":"172.21.15.153:6827/1798055911","cluster_addr":"172.21.15.153:6829/1798055911","heartbeat_back_addr":"172.21.15.153:6833/1798055911","heartbeat_front_addr":"172.21.15.153:6831/1798055911","state":["exists","up"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6809","nonce":1122624549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6811","nonce":1122624549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6815","nonce":1122624549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6813","nonce":1122624549}]},"public_addr":"172.21.15.153:6809/1122624549","cluster_addr":"172.21.15.153:6811/1122624549","heartbeat_back_addr":"172.21.15.153:6815/1122624549","heartbeat_front_addr":"172.21.15.153:6813/1122624549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.912439+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.788769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.857319+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.926699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.752975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.222079+0000","dead_epoch":146},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.095040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.860946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:24:38.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T05:24:38.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T05:24:38.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T05:24:38.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T05:24:38.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T05:24:38.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T05:24:38.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T05:24:38.303 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T05:24:38.551 INFO:teuthology.orchestra.run.smithi012.stdout:55834574891 2024-09-11T05:24:38.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:24:38.556 INFO:teuthology.orchestra.run.smithi012.stdout:55834574891 2024-09-11T05:24:38.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:24:38.559 INFO:teuthology.orchestra.run.smithi012.stdout:55834574892 2024-09-11T05:24:38.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:24:38.561 INFO:teuthology.orchestra.run.smithi012.stdout:373662154774 2024-09-11T05:24:38.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:24:38.561 INFO:teuthology.orchestra.run.smithi012.stdout:55834574890 2024-09-11T05:24:38.562 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:24:38.563 INFO:teuthology.orchestra.run.smithi012.stdout:55834574893 2024-09-11T05:24:38.563 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:24:38.564 INFO:teuthology.orchestra.run.smithi012.stdout:721554505733 2024-09-11T05:24:38.564 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:24:38.565 INFO:teuthology.orchestra.run.smithi012.stdout:55834574890 2024-09-11T05:24:38.565 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:24:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:55834574890 2024-09-11T05:24:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:55834574890 2024-09-11T05:24:39.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.7 2024-09-11T05:24:39.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.3 2024-09-11T05:24:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:55834574889 2024-09-11T05:24:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:55834574892 2024-09-11T05:24:39.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574890 got 55834574889 for osd.4 2024-09-11T05:24:39.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.6 2024-09-11T05:24:39.218 INFO:teuthology.orchestra.run.smithi012.stdout:373662154773 2024-09-11T05:24:39.220 INFO:teuthology.orchestra.run.smithi012.stdout:721554505732 2024-09-11T05:24:39.228 INFO:teuthology.orchestra.run.smithi012.stdout:55834574891 2024-09-11T05:24:39.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 373662154774 got 373662154773 for osd.2 2024-09-11T05:24:39.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 721554505733 got 721554505732 for osd.5 2024-09-11T05:24:39.237 INFO:teuthology.orchestra.run.smithi012.stdout:55834574889 2024-09-11T05:24:39.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.1 2024-09-11T05:24:39.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574890 got 55834574889 for osd.0 2024-09-11T05:24:40.151 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:24:40.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:24:40.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:24:40.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:24:40.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:24:40.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:24:40.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:24:40.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:24:40.705 INFO:teuthology.orchestra.run.smithi012.stdout:55834574891 2024-09-11T05:24:40.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.7 2024-09-11T05:24:40.722 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.750 INFO:teuthology.orchestra.run.smithi012.stdout:55834574891 2024-09-11T05:24:40.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.3 2024-09-11T05:24:40.769 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.772 INFO:teuthology.orchestra.run.smithi012.stdout:55834574893 2024-09-11T05:24:40.782 INFO:teuthology.orchestra.run.smithi012.stdout:55834574890 2024-09-11T05:24:40.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.6 2024-09-11T05:24:40.787 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574890 got 55834574890 for osd.4 2024-09-11T05:24:40.799 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.813 INFO:teuthology.orchestra.run.smithi012.stdout:721554505733 2024-09-11T05:24:40.824 INFO:teuthology.orchestra.run.smithi012.stdout:55834574892 2024-09-11T05:24:40.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 721554505733 got 721554505733 for osd.5 2024-09-11T05:24:40.826 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.1 2024-09-11T05:24:40.837 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.849 INFO:teuthology.orchestra.run.smithi012.stdout:373662154774 2024-09-11T05:24:40.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 373662154774 got 373662154774 for osd.2 2024-09-11T05:24:40.864 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.877 INFO:teuthology.orchestra.run.smithi012.stdout:55834574890 2024-09-11T05:24:40.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574890 got 55834574890 for osd.0 2024-09-11T05:24:40.890 DEBUG:teuthology.parallel:result is None 2024-09-11T05:24:40.890 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T05:24:40.890 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:24:41.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:24:41.232 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-09-11T05:24:39.570889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1187,"num_object_clones":0,"num_object_copies":2374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":1179,"num_read":192672,"num_read_kb":678157,"num_write":21801,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8815,"num_bytes_recovered":209862272,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20130,"ondisk_log_size":20130,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400436,"kb_used_data":18436,"kb_used_omap":51,"kb_used_meta":381772,"kb_avail":754574284,"statfs":{"total":773094113280,"available":772684066816,"internally_reserved":0,"allocated":18878464,"data_stored":9768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52761,"internal_metadata":390935015},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.926098"},"pg_stats":[{"pgid":"3.1f","version":"169'752","reported_seq":4310,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318457+0000","last_change":"2024-09-11T05:24:22.519402+0000","last_active":"2024-09-11T05:24:38.318457+0000","last_peered":"2024-09-11T05:24:38.318457+0000","last_clean":"2024-09-11T05:24:38.318457+0000","last_became_active":"2024-09-11T05:24:22.436523+0000","last_became_peered":"2024-09-11T05:24:22.436523+0000","last_unstale":"2024-09-11T05:24:38.318457+0000","last_undegraded":"2024-09-11T05:24:38.318457+0000","last_fullsized":"2024-09-11T05:24:38.318457+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:20.159237+0000","scrub_duration":0,"objects_trimmed":18,"snaptrim_duration":0.027684375000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":5366,"num_read_kb":22197,"num_write":753,"num_write_kb":10362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'621","reported_seq":7378,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670313+0000","last_change":"2024-09-11T05:24:13.538318+0000","last_active":"2024-09-11T05:24:37.670313+0000","last_peered":"2024-09-11T05:24:37.670313+0000","last_clean":"2024-09-11T05:24:37.670313+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:24:37.670313+0000","last_undegraded":"2024-09-11T05:24:37.670313+0000","last_fullsized":"2024-09-11T05:24:37.670313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:32.438221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020765789999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":8377,"num_read_kb":25107,"num_write":672,"num_write_kb":13431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"172'633","reported_seq":4787,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315480+0000","last_change":"2024-09-11T05:24:25.459113+0000","last_active":"2024-09-11T05:24:38.315480+0000","last_peered":"2024-09-11T05:24:38.315480+0000","last_clean":"2024-09-11T05:24:38.315480+0000","last_became_active":"2024-09-11T05:24:25.432325+0000","last_became_peered":"2024-09-11T05:24:25.432325+0000","last_unstale":"2024-09-11T05:24:38.315480+0000","last_undegraded":"2024-09-11T05:24:38.315480+0000","last_fullsized":"2024-09-11T05:24:38.315480+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:28.213667+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.024392765,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":4840,"num_read_kb":11502,"num_write":711,"num_write_kb":4822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":477,"num_bytes_recovered":9769435,"num_keys_recovered":57,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'749","reported_seq":6083,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315453+0000","last_change":"2024-09-11T05:24:26.471523+0000","last_active":"2024-09-11T05:24:38.315453+0000","last_peered":"2024-09-11T05:24:38.315453+0000","last_clean":"2024-09-11T05:24:38.315453+0000","last_became_active":"2024-09-11T05:24:26.439136+0000","last_became_peered":"2024-09-11T05:24:26.439136+0000","last_unstale":"2024-09-11T05:24:38.315453+0000","last_undegraded":"2024-09-11T05:24:38.315453+0000","last_fullsized":"2024-09-11T05:24:38.315453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:21.492643+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.029901693999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":6111,"num_read_kb":17930,"num_write":835,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":481,"num_bytes_recovered":10267580,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"163'783","reported_seq":5357,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318870+0000","last_change":"2024-09-11T05:24:26.444002+0000","last_active":"2024-09-11T05:24:38.318870+0000","last_peered":"2024-09-11T05:24:38.318870+0000","last_clean":"2024-09-11T05:24:38.318870+0000","last_became_active":"2024-09-11T05:24:26.442532+0000","last_became_peered":"2024-09-11T05:24:26.442532+0000","last_unstale":"2024-09-11T05:24:38.318870+0000","last_undegraded":"2024-09-11T05:24:38.318870+0000","last_fullsized":"2024-09-11T05:24:38.318870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:30.869953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079803399999999998,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":4582,"num_read_kb":11922,"num_write":924,"num_write_kb":11555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":637,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'307","reported_seq":7021,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315773+0000","last_change":"2024-09-11T05:24:25.441145+0000","last_active":"2024-09-11T05:24:38.315773+0000","last_peered":"2024-09-11T05:24:38.315773+0000","last_clean":"2024-09-11T05:24:38.315773+0000","last_became_active":"2024-09-11T05:24:25.439785+0000","last_became_peered":"2024-09-11T05:24:25.439785+0000","last_unstale":"2024-09-11T05:24:38.315773+0000","last_undegraded":"2024-09-11T05:24:38.315773+0000","last_fullsized":"2024-09-11T05:24:38.315773+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:35.897346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040559979999999999,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5755,"num_read_kb":39037,"num_write":265,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":15189092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'305","reported_seq":3881,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668713+0000","last_change":"2024-09-11T05:24:13.535934+0000","last_active":"2024-09-11T05:24:37.668713+0000","last_peered":"2024-09-11T05:24:37.668713+0000","last_clean":"2024-09-11T05:24:37.668713+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:24:37.668713+0000","last_undegraded":"2024-09-11T05:24:37.668713+0000","last_fullsized":"2024-09-11T05:24:37.668713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:37:15.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015515279999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":3067,"num_read_kb":14648,"num_write":273,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"164'847","reported_seq":12059,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670134+0000","last_change":"2024-09-11T05:24:13.535051+0000","last_active":"2024-09-11T05:24:37.670134+0000","last_peered":"2024-09-11T05:24:37.670134+0000","last_clean":"2024-09-11T05:24:37.670134+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:24:37.670134+0000","last_undegraded":"2024-09-11T05:24:37.670134+0000","last_fullsized":"2024-09-11T05:24:37.670134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:45.776994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077435600000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":14340,"num_read_kb":34884,"num_write":1189,"num_write_kb":15897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"169'690","reported_seq":5096,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318554+0000","last_change":"2024-09-11T05:24:24.434881+0000","last_active":"2024-09-11T05:24:38.318554+0000","last_peered":"2024-09-11T05:24:38.318554+0000","last_clean":"2024-09-11T05:24:38.318554+0000","last_became_active":"2024-09-11T05:24:24.433017+0000","last_became_peered":"2024-09-11T05:24:24.433017+0000","last_unstale":"2024-09-11T05:24:38.318554+0000","last_undegraded":"2024-09-11T05:24:38.318554+0000","last_fullsized":"2024-09-11T05:24:38.318554+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:19.680870+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.015034211,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6372,"num_read_kb":20126,"num_write":676,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"169'673","reported_seq":13227,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315386+0000","last_change":"2024-09-11T05:24:22.498729+0000","last_active":"2024-09-11T05:24:38.315386+0000","last_peered":"2024-09-11T05:24:38.315386+0000","last_clean":"2024-09-11T05:24:38.315386+0000","last_became_active":"2024-09-11T05:24:22.433313+0000","last_became_peered":"2024-09-11T05:24:22.433313+0000","last_unstale":"2024-09-11T05:24:38.315386+0000","last_undegraded":"2024-09-11T05:24:38.315386+0000","last_fullsized":"2024-09-11T05:24:38.315386+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:09.112953+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.021913140000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":13534,"num_read_kb":32568,"num_write":829,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'512","reported_seq":4153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667786+0000","last_change":"2024-09-11T05:24:13.549345+0000","last_active":"2024-09-11T05:24:37.667786+0000","last_peered":"2024-09-11T05:24:37.667786+0000","last_clean":"2024-09-11T05:24:37.667786+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:24:37.667786+0000","last_undegraded":"2024-09-11T05:24:37.667786+0000","last_fullsized":"2024-09-11T05:24:37.667786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:21.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042871879999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4537,"num_read_kb":20166,"num_write":454,"num_write_kb":6827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"162'554","reported_seq":5781,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315800+0000","last_change":"2024-09-11T05:24:26.443804+0000","last_active":"2024-09-11T05:24:38.315800+0000","last_peered":"2024-09-11T05:24:38.315800+0000","last_clean":"2024-09-11T05:24:38.315800+0000","last_became_active":"2024-09-11T05:24:26.441181+0000","last_became_peered":"2024-09-11T05:24:26.441181+0000","last_unstale":"2024-09-11T05:24:38.315800+0000","last_undegraded":"2024-09-11T05:24:38.315800+0000","last_fullsized":"2024-09-11T05:24:38.315800+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:06:06.791827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012850680000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5275,"num_read_kb":23266,"num_write":617,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315146+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:24:38.315146+0000","last_peered":"2024-09-11T05:24:38.315146+0000","last_clean":"2024-09-11T05:24:38.315146+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:24:38.315146+0000","last_undegraded":"2024-09-11T05:24:38.315146+0000","last_fullsized":"2024-09-11T05:24:38.315146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"164'723","reported_seq":8111,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318350+0000","last_change":"2024-09-11T05:24:13.541807+0000","last_active":"2024-09-11T05:24:38.318350+0000","last_peered":"2024-09-11T05:24:38.318350+0000","last_clean":"2024-09-11T05:24:38.318350+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:24:38.318350+0000","last_undegraded":"2024-09-11T05:24:38.318350+0000","last_fullsized":"2024-09-11T05:24:38.318350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:16.711331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021736070000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9295,"num_read_kb":23648,"num_write":666,"num_write_kb":13705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":354,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.669122+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:24:37.669122+0000","last_peered":"2024-09-11T05:24:37.669122+0000","last_clean":"2024-09-11T05:24:37.669122+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:24:37.669122+0000","last_undegraded":"2024-09-11T05:24:37.669122+0000","last_fullsized":"2024-09-11T05:24:37.669122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"162'573","reported_seq":4599,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670342+0000","last_change":"2024-09-11T05:24:13.537895+0000","last_active":"2024-09-11T05:24:37.670342+0000","last_peered":"2024-09-11T05:24:37.670342+0000","last_clean":"2024-09-11T05:24:37.670342+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:24:37.670342+0000","last_undegraded":"2024-09-11T05:24:37.670342+0000","last_fullsized":"2024-09-11T05:24:37.670342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:29.987569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002015902,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5322,"num_read_kb":21543,"num_write":473,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667633+0000","last_change":"2024-09-11T05:24:11.547564+0000","last_active":"2024-09-11T05:24:37.667633+0000","last_peered":"2024-09-11T05:24:37.667633+0000","last_clean":"2024-09-11T05:24:37.667633+0000","last_became_active":"2024-09-11T05:24:11.547223+0000","last_became_peered":"2024-09-11T05:24:11.547223+0000","last_unstale":"2024-09-11T05:24:37.667633+0000","last_undegraded":"2024-09-11T05:24:37.667633+0000","last_fullsized":"2024-09-11T05:24:37.667633+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:46:09.745777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'530","reported_seq":2282,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668874+0000","last_change":"2024-09-11T05:24:13.537881+0000","last_active":"2024-09-11T05:24:37.668874+0000","last_peered":"2024-09-11T05:24:37.668874+0000","last_clean":"2024-09-11T05:24:37.668874+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:24:37.668874+0000","last_undegraded":"2024-09-11T05:24:37.668874+0000","last_fullsized":"2024-09-11T05:24:37.668874+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:50.170435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025491730000000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":2107,"num_read_kb":19783,"num_write":526,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":344,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668962+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:24:37.668962+0000","last_peered":"2024-09-11T05:24:37.668962+0000","last_clean":"2024-09-11T05:24:37.668962+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:24:37.668962+0000","last_undegraded":"2024-09-11T05:24:37.668962+0000","last_fullsized":"2024-09-11T05:24:37.668962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"169'399","reported_seq":5681,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315491+0000","last_change":"2024-09-11T05:24:22.510730+0000","last_active":"2024-09-11T05:24:38.315491+0000","last_peered":"2024-09-11T05:24:38.315491+0000","last_clean":"2024-09-11T05:24:38.315491+0000","last_became_active":"2024-09-11T05:24:22.433696+0000","last_became_peered":"2024-09-11T05:24:22.433696+0000","last_unstale":"2024-09-11T05:24:38.315491+0000","last_undegraded":"2024-09-11T05:24:38.315491+0000","last_fullsized":"2024-09-11T05:24:38.315491+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:45.326247+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024975909000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5377,"num_read_kb":14833,"num_write":328,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"164'668","reported_seq":14116,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315896+0000","last_change":"2024-09-11T05:24:26.446558+0000","last_active":"2024-09-11T05:24:38.315896+0000","last_peered":"2024-09-11T05:24:38.315896+0000","last_clean":"2024-09-11T05:24:38.315896+0000","last_became_active":"2024-09-11T05:24:26.443148+0000","last_became_peered":"2024-09-11T05:24:26.443148+0000","last_unstale":"2024-09-11T05:24:38.315896+0000","last_undegraded":"2024-09-11T05:24:38.315896+0000","last_fullsized":"2024-09-11T05:24:38.315896+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:20:15.090299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017964610000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":13594,"num_read_kb":50789,"num_write":605,"num_write_kb":30482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":230,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315455+0000","last_change":"2024-09-11T05:24:22.435740+0000","last_active":"2024-09-11T05:24:38.315455+0000","last_peered":"2024-09-11T05:24:38.315455+0000","last_clean":"2024-09-11T05:24:38.315455+0000","last_became_active":"2024-09-11T05:24:22.434799+0000","last_became_peered":"2024-09-11T05:24:22.434799+0000","last_unstale":"2024-09-11T05:24:38.315455+0000","last_undegraded":"2024-09-11T05:24:38.315455+0000","last_fullsized":"2024-09-11T05:24:38.315455+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:14.874122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'912","reported_seq":5164,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668600+0000","last_change":"2024-09-11T05:24:13.535651+0000","last_active":"2024-09-11T05:24:37.668600+0000","last_peered":"2024-09-11T05:24:37.668600+0000","last_clean":"2024-09-11T05:24:37.668600+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:24:37.668600+0000","last_undegraded":"2024-09-11T05:24:37.668600+0000","last_fullsized":"2024-09-11T05:24:37.668600+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:56.429502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901449999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":7435,"num_read_kb":34307,"num_write":1162,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":309,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315872+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:24:38.315872+0000","last_peered":"2024-09-11T05:24:38.315872+0000","last_clean":"2024-09-11T05:24:38.315872+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:24:38.315872+0000","last_undegraded":"2024-09-11T05:24:38.315872+0000","last_fullsized":"2024-09-11T05:24:38.315872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"162'468","reported_seq":9565,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318695+0000","last_change":"2024-09-11T05:24:25.442092+0000","last_active":"2024-09-11T05:24:38.318695+0000","last_peered":"2024-09-11T05:24:38.318695+0000","last_clean":"2024-09-11T05:24:38.318695+0000","last_became_active":"2024-09-11T05:24:25.440625+0000","last_became_peered":"2024-09-11T05:24:25.440625+0000","last_unstale":"2024-09-11T05:24:38.318695+0000","last_undegraded":"2024-09-11T05:24:38.318695+0000","last_fullsized":"2024-09-11T05:24:38.318695+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:15.232006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010588730000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":8562,"num_read_kb":22875,"num_write":429,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":507,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667583+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:24:37.667583+0000","last_peered":"2024-09-11T05:24:37.667583+0000","last_clean":"2024-09-11T05:24:37.667583+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:24:37.667583+0000","last_undegraded":"2024-09-11T05:24:37.667583+0000","last_fullsized":"2024-09-11T05:24:37.667583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"169'796","reported_seq":3042,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670259+0000","last_change":"2024-09-11T05:24:22.489264+0000","last_active":"2024-09-11T05:24:37.670259+0000","last_peered":"2024-09-11T05:24:37.670259+0000","last_clean":"2024-09-11T05:24:37.670259+0000","last_became_active":"2024-09-11T05:24:22.436605+0000","last_became_peered":"2024-09-11T05:24:22.436605+0000","last_unstale":"2024-09-11T05:24:37.670259+0000","last_undegraded":"2024-09-11T05:24:37.670259+0000","last_fullsized":"2024-09-11T05:24:37.670259+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:31.985246+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024085374999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4368,"num_read_kb":14537,"num_write":970,"num_write_kb":6756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":285,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315347+0000","last_change":"2024-09-11T05:24:22.431069+0000","last_active":"2024-09-11T05:24:38.315347+0000","last_peered":"2024-09-11T05:24:38.315347+0000","last_clean":"2024-09-11T05:24:38.315347+0000","last_became_active":"2024-09-11T05:24:22.430596+0000","last_became_peered":"2024-09-11T05:24:22.430596+0000","last_unstale":"2024-09-11T05:24:38.315347+0000","last_undegraded":"2024-09-11T05:24:38.315347+0000","last_fullsized":"2024-09-11T05:24:38.315347+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:56:11.667506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":423,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667578+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:24:37.667578+0000","last_peered":"2024-09-11T05:24:37.667578+0000","last_clean":"2024-09-11T05:24:37.667578+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:24:37.667578+0000","last_undegraded":"2024-09-11T05:24:37.667578+0000","last_fullsized":"2024-09-11T05:24:37.667578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"162'421","reported_seq":5788,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670186+0000","last_change":"2024-09-11T05:24:13.537545+0000","last_active":"2024-09-11T05:24:37.670186+0000","last_peered":"2024-09-11T05:24:37.670186+0000","last_clean":"2024-09-11T05:24:37.670186+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:24:37.670186+0000","last_undegraded":"2024-09-11T05:24:37.670186+0000","last_fullsized":"2024-09-11T05:24:37.670186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:35.277746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018840860000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4982,"num_read_kb":21766,"num_write":373,"num_write_kb":9562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'712","reported_seq":2742,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315622+0000","last_change":"2024-09-11T05:24:25.438536+0000","last_active":"2024-09-11T05:24:38.315622+0000","last_peered":"2024-09-11T05:24:38.315622+0000","last_clean":"2024-09-11T05:24:38.315622+0000","last_became_active":"2024-09-11T05:24:25.435777+0000","last_became_peered":"2024-09-11T05:24:25.435777+0000","last_unstale":"2024-09-11T05:24:38.315622+0000","last_undegraded":"2024-09-11T05:24:38.315622+0000","last_fullsized":"2024-09-11T05:24:38.315622+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:32.898916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00122751,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":2844,"num_read_kb":3973,"num_write":882,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":643,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'673","reported_seq":4517,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315189+0000","last_change":"2024-09-11T05:24:25.436040+0000","last_active":"2024-09-11T05:24:38.315189+0000","last_peered":"2024-09-11T05:24:38.315189+0000","last_clean":"2024-09-11T05:24:38.315189+0000","last_became_active":"2024-09-11T05:24:25.434584+0000","last_became_peered":"2024-09-11T05:24:25.434584+0000","last_unstale":"2024-09-11T05:24:38.315189+0000","last_undegraded":"2024-09-11T05:24:38.315189+0000","last_fullsized":"2024-09-11T05:24:38.315189+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:05.235489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011019910000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":4234,"num_read_kb":17484,"num_write":743,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'644","reported_seq":3524,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670170+0000","last_change":"2024-09-11T05:24:13.537129+0000","last_active":"2024-09-11T05:24:37.670170+0000","last_peered":"2024-09-11T05:24:37.670170+0000","last_clean":"2024-09-11T05:24:37.670170+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:24:37.670170+0000","last_undegraded":"2024-09-11T05:24:37.670170+0000","last_fullsized":"2024-09-11T05:24:37.670170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:29.964662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013836460000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4403,"num_read_kb":10564,"num_write":654,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"169'347","reported_seq":1487,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315604+0000","last_change":"2024-09-11T05:24:22.458771+0000","last_active":"2024-09-11T05:24:38.315604+0000","last_peered":"2024-09-11T05:24:38.315604+0000","last_clean":"2024-09-11T05:24:38.315604+0000","last_became_active":"2024-09-11T05:24:22.431901+0000","last_became_peered":"2024-09-11T05:24:22.431901+0000","last_unstale":"2024-09-11T05:24:38.315604+0000","last_undegraded":"2024-09-11T05:24:38.315604+0000","last_fullsized":"2024-09-11T05:24:38.315604+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:44.514731+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.018393828000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":816,"num_read_kb":10764,"num_write":338,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"169'850","reported_seq":5273,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667819+0000","last_change":"2024-09-11T05:24:22.533001+0000","last_active":"2024-09-11T05:24:37.667819+0000","last_peered":"2024-09-11T05:24:37.667819+0000","last_clean":"2024-09-11T05:24:37.667819+0000","last_became_active":"2024-09-11T05:24:22.437877+0000","last_became_peered":"2024-09-11T05:24:22.437877+0000","last_unstale":"2024-09-11T05:24:37.667819+0000","last_undegraded":"2024-09-11T05:24:37.667819+0000","last_fullsized":"2024-09-11T05:24:37.667819+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:17.940976+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.019759079999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":7315,"num_read_kb":39380,"num_write":944,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'525","reported_seq":4831,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667831+0000","last_change":"2024-09-11T05:24:25.439659+0000","last_active":"2024-09-11T05:24:37.667831+0000","last_peered":"2024-09-11T05:24:37.667831+0000","last_clean":"2024-09-11T05:24:37.667831+0000","last_became_active":"2024-09-11T05:24:25.437899+0000","last_became_peered":"2024-09-11T05:24:25.437899+0000","last_unstale":"2024-09-11T05:24:37.667831+0000","last_undegraded":"2024-09-11T05:24:37.667831+0000","last_fullsized":"2024-09-11T05:24:37.667831+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:26.967470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020611689999999998,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":3727,"num_read_kb":10330,"num_write":542,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"162'806","reported_seq":5017,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667904+0000","last_change":"2024-09-11T05:24:26.445868+0000","last_active":"2024-09-11T05:24:37.667904+0000","last_peered":"2024-09-11T05:24:37.667904+0000","last_clean":"2024-09-11T05:24:37.667904+0000","last_became_active":"2024-09-11T05:24:26.443227+0000","last_became_peered":"2024-09-11T05:24:26.443227+0000","last_unstale":"2024-09-11T05:24:37.667904+0000","last_undegraded":"2024-09-11T05:24:37.667904+0000","last_fullsized":"2024-09-11T05:24:37.667904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:49.198435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040415420000000004,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6010,"num_read_kb":20011,"num_write":960,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"162'658","reported_seq":2584,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315145+0000","last_change":"2024-09-11T05:24:13.588716+0000","last_active":"2024-09-11T05:24:38.315145+0000","last_peered":"2024-09-11T05:24:38.315145+0000","last_clean":"2024-09-11T05:24:38.315145+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:24:38.315145+0000","last_undegraded":"2024-09-11T05:24:38.315145+0000","last_fullsized":"2024-09-11T05:24:38.315145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.995244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010089490000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":3453,"num_read_kb":10043,"num_write":799,"num_write_kb":6150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"163'469","reported_seq":4204,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667711+0000","last_change":"2024-09-11T05:24:26.443799+0000","last_active":"2024-09-11T05:24:37.667711+0000","last_peered":"2024-09-11T05:24:37.667711+0000","last_clean":"2024-09-11T05:24:37.667711+0000","last_became_active":"2024-09-11T05:24:26.441576+0000","last_became_peered":"2024-09-11T05:24:26.441576+0000","last_unstale":"2024-09-11T05:24:37.667711+0000","last_undegraded":"2024-09-11T05:24:37.667711+0000","last_fullsized":"2024-09-11T05:24:37.667711+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:44.192222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027819350000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3620,"num_read_kb":8678,"num_write":401,"num_write_kb":3589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":619,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"163'622","reported_seq":7594,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318084+0000","last_change":"2024-09-11T05:24:24.434766+0000","last_active":"2024-09-11T05:24:38.318084+0000","last_peered":"2024-09-11T05:24:38.318084+0000","last_clean":"2024-09-11T05:24:38.318084+0000","last_became_active":"2024-09-11T05:24:24.433236+0000","last_became_peered":"2024-09-11T05:24:24.433236+0000","last_unstale":"2024-09-11T05:24:38.318084+0000","last_undegraded":"2024-09-11T05:24:38.318084+0000","last_fullsized":"2024-09-11T05:24:38.318084+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:20.967512+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00075108200000000003,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7982,"num_read_kb":29519,"num_write":609,"num_write_kb":13736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'788","reported_seq":4239,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667705+0000","last_change":"2024-09-11T05:24:26.446184+0000","last_active":"2024-09-11T05:24:37.667705+0000","last_peered":"2024-09-11T05:24:37.667705+0000","last_clean":"2024-09-11T05:24:37.667705+0000","last_became_active":"2024-09-11T05:24:26.442736+0000","last_became_peered":"2024-09-11T05:24:26.442736+0000","last_unstale":"2024-09-11T05:24:37.667705+0000","last_undegraded":"2024-09-11T05:24:37.667705+0000","last_fullsized":"2024-09-11T05:24:37.667705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:54.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051100649999999996,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":4954,"num_read_kb":19877,"num_write":1038,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":674,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1183,"num_object_clones":0,"num_object_copies":2366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":1179,"num_read":192556,"num_read_kb":678057,"num_write":21640,"num_write_kb":308752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8811,"num_bytes_recovered":208681536,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23429,"internal_metadata":0},"log_size":20010,"ondisk_log_size":20010,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2195456,"data_stored":1066957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":168,"seq":721554505733,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":2148,"kb_used_omap":30,"kb_used_meta":29089,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":2199552,"data_stored":1066976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31735,"internal_metadata":29787145},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51396,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320444,"statfs":{"total":96636764160,"available":96584134656,"internally_reserved":0,"allocated":2211840,"data_stored":1072789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154774,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38784,"kb_used_data":2156,"kb_used_omap":11,"kb_used_meta":36596,"kb_avail":94333056,"statfs":{"total":96636764160,"available":96597049344,"internally_reserved":0,"allocated":2207744,"data_stored":1072770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":37475126},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59736,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312104,"statfs":{"total":96636764160,"available":96575594496,"internally_reserved":0,"allocated":2228224,"data_stored":1078621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47812,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324028,"statfs":{"total":96636764160,"available":96587804672,"internally_reserved":0,"allocated":2801664,"data_stored":1663138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17043,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:24:41.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:24:41.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:41.527 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:24:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-09-11T05:24:39.570889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1187,"num_object_clones":0,"num_object_copies":2374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":1179,"num_read":192672,"num_read_kb":678157,"num_write":21801,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8815,"num_bytes_recovered":209862272,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20130,"ondisk_log_size":20130,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400436,"kb_used_data":18436,"kb_used_omap":51,"kb_used_meta":381772,"kb_avail":754574284,"statfs":{"total":773094113280,"available":772684066816,"internally_reserved":0,"allocated":18878464,"data_stored":9768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52761,"internal_metadata":390935015},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.926098"},"pg_stats":[{"pgid":"3.1f","version":"169'752","reported_seq":4310,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318457+0000","last_change":"2024-09-11T05:24:22.519402+0000","last_active":"2024-09-11T05:24:38.318457+0000","last_peered":"2024-09-11T05:24:38.318457+0000","last_clean":"2024-09-11T05:24:38.318457+0000","last_became_active":"2024-09-11T05:24:22.436523+0000","last_became_peered":"2024-09-11T05:24:22.436523+0000","last_unstale":"2024-09-11T05:24:38.318457+0000","last_undegraded":"2024-09-11T05:24:38.318457+0000","last_fullsized":"2024-09-11T05:24:38.318457+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:20.159237+0000","scrub_duration":0,"objects_trimmed":18,"snaptrim_duration":0.027684375000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":5366,"num_read_kb":22197,"num_write":753,"num_write_kb":10362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'621","reported_seq":7378,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670313+0000","last_change":"2024-09-11T05:24:13.538318+0000","last_active":"2024-09-11T05:24:37.670313+0000","last_peered":"2024-09-11T05:24:37.670313+0000","last_clean":"2024-09-11T05:24:37.670313+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:24:37.670313+0000","last_undegraded":"2024-09-11T05:24:37.670313+0000","last_fullsized":"2024-09-11T05:24:37.670313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:32.438221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020765789999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":8377,"num_read_kb":25107,"num_write":672,"num_write_kb":13431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"172'633","reported_seq":4787,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315480+0000","last_change":"2024-09-11T05:24:25.459113+0000","last_active":"2024-09-11T05:24:38.315480+0000","last_peered":"2024-09-11T05:24:38.315480+0000","last_clean":"2024-09-11T05:24:38.315480+0000","last_became_active":"2024-09-11T05:24:25.432325+0000","last_became_peered":"2024-09-11T05:24:25.432325+0000","last_unstale":"2024-09-11T05:24:38.315480+0000","last_undegraded":"2024-09-11T05:24:38.315480+0000","last_fullsized":"2024-09-11T05:24:38.315480+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:28.213667+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.024392765,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":4840,"num_read_kb":11502,"num_write":711,"num_write_kb":4822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":477,"num_bytes_recovered":9769435,"num_keys_recovered":57,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'749","reported_seq":6083,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315453+0000","last_change":"2024-09-11T05:24:26.471523+0000","last_active":"2024-09-11T05:24:38.315453+0000","last_peered":"2024-09-11T05:24:38.315453+0000","last_clean":"2024-09-11T05:24:38.315453+0000","last_became_active":"2024-09-11T05:24:26.439136+0000","last_became_peered":"2024-09-11T05:24:26.439136+0000","last_unstale":"2024-09-11T05:24:38.315453+0000","last_undegraded":"2024-09-11T05:24:38.315453+0000","last_fullsized":"2024-09-11T05:24:38.315453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:21.492643+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.029901693999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":6111,"num_read_kb":17930,"num_write":835,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":481,"num_bytes_recovered":10267580,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"163'783","reported_seq":5357,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318870+0000","last_change":"2024-09-11T05:24:26.444002+0000","last_active":"2024-09-11T05:24:38.318870+0000","last_peered":"2024-09-11T05:24:38.318870+0000","last_clean":"2024-09-11T05:24:38.318870+0000","last_became_active":"2024-09-11T05:24:26.442532+0000","last_became_peered":"2024-09-11T05:24:26.442532+0000","last_unstale":"2024-09-11T05:24:38.318870+0000","last_undegraded":"2024-09-11T05:24:38.318870+0000","last_fullsized":"2024-09-11T05:24:38.318870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:30.869953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079803399999999998,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":4582,"num_read_kb":11922,"num_write":924,"num_write_kb":11555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":637,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'307","reported_seq":7021,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315773+0000","last_change":"2024-09-11T05:24:25.441145+0000","last_active":"2024-09-11T05:24:38.315773+0000","last_peered":"2024-09-11T05:24:38.315773+0000","last_clean":"2024-09-11T05:24:38.315773+0000","last_became_active":"2024-09-11T05:24:25.439785+0000","last_became_peered":"2024-09-11T05:24:25.439785+0000","last_unstale":"2024-09-11T05:24:38.315773+0000","last_undegraded":"2024-09-11T05:24:38.315773+0000","last_fullsized":"2024-09-11T05:24:38.315773+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:35.897346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040559979999999999,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5755,"num_read_kb":39037,"num_write":265,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":15189092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'305","reported_seq":3881,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668713+0000","last_change":"2024-09-11T05:24:13.535934+0000","last_active":"2024-09-11T05:24:37.668713+0000","last_peered":"2024-09-11T05:24:37.668713+0000","last_clean":"2024-09-11T05:24:37.668713+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:24:37.668713+0000","last_undegraded":"2024-09-11T05:24:37.668713+0000","last_fullsized":"2024-09-11T05:24:37.668713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:37:15.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015515279999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":3067,"num_read_kb":14648,"num_write":273,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"164'847","reported_seq":12059,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670134+0000","last_change":"2024-09-11T05:24:13.535051+0000","last_active":"2024-09-11T05:24:37.670134+0000","last_peered":"2024-09-11T05:24:37.670134+0000","last_clean":"2024-09-11T05:24:37.670134+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:24:37.670134+0000","last_undegraded":"2024-09-11T05:24:37.670134+0000","last_fullsized":"2024-09-11T05:24:37.670134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:45.776994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077435600000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":14340,"num_read_kb":34884,"num_write":1189,"num_write_kb":15897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"169'690","reported_seq":5096,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318554+0000","last_change":"2024-09-11T05:24:24.434881+0000","last_active":"2024-09-11T05:24:38.318554+0000","last_peered":"2024-09-11T05:24:38.318554+0000","last_clean":"2024-09-11T05:24:38.318554+0000","last_became_active":"2024-09-11T05:24:24.433017+0000","last_became_peered":"2024-09-11T05:24:24.433017+0000","last_unstale":"2024-09-11T05:24:38.318554+0000","last_undegraded":"2024-09-11T05:24:38.318554+0000","last_fullsized":"2024-09-11T05:24:38.318554+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:19.680870+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.015034211,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6372,"num_read_kb":20126,"num_write":676,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"169'673","reported_seq":13227,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315386+0000","last_change":"2024-09-11T05:24:22.498729+0000","last_active":"2024-09-11T05:24:38.315386+0000","last_peered":"2024-09-11T05:24:38.315386+0000","last_clean":"2024-09-11T05:24:38.315386+0000","last_became_active":"2024-09-11T05:24:22.433313+0000","last_became_peered":"2024-09-11T05:24:22.433313+0000","last_unstale":"2024-09-11T05:24:38.315386+0000","last_undegraded":"2024-09-11T05:24:38.315386+0000","last_fullsized":"2024-09-11T05:24:38.315386+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:09.112953+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.021913140000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":13534,"num_read_kb":32568,"num_write":829,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'512","reported_seq":4153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667786+0000","last_change":"2024-09-11T05:24:13.549345+0000","last_active":"2024-09-11T05:24:37.667786+0000","last_peered":"2024-09-11T05:24:37.667786+0000","last_clean":"2024-09-11T05:24:37.667786+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:24:37.667786+0000","last_undegraded":"2024-09-11T05:24:37.667786+0000","last_fullsized":"2024-09-11T05:24:37.667786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:21.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042871879999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4537,"num_read_kb":20166,"num_write":454,"num_write_kb":6827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"162'554","reported_seq":5781,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315800+0000","last_change":"2024-09-11T05:24:26.443804+0000","last_active":"2024-09-11T05:24:38.315800+0000","last_peered":"2024-09-11T05:24:38.315800+0000","last_clean":"2024-09-11T05:24:38.315800+0000","last_became_active":"2024-09-11T05:24:26.441181+0000","last_became_peered":"2024-09-11T05:24:26.441181+0000","last_unstale":"2024-09-11T05:24:38.315800+0000","last_undegraded":"2024-09-11T05:24:38.315800+0000","last_fullsized":"2024-09-11T05:24:38.315800+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:06:06.791827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012850680000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5275,"num_read_kb":23266,"num_write":617,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315146+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:24:38.315146+0000","last_peered":"2024-09-11T05:24:38.315146+0000","last_clean":"2024-09-11T05:24:38.315146+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:24:38.315146+0000","last_undegraded":"2024-09-11T05:24:38.315146+0000","last_fullsized":"2024-09-11T05:24:38.315146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"164'723","reported_seq":8111,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318350+0000","last_change":"2024-09-11T05:24:13.541807+0000","last_active":"2024-09-11T05:24:38.318350+0000","last_peered":"2024-09-11T05:24:38.318350+0000","last_clean":"2024-09-11T05:24:38.318350+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:24:38.318350+0000","last_undegraded":"2024-09-11T05:24:38.318350+0000","last_fullsized":"2024-09-11T05:24:38.318350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:16.711331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021736070000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9295,"num_read_kb":23648,"num_write":666,"num_write_kb":13705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":354,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.669122+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:24:37.669122+0000","last_peered":"2024-09-11T05:24:37.669122+0000","last_clean":"2024-09-11T05:24:37.669122+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:24:37.669122+0000","last_undegraded":"2024-09-11T05:24:37.669122+0000","last_fullsized":"2024-09-11T05:24:37.669122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"162'573","reported_seq":4599,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670342+0000","last_change":"2024-09-11T05:24:13.537895+0000","last_active":"2024-09-11T05:24:37.670342+0000","last_peered":"2024-09-11T05:24:37.670342+0000","last_clean":"2024-09-11T05:24:37.670342+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:24:37.670342+0000","last_undegraded":"2024-09-11T05:24:37.670342+0000","last_fullsized":"2024-09-11T05:24:37.670342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:29.987569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002015902,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5322,"num_read_kb":21543,"num_write":473,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667633+0000","last_change":"2024-09-11T05:24:11.547564+0000","last_active":"2024-09-11T05:24:37.667633+0000","last_peered":"2024-09-11T05:24:37.667633+0000","last_clean":"2024-09-11T05:24:37.667633+0000","last_became_active":"2024-09-11T05:24:11.547223+0000","last_became_peered":"2024-09-11T05:24:11.547223+0000","last_unstale":"2024-09-11T05:24:37.667633+0000","last_undegraded":"2024-09-11T05:24:37.667633+0000","last_fullsized":"2024-09-11T05:24:37.667633+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:46:09.745777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'530","reported_seq":2282,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668874+0000","last_change":"2024-09-11T05:24:13.537881+0000","last_active":"2024-09-11T05:24:37.668874+0000","last_peered":"2024-09-11T05:24:37.668874+0000","last_clean":"2024-09-11T05:24:37.668874+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:24:37.668874+0000","last_undegraded":"2024-09-11T05:24:37.668874+0000","last_fullsized":"2024-09-11T05:24:37.668874+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:50.170435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025491730000000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":2107,"num_read_kb":19783,"num_write":526,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":344,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668962+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:24:37.668962+0000","last_peered":"2024-09-11T05:24:37.668962+0000","last_clean":"2024-09-11T05:24:37.668962+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:24:37.668962+0000","last_undegraded":"2024-09-11T05:24:37.668962+0000","last_fullsized":"2024-09-11T05:24:37.668962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"169'399","reported_seq":5681,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315491+0000","last_change":"2024-09-11T05:24:22.510730+0000","last_active":"2024-09-11T05:24:38.315491+0000","last_peered":"2024-09-11T05:24:38.315491+0000","last_clean":"2024-09-11T05:24:38.315491+0000","last_became_active":"2024-09-11T05:24:22.433696+0000","last_became_peered":"2024-09-11T05:24:22.433696+0000","last_unstale":"2024-09-11T05:24:38.315491+0000","last_undegraded":"2024-09-11T05:24:38.315491+0000","last_fullsized":"2024-09-11T05:24:38.315491+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:45.326247+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024975909000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5377,"num_read_kb":14833,"num_write":328,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"164'668","reported_seq":14116,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315896+0000","last_change":"2024-09-11T05:24:26.446558+0000","last_active":"2024-09-11T05:24:38.315896+0000","last_peered":"2024-09-11T05:24:38.315896+0000","last_clean":"2024-09-11T05:24:38.315896+0000","last_became_active":"2024-09-11T05:24:26.443148+0000","last_became_peered":"2024-09-11T05:24:26.443148+0000","last_unstale":"2024-09-11T05:24:38.315896+0000","last_undegraded":"2024-09-11T05:24:38.315896+0000","last_fullsized":"2024-09-11T05:24:38.315896+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:20:15.090299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017964610000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":13594,"num_read_kb":50789,"num_write":605,"num_write_kb":30482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":230,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315455+0000","last_change":"2024-09-11T05:24:22.435740+0000","last_active":"2024-09-11T05:24:38.315455+0000","last_peered":"2024-09-11T05:24:38.315455+0000","last_clean":"2024-09-11T05:24:38.315455+0000","last_became_active":"2024-09-11T05:24:22.434799+0000","last_became_peered":"2024-09-11T05:24:22.434799+0000","last_unstale":"2024-09-11T05:24:38.315455+0000","last_undegraded":"2024-09-11T05:24:38.315455+0000","last_fullsized":"2024-09-11T05:24:38.315455+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:14.874122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'912","reported_seq":5164,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668600+0000","last_change":"2024-09-11T05:24:13.535651+0000","last_active":"2024-09-11T05:24:37.668600+0000","last_peered":"2024-09-11T05:24:37.668600+0000","last_clean":"2024-09-11T05:24:37.668600+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:24:37.668600+0000","last_undegraded":"2024-09-11T05:24:37.668600+0000","last_fullsized":"2024-09-11T05:24:37.668600+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:56.429502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901449999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":7435,"num_read_kb":34307,"num_write":1162,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":309,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315872+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:24:38.315872+0000","last_peered":"2024-09-11T05:24:38.315872+0000","last_clean":"2024-09-11T05:24:38.315872+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:24:38.315872+0000","last_undegraded":"2024-09-11T05:24:38.315872+0000","last_fullsized":"2024-09-11T05:24:38.315872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"162'468","reported_seq":9565,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318695+0000","last_change":"2024-09-11T05:24:25.442092+0000","last_active":"2024-09-11T05:24:38.318695+0000","last_peered":"2024-09-11T05:24:38.318695+0000","last_clean":"2024-09-11T05:24:38.318695+0000","last_became_active":"2024-09-11T05:24:25.440625+0000","last_became_peered":"2024-09-11T05:24:25.440625+0000","last_unstale":"2024-09-11T05:24:38.318695+0000","last_undegraded":"2024-09-11T05:24:38.318695+0000","last_fullsized":"2024-09-11T05:24:38.318695+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:15.232006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010588730000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":8562,"num_read_kb":22875,"num_write":429,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":507,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667583+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:24:37.667583+0000","last_peered":"2024-09-11T05:24:37.667583+0000","last_clean":"2024-09-11T05:24:37.667583+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:24:37.667583+0000","last_undegraded":"2024-09-11T05:24:37.667583+0000","last_fullsized":"2024-09-11T05:24:37.667583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"169'796","reported_seq":3042,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670259+0000","last_change":"2024-09-11T05:24:22.489264+0000","last_active":"2024-09-11T05:24:37.670259+0000","last_peered":"2024-09-11T05:24:37.670259+0000","last_clean":"2024-09-11T05:24:37.670259+0000","last_became_active":"2024-09-11T05:24:22.436605+0000","last_became_peered":"2024-09-11T05:24:22.436605+0000","last_unstale":"2024-09-11T05:24:37.670259+0000","last_undegraded":"2024-09-11T05:24:37.670259+0000","last_fullsized":"2024-09-11T05:24:37.670259+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:31.985246+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024085374999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4368,"num_read_kb":14537,"num_write":970,"num_write_kb":6756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":285,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315347+0000","last_change":"2024-09-11T05:24:22.431069+0000","last_active":"2024-09-11T05:24:38.315347+0000","last_peered":"2024-09-11T05:24:38.315347+0000","last_clean":"2024-09-11T05:24:38.315347+0000","last_became_active":"2024-09-11T05:24:22.430596+0000","last_became_peered":"2024-09-11T05:24:22.430596+0000","last_unstale":"2024-09-11T05:24:38.315347+0000","last_undegraded":"2024-09-11T05:24:38.315347+0000","last_fullsized":"2024-09-11T05:24:38.315347+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:56:11.667506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":423,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667578+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:24:37.667578+0000","last_peered":"2024-09-11T05:24:37.667578+0000","last_clean":"2024-09-11T05:24:37.667578+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:24:37.667578+0000","last_undegraded":"2024-09-11T05:24:37.667578+0000","last_fullsized":"2024-09-11T05:24:37.667578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"162'421","reported_seq":5788,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670186+0000","last_change":"2024-09-11T05:24:13.537545+0000","last_active":"2024-09-11T05:24:37.670186+0000","last_peered":"2024-09-11T05:24:37.670186+0000","last_clean":"2024-09-11T05:24:37.670186+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:24:37.670186+0000","last_undegraded":"2024-09-11T05:24:37.670186+0000","last_fullsized":"2024-09-11T05:24:37.670186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:35.277746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018840860000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4982,"num_read_kb":21766,"num_write":373,"num_write_kb":9562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'712","reported_seq":2742,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315622+0000","last_change":"2024-09-11T05:24:25.438536+0000","last_active":"2024-09-11T05:24:38.315622+0000","last_peered":"2024-09-11T05:24:38.315622+0000","last_clean":"2024-09-11T05:24:38.315622+0000","last_became_active":"2024-09-11T05:24:25.435777+0000","last_became_peered":"2024-09-11T05:24:25.435777+0000","last_unstale":"2024-09-11T05:24:38.315622+0000","last_undegraded":"2024-09-11T05:24:38.315622+0000","last_fullsized":"2024-09-11T05:24:38.315622+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:32.898916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00122751,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":2844,"num_read_kb":3973,"num_write":882,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":643,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'673","reported_seq":4517,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315189+0000","last_change":"2024-09-11T05:24:25.436040+0000","last_active":"2024-09-11T05:24:38.315189+0000","last_peered":"2024-09-11T05:24:38.315189+0000","last_clean":"2024-09-11T05:24:38.315189+0000","last_became_active":"2024-09-11T05:24:25.434584+0000","last_became_peered":"2024-09-11T05:24:25.434584+0000","last_unstale":"2024-09-11T05:24:38.315189+0000","last_undegraded":"2024-09-11T05:24:38.315189+0000","last_fullsized":"2024-09-11T05:24:38.315189+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:05.235489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011019910000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":4234,"num_read_kb":17484,"num_write":743,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'644","reported_seq":3524,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670170+0000","last_change":"2024-09-11T05:24:13.537129+0000","last_active":"2024-09-11T05:24:37.670170+0000","last_peered":"2024-09-11T05:24:37.670170+0000","last_clean":"2024-09-11T05:24:37.670170+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:24:37.670170+0000","last_undegraded":"2024-09-11T05:24:37.670170+0000","last_fullsized":"2024-09-11T05:24:37.670170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:29.964662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013836460000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4403,"num_read_kb":10564,"num_write":654,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"169'347","reported_seq":1487,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315604+0000","last_change":"2024-09-11T05:24:22.458771+0000","last_active":"2024-09-11T05:24:38.315604+0000","last_peered":"2024-09-11T05:24:38.315604+0000","last_clean":"2024-09-11T05:24:38.315604+0000","last_became_active":"2024-09-11T05:24:22.431901+0000","last_became_peered":"2024-09-11T05:24:22.431901+0000","last_unstale":"2024-09-11T05:24:38.315604+0000","last_undegraded":"2024-09-11T05:24:38.315604+0000","last_fullsized":"2024-09-11T05:24:38.315604+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:44.514731+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.018393828000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":816,"num_read_kb":10764,"num_write":338,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"169'850","reported_seq":5273,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667819+0000","last_change":"2024-09-11T05:24:22.533001+0000","last_active":"2024-09-11T05:24:37.667819+0000","last_peered":"2024-09-11T05:24:37.667819+0000","last_clean":"2024-09-11T05:24:37.667819+0000","last_became_active":"2024-09-11T05:24:22.437877+0000","last_became_peered":"2024-09-11T05:24:22.437877+0000","last_unstale":"2024-09-11T05:24:37.667819+0000","last_undegraded":"2024-09-11T05:24:37.667819+0000","last_fullsized":"2024-09-11T05:24:37.667819+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:17.940976+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.019759079999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":7315,"num_read_kb":39380,"num_write":944,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'525","reported_seq":4831,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667831+0000","last_change":"2024-09-11T05:24:25.439659+0000","last_active":"2024-09-11T05:24:37.667831+0000","last_peered":"2024-09-11T05:24:37.667831+0000","last_clean":"2024-09-11T05:24:37.667831+0000","last_became_active":"2024-09-11T05:24:25.437899+0000","last_became_peered":"2024-09-11T05:24:25.437899+0000","last_unstale":"2024-09-11T05:24:37.667831+0000","last_undegraded":"2024-09-11T05:24:37.667831+0000","last_fullsized":"2024-09-11T05:24:37.667831+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:26.967470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020611689999999998,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":3727,"num_read_kb":10330,"num_write":542,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"162'806","reported_seq":5017,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667904+0000","last_change":"2024-09-11T05:24:26.445868+0000","last_active":"2024-09-11T05:24:37.667904+0000","last_peered":"2024-09-11T05:24:37.667904+0000","last_clean":"2024-09-11T05:24:37.667904+0000","last_became_active":"2024-09-11T05:24:26.443227+0000","last_became_peered":"2024-09-11T05:24:26.443227+0000","last_unstale":"2024-09-11T05:24:37.667904+0000","last_undegraded":"2024-09-11T05:24:37.667904+0000","last_fullsized":"2024-09-11T05:24:37.667904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:49.198435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040415420000000004,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6010,"num_read_kb":20011,"num_write":960,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"162'658","reported_seq":2584,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315145+0000","last_change":"2024-09-11T05:24:13.588716+0000","last_active":"2024-09-11T05:24:38.315145+0000","last_peered":"2024-09-11T05:24:38.315145+0000","last_clean":"2024-09-11T05:24:38.315145+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:24:38.315145+0000","last_undegraded":"2024-09-11T05:24:38.315145+0000","last_fullsized":"2024-09-11T05:24:38.315145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.995244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010089490000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":3453,"num_read_kb":10043,"num_write":799,"num_write_kb":6150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"163'469","reported_seq":4204,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667711+0000","last_change":"2024-09-11T05:24:26.443799+0000","last_active":"2024-09-11T05:24:37.667711+0000","last_peered":"2024-09-11T05:24:37.667711+0000","last_clean":"2024-09-11T05:24:37.667711+0000","last_became_active":"2024-09-11T05:24:26.441576+0000","last_became_peered":"2024-09-11T05:24:26.441576+0000","last_unstale":"2024-09-11T05:24:37.667711+0000","last_undegraded":"2024-09-11T05:24:37.667711+0000","last_fullsized":"2024-09-11T05:24:37.667711+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:44.192222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027819350000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3620,"num_read_kb":8678,"num_write":401,"num_write_kb":3589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":619,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"163'622","reported_seq":7594,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318084+0000","last_change":"2024-09-11T05:24:24.434766+0000","last_active":"2024-09-11T05:24:38.318084+0000","last_peered":"2024-09-11T05:24:38.318084+0000","last_clean":"2024-09-11T05:24:38.318084+0000","last_became_active":"2024-09-11T05:24:24.433236+0000","last_became_peered":"2024-09-11T05:24:24.433236+0000","last_unstale":"2024-09-11T05:24:38.318084+0000","last_undegraded":"2024-09-11T05:24:38.318084+0000","last_fullsized":"2024-09-11T05:24:38.318084+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:20.967512+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00075108200000000003,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7982,"num_read_kb":29519,"num_write":609,"num_write_kb":13736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'788","reported_seq":4239,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667705+0000","last_change":"2024-09-11T05:24:26.446184+0000","last_active":"2024-09-11T05:24:37.667705+0000","last_peered":"2024-09-11T05:24:37.667705+0000","last_clean":"2024-09-11T05:24:37.667705+0000","last_became_active":"2024-09-11T05:24:26.442736+0000","last_became_peered":"2024-09-11T05:24:26.442736+0000","last_unstale":"2024-09-11T05:24:37.667705+0000","last_undegraded":"2024-09-11T05:24:37.667705+0000","last_fullsized":"2024-09-11T05:24:37.667705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:54.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051100649999999996,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":4954,"num_read_kb":19877,"num_write":1038,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":674,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1183,"num_object_clones":0,"num_object_copies":2366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":1179,"num_read":192556,"num_read_kb":678057,"num_write":21640,"num_write_kb":308752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8811,"num_bytes_recovered":208681536,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23429,"internal_metadata":0},"log_size":20010,"ondisk_log_size":20010,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2195456,"data_stored":1066957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":168,"seq":721554505733,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":2148,"kb_used_omap":30,"kb_used_meta":29089,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":2199552,"data_stored":1066976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31735,"internal_metadata":29787145},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51396,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320444,"statfs":{"total":96636764160,"available":96584134656,"internally_reserved":0,"allocated":2211840,"data_stored":1072789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154774,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38784,"kb_used_data":2156,"kb_used_omap":11,"kb_used_meta":36596,"kb_avail":94333056,"statfs":{"total":96636764160,"available":96597049344,"internally_reserved":0,"allocated":2207744,"data_stored":1072770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":37475126},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59736,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312104,"statfs":{"total":96636764160,"available":96575594496,"internally_reserved":0,"allocated":2228224,"data_stored":1078621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47812,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324028,"statfs":{"total":96636764160,"available":96587804672,"internally_reserved":0,"allocated":2801664,"data_stored":1663138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17043,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:24:41.540 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T05:24:41.540 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-11T05:24:41.849 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T05:24:41.859 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T05:24:41.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:24:42.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:42.151 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:24:42.163 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-11T05:24:41.571401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1187,"num_object_clones":0,"num_object_copies":2374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":1179,"num_read":192672,"num_read_kb":678157,"num_write":21801,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8815,"num_bytes_recovered":209862272,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20130,"ondisk_log_size":20130,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400480,"kb_used_data":18472,"kb_used_omap":51,"kb_used_meta":381772,"kb_avail":754574240,"statfs":{"total":773094113280,"available":772684021760,"internally_reserved":0,"allocated":18915328,"data_stored":9786224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52761,"internal_metadata":390935015},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001450"},"pg_stats":[{"pgid":"3.1f","version":"169'752","reported_seq":4310,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318457+0000","last_change":"2024-09-11T05:24:22.519402+0000","last_active":"2024-09-11T05:24:38.318457+0000","last_peered":"2024-09-11T05:24:38.318457+0000","last_clean":"2024-09-11T05:24:38.318457+0000","last_became_active":"2024-09-11T05:24:22.436523+0000","last_became_peered":"2024-09-11T05:24:22.436523+0000","last_unstale":"2024-09-11T05:24:38.318457+0000","last_undegraded":"2024-09-11T05:24:38.318457+0000","last_fullsized":"2024-09-11T05:24:38.318457+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:20.159237+0000","scrub_duration":0,"objects_trimmed":18,"snaptrim_duration":0.027684375000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":5366,"num_read_kb":22197,"num_write":753,"num_write_kb":10362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'621","reported_seq":7378,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670313+0000","last_change":"2024-09-11T05:24:13.538318+0000","last_active":"2024-09-11T05:24:37.670313+0000","last_peered":"2024-09-11T05:24:37.670313+0000","last_clean":"2024-09-11T05:24:37.670313+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:24:37.670313+0000","last_undegraded":"2024-09-11T05:24:37.670313+0000","last_fullsized":"2024-09-11T05:24:37.670313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:32.438221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020765789999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":8377,"num_read_kb":25107,"num_write":672,"num_write_kb":13431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"172'633","reported_seq":4787,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315480+0000","last_change":"2024-09-11T05:24:25.459113+0000","last_active":"2024-09-11T05:24:38.315480+0000","last_peered":"2024-09-11T05:24:38.315480+0000","last_clean":"2024-09-11T05:24:38.315480+0000","last_became_active":"2024-09-11T05:24:25.432325+0000","last_became_peered":"2024-09-11T05:24:25.432325+0000","last_unstale":"2024-09-11T05:24:38.315480+0000","last_undegraded":"2024-09-11T05:24:38.315480+0000","last_fullsized":"2024-09-11T05:24:38.315480+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:28.213667+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.024392765,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":4840,"num_read_kb":11502,"num_write":711,"num_write_kb":4822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":477,"num_bytes_recovered":9769435,"num_keys_recovered":57,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'749","reported_seq":6083,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315453+0000","last_change":"2024-09-11T05:24:26.471523+0000","last_active":"2024-09-11T05:24:38.315453+0000","last_peered":"2024-09-11T05:24:38.315453+0000","last_clean":"2024-09-11T05:24:38.315453+0000","last_became_active":"2024-09-11T05:24:26.439136+0000","last_became_peered":"2024-09-11T05:24:26.439136+0000","last_unstale":"2024-09-11T05:24:38.315453+0000","last_undegraded":"2024-09-11T05:24:38.315453+0000","last_fullsized":"2024-09-11T05:24:38.315453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:21.492643+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.029901693999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":6111,"num_read_kb":17930,"num_write":835,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":481,"num_bytes_recovered":10267580,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"163'783","reported_seq":5357,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318870+0000","last_change":"2024-09-11T05:24:26.444002+0000","last_active":"2024-09-11T05:24:38.318870+0000","last_peered":"2024-09-11T05:24:38.318870+0000","last_clean":"2024-09-11T05:24:38.318870+0000","last_became_active":"2024-09-11T05:24:26.442532+0000","last_became_peered":"2024-09-11T05:24:26.442532+0000","last_unstale":"2024-09-11T05:24:38.318870+0000","last_undegraded":"2024-09-11T05:24:38.318870+0000","last_fullsized":"2024-09-11T05:24:38.318870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:30.869953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079803399999999998,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":4582,"num_read_kb":11922,"num_write":924,"num_write_kb":11555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":637,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'307","reported_seq":7021,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315773+0000","last_change":"2024-09-11T05:24:25.441145+0000","last_active":"2024-09-11T05:24:38.315773+0000","last_peered":"2024-09-11T05:24:38.315773+0000","last_clean":"2024-09-11T05:24:38.315773+0000","last_became_active":"2024-09-11T05:24:25.439785+0000","last_became_peered":"2024-09-11T05:24:25.439785+0000","last_unstale":"2024-09-11T05:24:38.315773+0000","last_undegraded":"2024-09-11T05:24:38.315773+0000","last_fullsized":"2024-09-11T05:24:38.315773+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:35.897346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040559979999999999,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5755,"num_read_kb":39037,"num_write":265,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":15189092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'305","reported_seq":3881,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668713+0000","last_change":"2024-09-11T05:24:13.535934+0000","last_active":"2024-09-11T05:24:37.668713+0000","last_peered":"2024-09-11T05:24:37.668713+0000","last_clean":"2024-09-11T05:24:37.668713+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:24:37.668713+0000","last_undegraded":"2024-09-11T05:24:37.668713+0000","last_fullsized":"2024-09-11T05:24:37.668713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:37:15.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015515279999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":3067,"num_read_kb":14648,"num_write":273,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"164'847","reported_seq":12059,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670134+0000","last_change":"2024-09-11T05:24:13.535051+0000","last_active":"2024-09-11T05:24:37.670134+0000","last_peered":"2024-09-11T05:24:37.670134+0000","last_clean":"2024-09-11T05:24:37.670134+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:24:37.670134+0000","last_undegraded":"2024-09-11T05:24:37.670134+0000","last_fullsized":"2024-09-11T05:24:37.670134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:45.776994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077435600000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":14340,"num_read_kb":34884,"num_write":1189,"num_write_kb":15897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"169'690","reported_seq":5096,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318554+0000","last_change":"2024-09-11T05:24:24.434881+0000","last_active":"2024-09-11T05:24:38.318554+0000","last_peered":"2024-09-11T05:24:38.318554+0000","last_clean":"2024-09-11T05:24:38.318554+0000","last_became_active":"2024-09-11T05:24:24.433017+0000","last_became_peered":"2024-09-11T05:24:24.433017+0000","last_unstale":"2024-09-11T05:24:38.318554+0000","last_undegraded":"2024-09-11T05:24:38.318554+0000","last_fullsized":"2024-09-11T05:24:38.318554+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:19.680870+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.015034211,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6372,"num_read_kb":20126,"num_write":676,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"169'673","reported_seq":13227,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315386+0000","last_change":"2024-09-11T05:24:22.498729+0000","last_active":"2024-09-11T05:24:38.315386+0000","last_peered":"2024-09-11T05:24:38.315386+0000","last_clean":"2024-09-11T05:24:38.315386+0000","last_became_active":"2024-09-11T05:24:22.433313+0000","last_became_peered":"2024-09-11T05:24:22.433313+0000","last_unstale":"2024-09-11T05:24:38.315386+0000","last_undegraded":"2024-09-11T05:24:38.315386+0000","last_fullsized":"2024-09-11T05:24:38.315386+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:09.112953+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.021913140000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":13534,"num_read_kb":32568,"num_write":829,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'512","reported_seq":4153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667786+0000","last_change":"2024-09-11T05:24:13.549345+0000","last_active":"2024-09-11T05:24:37.667786+0000","last_peered":"2024-09-11T05:24:37.667786+0000","last_clean":"2024-09-11T05:24:37.667786+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:24:37.667786+0000","last_undegraded":"2024-09-11T05:24:37.667786+0000","last_fullsized":"2024-09-11T05:24:37.667786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:21.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042871879999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4537,"num_read_kb":20166,"num_write":454,"num_write_kb":6827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"162'554","reported_seq":5781,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315800+0000","last_change":"2024-09-11T05:24:26.443804+0000","last_active":"2024-09-11T05:24:38.315800+0000","last_peered":"2024-09-11T05:24:38.315800+0000","last_clean":"2024-09-11T05:24:38.315800+0000","last_became_active":"2024-09-11T05:24:26.441181+0000","last_became_peered":"2024-09-11T05:24:26.441181+0000","last_unstale":"2024-09-11T05:24:38.315800+0000","last_undegraded":"2024-09-11T05:24:38.315800+0000","last_fullsized":"2024-09-11T05:24:38.315800+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:06:06.791827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012850680000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5275,"num_read_kb":23266,"num_write":617,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315146+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:24:38.315146+0000","last_peered":"2024-09-11T05:24:38.315146+0000","last_clean":"2024-09-11T05:24:38.315146+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:24:38.315146+0000","last_undegraded":"2024-09-11T05:24:38.315146+0000","last_fullsized":"2024-09-11T05:24:38.315146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"164'723","reported_seq":8111,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318350+0000","last_change":"2024-09-11T05:24:13.541807+0000","last_active":"2024-09-11T05:24:38.318350+0000","last_peered":"2024-09-11T05:24:38.318350+0000","last_clean":"2024-09-11T05:24:38.318350+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:24:38.318350+0000","last_undegraded":"2024-09-11T05:24:38.318350+0000","last_fullsized":"2024-09-11T05:24:38.318350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:16.711331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021736070000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9295,"num_read_kb":23648,"num_write":666,"num_write_kb":13705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":354,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.669122+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:24:37.669122+0000","last_peered":"2024-09-11T05:24:37.669122+0000","last_clean":"2024-09-11T05:24:37.669122+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:24:37.669122+0000","last_undegraded":"2024-09-11T05:24:37.669122+0000","last_fullsized":"2024-09-11T05:24:37.669122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"162'573","reported_seq":4599,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670342+0000","last_change":"2024-09-11T05:24:13.537895+0000","last_active":"2024-09-11T05:24:37.670342+0000","last_peered":"2024-09-11T05:24:37.670342+0000","last_clean":"2024-09-11T05:24:37.670342+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:24:37.670342+0000","last_undegraded":"2024-09-11T05:24:37.670342+0000","last_fullsized":"2024-09-11T05:24:37.670342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:29.987569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002015902,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5322,"num_read_kb":21543,"num_write":473,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667633+0000","last_change":"2024-09-11T05:24:11.547564+0000","last_active":"2024-09-11T05:24:37.667633+0000","last_peered":"2024-09-11T05:24:37.667633+0000","last_clean":"2024-09-11T05:24:37.667633+0000","last_became_active":"2024-09-11T05:24:11.547223+0000","last_became_peered":"2024-09-11T05:24:11.547223+0000","last_unstale":"2024-09-11T05:24:37.667633+0000","last_undegraded":"2024-09-11T05:24:37.667633+0000","last_fullsized":"2024-09-11T05:24:37.667633+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:46:09.745777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'530","reported_seq":2282,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668874+0000","last_change":"2024-09-11T05:24:13.537881+0000","last_active":"2024-09-11T05:24:37.668874+0000","last_peered":"2024-09-11T05:24:37.668874+0000","last_clean":"2024-09-11T05:24:37.668874+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:24:37.668874+0000","last_undegraded":"2024-09-11T05:24:37.668874+0000","last_fullsized":"2024-09-11T05:24:37.668874+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:50.170435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025491730000000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":2107,"num_read_kb":19783,"num_write":526,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":344,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668962+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:24:37.668962+0000","last_peered":"2024-09-11T05:24:37.668962+0000","last_clean":"2024-09-11T05:24:37.668962+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:24:37.668962+0000","last_undegraded":"2024-09-11T05:24:37.668962+0000","last_fullsized":"2024-09-11T05:24:37.668962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"169'399","reported_seq":5681,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315491+0000","last_change":"2024-09-11T05:24:22.510730+0000","last_active":"2024-09-11T05:24:38.315491+0000","last_peered":"2024-09-11T05:24:38.315491+0000","last_clean":"2024-09-11T05:24:38.315491+0000","last_became_active":"2024-09-11T05:24:22.433696+0000","last_became_peered":"2024-09-11T05:24:22.433696+0000","last_unstale":"2024-09-11T05:24:38.315491+0000","last_undegraded":"2024-09-11T05:24:38.315491+0000","last_fullsized":"2024-09-11T05:24:38.315491+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:45.326247+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024975909000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5377,"num_read_kb":14833,"num_write":328,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"164'668","reported_seq":14116,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315896+0000","last_change":"2024-09-11T05:24:26.446558+0000","last_active":"2024-09-11T05:24:38.315896+0000","last_peered":"2024-09-11T05:24:38.315896+0000","last_clean":"2024-09-11T05:24:38.315896+0000","last_became_active":"2024-09-11T05:24:26.443148+0000","last_became_peered":"2024-09-11T05:24:26.443148+0000","last_unstale":"2024-09-11T05:24:38.315896+0000","last_undegraded":"2024-09-11T05:24:38.315896+0000","last_fullsized":"2024-09-11T05:24:38.315896+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:20:15.090299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017964610000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":13594,"num_read_kb":50789,"num_write":605,"num_write_kb":30482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":230,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315455+0000","last_change":"2024-09-11T05:24:22.435740+0000","last_active":"2024-09-11T05:24:38.315455+0000","last_peered":"2024-09-11T05:24:38.315455+0000","last_clean":"2024-09-11T05:24:38.315455+0000","last_became_active":"2024-09-11T05:24:22.434799+0000","last_became_peered":"2024-09-11T05:24:22.434799+0000","last_unstale":"2024-09-11T05:24:38.315455+0000","last_undegraded":"2024-09-11T05:24:38.315455+0000","last_fullsized":"2024-09-11T05:24:38.315455+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:14.874122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'912","reported_seq":5164,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668600+0000","last_change":"2024-09-11T05:24:13.535651+0000","last_active":"2024-09-11T05:24:37.668600+0000","last_peered":"2024-09-11T05:24:37.668600+0000","last_clean":"2024-09-11T05:24:37.668600+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:24:37.668600+0000","last_undegraded":"2024-09-11T05:24:37.668600+0000","last_fullsized":"2024-09-11T05:24:37.668600+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:56.429502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901449999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":7435,"num_read_kb":34307,"num_write":1162,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":309,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315872+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:24:38.315872+0000","last_peered":"2024-09-11T05:24:38.315872+0000","last_clean":"2024-09-11T05:24:38.315872+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:24:38.315872+0000","last_undegraded":"2024-09-11T05:24:38.315872+0000","last_fullsized":"2024-09-11T05:24:38.315872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"162'468","reported_seq":9565,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318695+0000","last_change":"2024-09-11T05:24:25.442092+0000","last_active":"2024-09-11T05:24:38.318695+0000","last_peered":"2024-09-11T05:24:38.318695+0000","last_clean":"2024-09-11T05:24:38.318695+0000","last_became_active":"2024-09-11T05:24:25.440625+0000","last_became_peered":"2024-09-11T05:24:25.440625+0000","last_unstale":"2024-09-11T05:24:38.318695+0000","last_undegraded":"2024-09-11T05:24:38.318695+0000","last_fullsized":"2024-09-11T05:24:38.318695+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:15.232006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010588730000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":8562,"num_read_kb":22875,"num_write":429,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":507,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667583+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:24:37.667583+0000","last_peered":"2024-09-11T05:24:37.667583+0000","last_clean":"2024-09-11T05:24:37.667583+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:24:37.667583+0000","last_undegraded":"2024-09-11T05:24:37.667583+0000","last_fullsized":"2024-09-11T05:24:37.667583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"169'796","reported_seq":3042,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670259+0000","last_change":"2024-09-11T05:24:22.489264+0000","last_active":"2024-09-11T05:24:37.670259+0000","last_peered":"2024-09-11T05:24:37.670259+0000","last_clean":"2024-09-11T05:24:37.670259+0000","last_became_active":"2024-09-11T05:24:22.436605+0000","last_became_peered":"2024-09-11T05:24:22.436605+0000","last_unstale":"2024-09-11T05:24:37.670259+0000","last_undegraded":"2024-09-11T05:24:37.670259+0000","last_fullsized":"2024-09-11T05:24:37.670259+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:31.985246+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024085374999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4368,"num_read_kb":14537,"num_write":970,"num_write_kb":6756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":285,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315347+0000","last_change":"2024-09-11T05:24:22.431069+0000","last_active":"2024-09-11T05:24:38.315347+0000","last_peered":"2024-09-11T05:24:38.315347+0000","last_clean":"2024-09-11T05:24:38.315347+0000","last_became_active":"2024-09-11T05:24:22.430596+0000","last_became_peered":"2024-09-11T05:24:22.430596+0000","last_unstale":"2024-09-11T05:24:38.315347+0000","last_undegraded":"2024-09-11T05:24:38.315347+0000","last_fullsized":"2024-09-11T05:24:38.315347+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:56:11.667506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":423,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667578+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:24:37.667578+0000","last_peered":"2024-09-11T05:24:37.667578+0000","last_clean":"2024-09-11T05:24:37.667578+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:24:37.667578+0000","last_undegraded":"2024-09-11T05:24:37.667578+0000","last_fullsized":"2024-09-11T05:24:37.667578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"162'421","reported_seq":5788,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670186+0000","last_change":"2024-09-11T05:24:13.537545+0000","last_active":"2024-09-11T05:24:37.670186+0000","last_peered":"2024-09-11T05:24:37.670186+0000","last_clean":"2024-09-11T05:24:37.670186+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:24:37.670186+0000","last_undegraded":"2024-09-11T05:24:37.670186+0000","last_fullsized":"2024-09-11T05:24:37.670186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:35.277746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018840860000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4982,"num_read_kb":21766,"num_write":373,"num_write_kb":9562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'712","reported_seq":2742,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315622+0000","last_change":"2024-09-11T05:24:25.438536+0000","last_active":"2024-09-11T05:24:38.315622+0000","last_peered":"2024-09-11T05:24:38.315622+0000","last_clean":"2024-09-11T05:24:38.315622+0000","last_became_active":"2024-09-11T05:24:25.435777+0000","last_became_peered":"2024-09-11T05:24:25.435777+0000","last_unstale":"2024-09-11T05:24:38.315622+0000","last_undegraded":"2024-09-11T05:24:38.315622+0000","last_fullsized":"2024-09-11T05:24:38.315622+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:32.898916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00122751,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":2844,"num_read_kb":3973,"num_write":882,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":643,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'673","reported_seq":4517,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315189+0000","last_change":"2024-09-11T05:24:25.436040+0000","last_active":"2024-09-11T05:24:38.315189+0000","last_peered":"2024-09-11T05:24:38.315189+0000","last_clean":"2024-09-11T05:24:38.315189+0000","last_became_active":"2024-09-11T05:24:25.434584+0000","last_became_peered":"2024-09-11T05:24:25.434584+0000","last_unstale":"2024-09-11T05:24:38.315189+0000","last_undegraded":"2024-09-11T05:24:38.315189+0000","last_fullsized":"2024-09-11T05:24:38.315189+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:05.235489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011019910000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":4234,"num_read_kb":17484,"num_write":743,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'644","reported_seq":3524,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670170+0000","last_change":"2024-09-11T05:24:13.537129+0000","last_active":"2024-09-11T05:24:37.670170+0000","last_peered":"2024-09-11T05:24:37.670170+0000","last_clean":"2024-09-11T05:24:37.670170+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:24:37.670170+0000","last_undegraded":"2024-09-11T05:24:37.670170+0000","last_fullsized":"2024-09-11T05:24:37.670170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:29.964662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013836460000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4403,"num_read_kb":10564,"num_write":654,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"169'347","reported_seq":1487,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315604+0000","last_change":"2024-09-11T05:24:22.458771+0000","last_active":"2024-09-11T05:24:38.315604+0000","last_peered":"2024-09-11T05:24:38.315604+0000","last_clean":"2024-09-11T05:24:38.315604+0000","last_became_active":"2024-09-11T05:24:22.431901+0000","last_became_peered":"2024-09-11T05:24:22.431901+0000","last_unstale":"2024-09-11T05:24:38.315604+0000","last_undegraded":"2024-09-11T05:24:38.315604+0000","last_fullsized":"2024-09-11T05:24:38.315604+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:44.514731+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.018393828000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":816,"num_read_kb":10764,"num_write":338,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"169'850","reported_seq":5273,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667819+0000","last_change":"2024-09-11T05:24:22.533001+0000","last_active":"2024-09-11T05:24:37.667819+0000","last_peered":"2024-09-11T05:24:37.667819+0000","last_clean":"2024-09-11T05:24:37.667819+0000","last_became_active":"2024-09-11T05:24:22.437877+0000","last_became_peered":"2024-09-11T05:24:22.437877+0000","last_unstale":"2024-09-11T05:24:37.667819+0000","last_undegraded":"2024-09-11T05:24:37.667819+0000","last_fullsized":"2024-09-11T05:24:37.667819+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:17.940976+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.019759079999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":7315,"num_read_kb":39380,"num_write":944,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'525","reported_seq":4831,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667831+0000","last_change":"2024-09-11T05:24:25.439659+0000","last_active":"2024-09-11T05:24:37.667831+0000","last_peered":"2024-09-11T05:24:37.667831+0000","last_clean":"2024-09-11T05:24:37.667831+0000","last_became_active":"2024-09-11T05:24:25.437899+0000","last_became_peered":"2024-09-11T05:24:25.437899+0000","last_unstale":"2024-09-11T05:24:37.667831+0000","last_undegraded":"2024-09-11T05:24:37.667831+0000","last_fullsized":"2024-09-11T05:24:37.667831+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:26.967470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020611689999999998,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":3727,"num_read_kb":10330,"num_write":542,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"162'806","reported_seq":5017,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667904+0000","last_change":"2024-09-11T05:24:26.445868+0000","last_active":"2024-09-11T05:24:37.667904+0000","last_peered":"2024-09-11T05:24:37.667904+0000","last_clean":"2024-09-11T05:24:37.667904+0000","last_became_active":"2024-09-11T05:24:26.443227+0000","last_became_peered":"2024-09-11T05:24:26.443227+0000","last_unstale":"2024-09-11T05:24:37.667904+0000","last_undegraded":"2024-09-11T05:24:37.667904+0000","last_fullsized":"2024-09-11T05:24:37.667904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:49.198435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040415420000000004,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6010,"num_read_kb":20011,"num_write":960,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"162'658","reported_seq":2584,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315145+0000","last_change":"2024-09-11T05:24:13.588716+0000","last_active":"2024-09-11T05:24:38.315145+0000","last_peered":"2024-09-11T05:24:38.315145+0000","last_clean":"2024-09-11T05:24:38.315145+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:24:38.315145+0000","last_undegraded":"2024-09-11T05:24:38.315145+0000","last_fullsized":"2024-09-11T05:24:38.315145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.995244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010089490000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":3453,"num_read_kb":10043,"num_write":799,"num_write_kb":6150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"163'469","reported_seq":4204,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667711+0000","last_change":"2024-09-11T05:24:26.443799+0000","last_active":"2024-09-11T05:24:37.667711+0000","last_peered":"2024-09-11T05:24:37.667711+0000","last_clean":"2024-09-11T05:24:37.667711+0000","last_became_active":"2024-09-11T05:24:26.441576+0000","last_became_peered":"2024-09-11T05:24:26.441576+0000","last_unstale":"2024-09-11T05:24:37.667711+0000","last_undegraded":"2024-09-11T05:24:37.667711+0000","last_fullsized":"2024-09-11T05:24:37.667711+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:44.192222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027819350000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3620,"num_read_kb":8678,"num_write":401,"num_write_kb":3589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":619,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"163'622","reported_seq":7594,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318084+0000","last_change":"2024-09-11T05:24:24.434766+0000","last_active":"2024-09-11T05:24:38.318084+0000","last_peered":"2024-09-11T05:24:38.318084+0000","last_clean":"2024-09-11T05:24:38.318084+0000","last_became_active":"2024-09-11T05:24:24.433236+0000","last_became_peered":"2024-09-11T05:24:24.433236+0000","last_unstale":"2024-09-11T05:24:38.318084+0000","last_undegraded":"2024-09-11T05:24:38.318084+0000","last_fullsized":"2024-09-11T05:24:38.318084+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:20.967512+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00075108200000000003,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7982,"num_read_kb":29519,"num_write":609,"num_write_kb":13736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'788","reported_seq":4239,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667705+0000","last_change":"2024-09-11T05:24:26.446184+0000","last_active":"2024-09-11T05:24:37.667705+0000","last_peered":"2024-09-11T05:24:37.667705+0000","last_clean":"2024-09-11T05:24:37.667705+0000","last_became_active":"2024-09-11T05:24:26.442736+0000","last_became_peered":"2024-09-11T05:24:26.442736+0000","last_unstale":"2024-09-11T05:24:37.667705+0000","last_undegraded":"2024-09-11T05:24:37.667705+0000","last_fullsized":"2024-09-11T05:24:37.667705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:54.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051100649999999996,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":4954,"num_read_kb":19877,"num_write":1038,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":674,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1183,"num_object_clones":0,"num_object_copies":2366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":1179,"num_read":192556,"num_read_kb":678057,"num_write":21640,"num_write_kb":308752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8811,"num_bytes_recovered":208681536,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23429,"internal_metadata":0},"log_size":20010,"ondisk_log_size":20010,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2195456,"data_stored":1066957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":168,"seq":721554505734,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":2172,"kb_used_omap":30,"kb_used_meta":29089,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":2224128,"data_stored":1078602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31735,"internal_metadata":29787145},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51396,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320444,"statfs":{"total":96636764160,"available":96584134656,"internally_reserved":0,"allocated":2211840,"data_stored":1072789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154775,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38800,"kb_used_data":2168,"kb_used_omap":11,"kb_used_meta":36596,"kb_avail":94333040,"statfs":{"total":96636764160,"available":96597032960,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":37475126},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59736,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312104,"statfs":{"total":96636764160,"available":96575594496,"internally_reserved":0,"allocated":2228224,"data_stored":1078621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47812,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324028,"statfs":{"total":96636764160,"available":96587804672,"internally_reserved":0,"allocated":2801664,"data_stored":1663138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17043,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:24:42.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:24:42.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:42.514 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:24:42.515 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-11T05:24:41.571401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1187,"num_object_clones":0,"num_object_copies":2374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":1179,"num_read":192672,"num_read_kb":678157,"num_write":21801,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8815,"num_bytes_recovered":209862272,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20130,"ondisk_log_size":20130,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400480,"kb_used_data":18472,"kb_used_omap":51,"kb_used_meta":381772,"kb_avail":754574240,"statfs":{"total":773094113280,"available":772684021760,"internally_reserved":0,"allocated":18915328,"data_stored":9786224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52761,"internal_metadata":390935015},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001450"},"pg_stats":[{"pgid":"3.1f","version":"169'752","reported_seq":4310,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318457+0000","last_change":"2024-09-11T05:24:22.519402+0000","last_active":"2024-09-11T05:24:38.318457+0000","last_peered":"2024-09-11T05:24:38.318457+0000","last_clean":"2024-09-11T05:24:38.318457+0000","last_became_active":"2024-09-11T05:24:22.436523+0000","last_became_peered":"2024-09-11T05:24:22.436523+0000","last_unstale":"2024-09-11T05:24:38.318457+0000","last_undegraded":"2024-09-11T05:24:38.318457+0000","last_fullsized":"2024-09-11T05:24:38.318457+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:20.159237+0000","scrub_duration":0,"objects_trimmed":18,"snaptrim_duration":0.027684375000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":5366,"num_read_kb":22197,"num_write":753,"num_write_kb":10362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'621","reported_seq":7378,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670313+0000","last_change":"2024-09-11T05:24:13.538318+0000","last_active":"2024-09-11T05:24:37.670313+0000","last_peered":"2024-09-11T05:24:37.670313+0000","last_clean":"2024-09-11T05:24:37.670313+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:24:37.670313+0000","last_undegraded":"2024-09-11T05:24:37.670313+0000","last_fullsized":"2024-09-11T05:24:37.670313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:32.438221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020765789999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":8377,"num_read_kb":25107,"num_write":672,"num_write_kb":13431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"172'633","reported_seq":4787,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315480+0000","last_change":"2024-09-11T05:24:25.459113+0000","last_active":"2024-09-11T05:24:38.315480+0000","last_peered":"2024-09-11T05:24:38.315480+0000","last_clean":"2024-09-11T05:24:38.315480+0000","last_became_active":"2024-09-11T05:24:25.432325+0000","last_became_peered":"2024-09-11T05:24:25.432325+0000","last_unstale":"2024-09-11T05:24:38.315480+0000","last_undegraded":"2024-09-11T05:24:38.315480+0000","last_fullsized":"2024-09-11T05:24:38.315480+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:28.213667+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.024392765,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":4840,"num_read_kb":11502,"num_write":711,"num_write_kb":4822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":477,"num_bytes_recovered":9769435,"num_keys_recovered":57,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'749","reported_seq":6083,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315453+0000","last_change":"2024-09-11T05:24:26.471523+0000","last_active":"2024-09-11T05:24:38.315453+0000","last_peered":"2024-09-11T05:24:38.315453+0000","last_clean":"2024-09-11T05:24:38.315453+0000","last_became_active":"2024-09-11T05:24:26.439136+0000","last_became_peered":"2024-09-11T05:24:26.439136+0000","last_unstale":"2024-09-11T05:24:38.315453+0000","last_undegraded":"2024-09-11T05:24:38.315453+0000","last_fullsized":"2024-09-11T05:24:38.315453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:21.492643+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.029901693999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":6111,"num_read_kb":17930,"num_write":835,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":481,"num_bytes_recovered":10267580,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"163'783","reported_seq":5357,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318870+0000","last_change":"2024-09-11T05:24:26.444002+0000","last_active":"2024-09-11T05:24:38.318870+0000","last_peered":"2024-09-11T05:24:38.318870+0000","last_clean":"2024-09-11T05:24:38.318870+0000","last_became_active":"2024-09-11T05:24:26.442532+0000","last_became_peered":"2024-09-11T05:24:26.442532+0000","last_unstale":"2024-09-11T05:24:38.318870+0000","last_undegraded":"2024-09-11T05:24:38.318870+0000","last_fullsized":"2024-09-11T05:24:38.318870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:30.869953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079803399999999998,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":4582,"num_read_kb":11922,"num_write":924,"num_write_kb":11555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":637,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'307","reported_seq":7021,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315773+0000","last_change":"2024-09-11T05:24:25.441145+0000","last_active":"2024-09-11T05:24:38.315773+0000","last_peered":"2024-09-11T05:24:38.315773+0000","last_clean":"2024-09-11T05:24:38.315773+0000","last_became_active":"2024-09-11T05:24:25.439785+0000","last_became_peered":"2024-09-11T05:24:25.439785+0000","last_unstale":"2024-09-11T05:24:38.315773+0000","last_undegraded":"2024-09-11T05:24:38.315773+0000","last_fullsized":"2024-09-11T05:24:38.315773+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:35.897346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040559979999999999,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5755,"num_read_kb":39037,"num_write":265,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":15189092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'305","reported_seq":3881,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668713+0000","last_change":"2024-09-11T05:24:13.535934+0000","last_active":"2024-09-11T05:24:37.668713+0000","last_peered":"2024-09-11T05:24:37.668713+0000","last_clean":"2024-09-11T05:24:37.668713+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:24:37.668713+0000","last_undegraded":"2024-09-11T05:24:37.668713+0000","last_fullsized":"2024-09-11T05:24:37.668713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:37:15.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015515279999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":3067,"num_read_kb":14648,"num_write":273,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"164'847","reported_seq":12059,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670134+0000","last_change":"2024-09-11T05:24:13.535051+0000","last_active":"2024-09-11T05:24:37.670134+0000","last_peered":"2024-09-11T05:24:37.670134+0000","last_clean":"2024-09-11T05:24:37.670134+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:24:37.670134+0000","last_undegraded":"2024-09-11T05:24:37.670134+0000","last_fullsized":"2024-09-11T05:24:37.670134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:45.776994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077435600000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":14340,"num_read_kb":34884,"num_write":1189,"num_write_kb":15897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"169'690","reported_seq":5096,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318554+0000","last_change":"2024-09-11T05:24:24.434881+0000","last_active":"2024-09-11T05:24:38.318554+0000","last_peered":"2024-09-11T05:24:38.318554+0000","last_clean":"2024-09-11T05:24:38.318554+0000","last_became_active":"2024-09-11T05:24:24.433017+0000","last_became_peered":"2024-09-11T05:24:24.433017+0000","last_unstale":"2024-09-11T05:24:38.318554+0000","last_undegraded":"2024-09-11T05:24:38.318554+0000","last_fullsized":"2024-09-11T05:24:38.318554+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:19.680870+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.015034211,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6372,"num_read_kb":20126,"num_write":676,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"169'673","reported_seq":13227,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315386+0000","last_change":"2024-09-11T05:24:22.498729+0000","last_active":"2024-09-11T05:24:38.315386+0000","last_peered":"2024-09-11T05:24:38.315386+0000","last_clean":"2024-09-11T05:24:38.315386+0000","last_became_active":"2024-09-11T05:24:22.433313+0000","last_became_peered":"2024-09-11T05:24:22.433313+0000","last_unstale":"2024-09-11T05:24:38.315386+0000","last_undegraded":"2024-09-11T05:24:38.315386+0000","last_fullsized":"2024-09-11T05:24:38.315386+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:09.112953+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.021913140000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":13534,"num_read_kb":32568,"num_write":829,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'512","reported_seq":4153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667786+0000","last_change":"2024-09-11T05:24:13.549345+0000","last_active":"2024-09-11T05:24:37.667786+0000","last_peered":"2024-09-11T05:24:37.667786+0000","last_clean":"2024-09-11T05:24:37.667786+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:24:37.667786+0000","last_undegraded":"2024-09-11T05:24:37.667786+0000","last_fullsized":"2024-09-11T05:24:37.667786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:21.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042871879999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4537,"num_read_kb":20166,"num_write":454,"num_write_kb":6827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"162'554","reported_seq":5781,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315800+0000","last_change":"2024-09-11T05:24:26.443804+0000","last_active":"2024-09-11T05:24:38.315800+0000","last_peered":"2024-09-11T05:24:38.315800+0000","last_clean":"2024-09-11T05:24:38.315800+0000","last_became_active":"2024-09-11T05:24:26.441181+0000","last_became_peered":"2024-09-11T05:24:26.441181+0000","last_unstale":"2024-09-11T05:24:38.315800+0000","last_undegraded":"2024-09-11T05:24:38.315800+0000","last_fullsized":"2024-09-11T05:24:38.315800+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:06:06.791827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012850680000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5275,"num_read_kb":23266,"num_write":617,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315146+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:24:38.315146+0000","last_peered":"2024-09-11T05:24:38.315146+0000","last_clean":"2024-09-11T05:24:38.315146+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:24:38.315146+0000","last_undegraded":"2024-09-11T05:24:38.315146+0000","last_fullsized":"2024-09-11T05:24:38.315146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"164'723","reported_seq":8111,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318350+0000","last_change":"2024-09-11T05:24:13.541807+0000","last_active":"2024-09-11T05:24:38.318350+0000","last_peered":"2024-09-11T05:24:38.318350+0000","last_clean":"2024-09-11T05:24:38.318350+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:24:38.318350+0000","last_undegraded":"2024-09-11T05:24:38.318350+0000","last_fullsized":"2024-09-11T05:24:38.318350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:16.711331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021736070000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9295,"num_read_kb":23648,"num_write":666,"num_write_kb":13705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":354,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.669122+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:24:37.669122+0000","last_peered":"2024-09-11T05:24:37.669122+0000","last_clean":"2024-09-11T05:24:37.669122+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:24:37.669122+0000","last_undegraded":"2024-09-11T05:24:37.669122+0000","last_fullsized":"2024-09-11T05:24:37.669122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"162'573","reported_seq":4599,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670342+0000","last_change":"2024-09-11T05:24:13.537895+0000","last_active":"2024-09-11T05:24:37.670342+0000","last_peered":"2024-09-11T05:24:37.670342+0000","last_clean":"2024-09-11T05:24:37.670342+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:24:37.670342+0000","last_undegraded":"2024-09-11T05:24:37.670342+0000","last_fullsized":"2024-09-11T05:24:37.670342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:29.987569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002015902,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5322,"num_read_kb":21543,"num_write":473,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667633+0000","last_change":"2024-09-11T05:24:11.547564+0000","last_active":"2024-09-11T05:24:37.667633+0000","last_peered":"2024-09-11T05:24:37.667633+0000","last_clean":"2024-09-11T05:24:37.667633+0000","last_became_active":"2024-09-11T05:24:11.547223+0000","last_became_peered":"2024-09-11T05:24:11.547223+0000","last_unstale":"2024-09-11T05:24:37.667633+0000","last_undegraded":"2024-09-11T05:24:37.667633+0000","last_fullsized":"2024-09-11T05:24:37.667633+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:46:09.745777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'530","reported_seq":2282,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668874+0000","last_change":"2024-09-11T05:24:13.537881+0000","last_active":"2024-09-11T05:24:37.668874+0000","last_peered":"2024-09-11T05:24:37.668874+0000","last_clean":"2024-09-11T05:24:37.668874+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:24:37.668874+0000","last_undegraded":"2024-09-11T05:24:37.668874+0000","last_fullsized":"2024-09-11T05:24:37.668874+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:50.170435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025491730000000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":2107,"num_read_kb":19783,"num_write":526,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":344,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668962+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:24:37.668962+0000","last_peered":"2024-09-11T05:24:37.668962+0000","last_clean":"2024-09-11T05:24:37.668962+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:24:37.668962+0000","last_undegraded":"2024-09-11T05:24:37.668962+0000","last_fullsized":"2024-09-11T05:24:37.668962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"169'399","reported_seq":5681,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315491+0000","last_change":"2024-09-11T05:24:22.510730+0000","last_active":"2024-09-11T05:24:38.315491+0000","last_peered":"2024-09-11T05:24:38.315491+0000","last_clean":"2024-09-11T05:24:38.315491+0000","last_became_active":"2024-09-11T05:24:22.433696+0000","last_became_peered":"2024-09-11T05:24:22.433696+0000","last_unstale":"2024-09-11T05:24:38.315491+0000","last_undegraded":"2024-09-11T05:24:38.315491+0000","last_fullsized":"2024-09-11T05:24:38.315491+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:45.326247+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024975909000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5377,"num_read_kb":14833,"num_write":328,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"164'668","reported_seq":14116,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315896+0000","last_change":"2024-09-11T05:24:26.446558+0000","last_active":"2024-09-11T05:24:38.315896+0000","last_peered":"2024-09-11T05:24:38.315896+0000","last_clean":"2024-09-11T05:24:38.315896+0000","last_became_active":"2024-09-11T05:24:26.443148+0000","last_became_peered":"2024-09-11T05:24:26.443148+0000","last_unstale":"2024-09-11T05:24:38.315896+0000","last_undegraded":"2024-09-11T05:24:38.315896+0000","last_fullsized":"2024-09-11T05:24:38.315896+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:20:15.090299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017964610000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":13594,"num_read_kb":50789,"num_write":605,"num_write_kb":30482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":230,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315455+0000","last_change":"2024-09-11T05:24:22.435740+0000","last_active":"2024-09-11T05:24:38.315455+0000","last_peered":"2024-09-11T05:24:38.315455+0000","last_clean":"2024-09-11T05:24:38.315455+0000","last_became_active":"2024-09-11T05:24:22.434799+0000","last_became_peered":"2024-09-11T05:24:22.434799+0000","last_unstale":"2024-09-11T05:24:38.315455+0000","last_undegraded":"2024-09-11T05:24:38.315455+0000","last_fullsized":"2024-09-11T05:24:38.315455+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:14.874122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'912","reported_seq":5164,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668600+0000","last_change":"2024-09-11T05:24:13.535651+0000","last_active":"2024-09-11T05:24:37.668600+0000","last_peered":"2024-09-11T05:24:37.668600+0000","last_clean":"2024-09-11T05:24:37.668600+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:24:37.668600+0000","last_undegraded":"2024-09-11T05:24:37.668600+0000","last_fullsized":"2024-09-11T05:24:37.668600+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:56.429502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901449999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":7435,"num_read_kb":34307,"num_write":1162,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":309,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315872+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:24:38.315872+0000","last_peered":"2024-09-11T05:24:38.315872+0000","last_clean":"2024-09-11T05:24:38.315872+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:24:38.315872+0000","last_undegraded":"2024-09-11T05:24:38.315872+0000","last_fullsized":"2024-09-11T05:24:38.315872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"162'468","reported_seq":9565,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318695+0000","last_change":"2024-09-11T05:24:25.442092+0000","last_active":"2024-09-11T05:24:38.318695+0000","last_peered":"2024-09-11T05:24:38.318695+0000","last_clean":"2024-09-11T05:24:38.318695+0000","last_became_active":"2024-09-11T05:24:25.440625+0000","last_became_peered":"2024-09-11T05:24:25.440625+0000","last_unstale":"2024-09-11T05:24:38.318695+0000","last_undegraded":"2024-09-11T05:24:38.318695+0000","last_fullsized":"2024-09-11T05:24:38.318695+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:15.232006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010588730000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":8562,"num_read_kb":22875,"num_write":429,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":507,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667583+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:24:37.667583+0000","last_peered":"2024-09-11T05:24:37.667583+0000","last_clean":"2024-09-11T05:24:37.667583+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:24:37.667583+0000","last_undegraded":"2024-09-11T05:24:37.667583+0000","last_fullsized":"2024-09-11T05:24:37.667583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"169'796","reported_seq":3042,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670259+0000","last_change":"2024-09-11T05:24:22.489264+0000","last_active":"2024-09-11T05:24:37.670259+0000","last_peered":"2024-09-11T05:24:37.670259+0000","last_clean":"2024-09-11T05:24:37.670259+0000","last_became_active":"2024-09-11T05:24:22.436605+0000","last_became_peered":"2024-09-11T05:24:22.436605+0000","last_unstale":"2024-09-11T05:24:37.670259+0000","last_undegraded":"2024-09-11T05:24:37.670259+0000","last_fullsized":"2024-09-11T05:24:37.670259+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:31.985246+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024085374999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4368,"num_read_kb":14537,"num_write":970,"num_write_kb":6756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":285,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315347+0000","last_change":"2024-09-11T05:24:22.431069+0000","last_active":"2024-09-11T05:24:38.315347+0000","last_peered":"2024-09-11T05:24:38.315347+0000","last_clean":"2024-09-11T05:24:38.315347+0000","last_became_active":"2024-09-11T05:24:22.430596+0000","last_became_peered":"2024-09-11T05:24:22.430596+0000","last_unstale":"2024-09-11T05:24:38.315347+0000","last_undegraded":"2024-09-11T05:24:38.315347+0000","last_fullsized":"2024-09-11T05:24:38.315347+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:56:11.667506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":423,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667578+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:24:37.667578+0000","last_peered":"2024-09-11T05:24:37.667578+0000","last_clean":"2024-09-11T05:24:37.667578+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:24:37.667578+0000","last_undegraded":"2024-09-11T05:24:37.667578+0000","last_fullsized":"2024-09-11T05:24:37.667578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"162'421","reported_seq":5788,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670186+0000","last_change":"2024-09-11T05:24:13.537545+0000","last_active":"2024-09-11T05:24:37.670186+0000","last_peered":"2024-09-11T05:24:37.670186+0000","last_clean":"2024-09-11T05:24:37.670186+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:24:37.670186+0000","last_undegraded":"2024-09-11T05:24:37.670186+0000","last_fullsized":"2024-09-11T05:24:37.670186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:35.277746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018840860000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4982,"num_read_kb":21766,"num_write":373,"num_write_kb":9562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'712","reported_seq":2742,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315622+0000","last_change":"2024-09-11T05:24:25.438536+0000","last_active":"2024-09-11T05:24:38.315622+0000","last_peered":"2024-09-11T05:24:38.315622+0000","last_clean":"2024-09-11T05:24:38.315622+0000","last_became_active":"2024-09-11T05:24:25.435777+0000","last_became_peered":"2024-09-11T05:24:25.435777+0000","last_unstale":"2024-09-11T05:24:38.315622+0000","last_undegraded":"2024-09-11T05:24:38.315622+0000","last_fullsized":"2024-09-11T05:24:38.315622+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:32.898916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00122751,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":2844,"num_read_kb":3973,"num_write":882,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":643,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'673","reported_seq":4517,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315189+0000","last_change":"2024-09-11T05:24:25.436040+0000","last_active":"2024-09-11T05:24:38.315189+0000","last_peered":"2024-09-11T05:24:38.315189+0000","last_clean":"2024-09-11T05:24:38.315189+0000","last_became_active":"2024-09-11T05:24:25.434584+0000","last_became_peered":"2024-09-11T05:24:25.434584+0000","last_unstale":"2024-09-11T05:24:38.315189+0000","last_undegraded":"2024-09-11T05:24:38.315189+0000","last_fullsized":"2024-09-11T05:24:38.315189+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:05.235489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011019910000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":4234,"num_read_kb":17484,"num_write":743,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'644","reported_seq":3524,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670170+0000","last_change":"2024-09-11T05:24:13.537129+0000","last_active":"2024-09-11T05:24:37.670170+0000","last_peered":"2024-09-11T05:24:37.670170+0000","last_clean":"2024-09-11T05:24:37.670170+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:24:37.670170+0000","last_undegraded":"2024-09-11T05:24:37.670170+0000","last_fullsized":"2024-09-11T05:24:37.670170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:29.964662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013836460000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4403,"num_read_kb":10564,"num_write":654,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"169'347","reported_seq":1487,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315604+0000","last_change":"2024-09-11T05:24:22.458771+0000","last_active":"2024-09-11T05:24:38.315604+0000","last_peered":"2024-09-11T05:24:38.315604+0000","last_clean":"2024-09-11T05:24:38.315604+0000","last_became_active":"2024-09-11T05:24:22.431901+0000","last_became_peered":"2024-09-11T05:24:22.431901+0000","last_unstale":"2024-09-11T05:24:38.315604+0000","last_undegraded":"2024-09-11T05:24:38.315604+0000","last_fullsized":"2024-09-11T05:24:38.315604+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:44.514731+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.018393828000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":816,"num_read_kb":10764,"num_write":338,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"169'850","reported_seq":5273,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667819+0000","last_change":"2024-09-11T05:24:22.533001+0000","last_active":"2024-09-11T05:24:37.667819+0000","last_peered":"2024-09-11T05:24:37.667819+0000","last_clean":"2024-09-11T05:24:37.667819+0000","last_became_active":"2024-09-11T05:24:22.437877+0000","last_became_peered":"2024-09-11T05:24:22.437877+0000","last_unstale":"2024-09-11T05:24:37.667819+0000","last_undegraded":"2024-09-11T05:24:37.667819+0000","last_fullsized":"2024-09-11T05:24:37.667819+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:17.940976+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.019759079999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":7315,"num_read_kb":39380,"num_write":944,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'525","reported_seq":4831,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667831+0000","last_change":"2024-09-11T05:24:25.439659+0000","last_active":"2024-09-11T05:24:37.667831+0000","last_peered":"2024-09-11T05:24:37.667831+0000","last_clean":"2024-09-11T05:24:37.667831+0000","last_became_active":"2024-09-11T05:24:25.437899+0000","last_became_peered":"2024-09-11T05:24:25.437899+0000","last_unstale":"2024-09-11T05:24:37.667831+0000","last_undegraded":"2024-09-11T05:24:37.667831+0000","last_fullsized":"2024-09-11T05:24:37.667831+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:26.967470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020611689999999998,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":3727,"num_read_kb":10330,"num_write":542,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"162'806","reported_seq":5017,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667904+0000","last_change":"2024-09-11T05:24:26.445868+0000","last_active":"2024-09-11T05:24:37.667904+0000","last_peered":"2024-09-11T05:24:37.667904+0000","last_clean":"2024-09-11T05:24:37.667904+0000","last_became_active":"2024-09-11T05:24:26.443227+0000","last_became_peered":"2024-09-11T05:24:26.443227+0000","last_unstale":"2024-09-11T05:24:37.667904+0000","last_undegraded":"2024-09-11T05:24:37.667904+0000","last_fullsized":"2024-09-11T05:24:37.667904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:49.198435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040415420000000004,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6010,"num_read_kb":20011,"num_write":960,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"162'658","reported_seq":2584,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315145+0000","last_change":"2024-09-11T05:24:13.588716+0000","last_active":"2024-09-11T05:24:38.315145+0000","last_peered":"2024-09-11T05:24:38.315145+0000","last_clean":"2024-09-11T05:24:38.315145+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:24:38.315145+0000","last_undegraded":"2024-09-11T05:24:38.315145+0000","last_fullsized":"2024-09-11T05:24:38.315145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.995244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010089490000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":3453,"num_read_kb":10043,"num_write":799,"num_write_kb":6150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"163'469","reported_seq":4204,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667711+0000","last_change":"2024-09-11T05:24:26.443799+0000","last_active":"2024-09-11T05:24:37.667711+0000","last_peered":"2024-09-11T05:24:37.667711+0000","last_clean":"2024-09-11T05:24:37.667711+0000","last_became_active":"2024-09-11T05:24:26.441576+0000","last_became_peered":"2024-09-11T05:24:26.441576+0000","last_unstale":"2024-09-11T05:24:37.667711+0000","last_undegraded":"2024-09-11T05:24:37.667711+0000","last_fullsized":"2024-09-11T05:24:37.667711+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:44.192222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027819350000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3620,"num_read_kb":8678,"num_write":401,"num_write_kb":3589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":619,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"163'622","reported_seq":7594,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318084+0000","last_change":"2024-09-11T05:24:24.434766+0000","last_active":"2024-09-11T05:24:38.318084+0000","last_peered":"2024-09-11T05:24:38.318084+0000","last_clean":"2024-09-11T05:24:38.318084+0000","last_became_active":"2024-09-11T05:24:24.433236+0000","last_became_peered":"2024-09-11T05:24:24.433236+0000","last_unstale":"2024-09-11T05:24:38.318084+0000","last_undegraded":"2024-09-11T05:24:38.318084+0000","last_fullsized":"2024-09-11T05:24:38.318084+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:20.967512+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00075108200000000003,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7982,"num_read_kb":29519,"num_write":609,"num_write_kb":13736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'788","reported_seq":4239,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667705+0000","last_change":"2024-09-11T05:24:26.446184+0000","last_active":"2024-09-11T05:24:37.667705+0000","last_peered":"2024-09-11T05:24:37.667705+0000","last_clean":"2024-09-11T05:24:37.667705+0000","last_became_active":"2024-09-11T05:24:26.442736+0000","last_became_peered":"2024-09-11T05:24:26.442736+0000","last_unstale":"2024-09-11T05:24:37.667705+0000","last_undegraded":"2024-09-11T05:24:37.667705+0000","last_fullsized":"2024-09-11T05:24:37.667705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:54.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051100649999999996,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":4954,"num_read_kb":19877,"num_write":1038,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":674,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1183,"num_object_clones":0,"num_object_copies":2366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":1179,"num_read":192556,"num_read_kb":678057,"num_write":21640,"num_write_kb":308752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8811,"num_bytes_recovered":208681536,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23429,"internal_metadata":0},"log_size":20010,"ondisk_log_size":20010,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2195456,"data_stored":1066957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":168,"seq":721554505734,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":2172,"kb_used_omap":30,"kb_used_meta":29089,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":2224128,"data_stored":1078602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31735,"internal_metadata":29787145},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51396,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320444,"statfs":{"total":96636764160,"available":96584134656,"internally_reserved":0,"allocated":2211840,"data_stored":1072789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154775,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38800,"kb_used_data":2168,"kb_used_omap":11,"kb_used_meta":36596,"kb_avail":94333040,"statfs":{"total":96636764160,"available":96597032960,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":37475126},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59736,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312104,"statfs":{"total":96636764160,"available":96575594496,"internally_reserved":0,"allocated":2228224,"data_stored":1078621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47812,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324028,"statfs":{"total":96636764160,"available":96587804672,"internally_reserved":0,"allocated":2801664,"data_stored":1663138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17043,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:24:42.517 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T05:24:42.518 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:24:42.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:42.810 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:24:42.822 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-11T05:24:41.571401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1187,"num_object_clones":0,"num_object_copies":2374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":1179,"num_read":192672,"num_read_kb":678157,"num_write":21801,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8815,"num_bytes_recovered":209862272,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20130,"ondisk_log_size":20130,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400480,"kb_used_data":18472,"kb_used_omap":51,"kb_used_meta":381772,"kb_avail":754574240,"statfs":{"total":773094113280,"available":772684021760,"internally_reserved":0,"allocated":18915328,"data_stored":9786224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52761,"internal_metadata":390935015},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001450"},"pg_stats":[{"pgid":"3.1f","version":"169'752","reported_seq":4310,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318457+0000","last_change":"2024-09-11T05:24:22.519402+0000","last_active":"2024-09-11T05:24:38.318457+0000","last_peered":"2024-09-11T05:24:38.318457+0000","last_clean":"2024-09-11T05:24:38.318457+0000","last_became_active":"2024-09-11T05:24:22.436523+0000","last_became_peered":"2024-09-11T05:24:22.436523+0000","last_unstale":"2024-09-11T05:24:38.318457+0000","last_undegraded":"2024-09-11T05:24:38.318457+0000","last_fullsized":"2024-09-11T05:24:38.318457+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:20.159237+0000","scrub_duration":0,"objects_trimmed":18,"snaptrim_duration":0.027684375000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":5366,"num_read_kb":22197,"num_write":753,"num_write_kb":10362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'621","reported_seq":7378,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670313+0000","last_change":"2024-09-11T05:24:13.538318+0000","last_active":"2024-09-11T05:24:37.670313+0000","last_peered":"2024-09-11T05:24:37.670313+0000","last_clean":"2024-09-11T05:24:37.670313+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:24:37.670313+0000","last_undegraded":"2024-09-11T05:24:37.670313+0000","last_fullsized":"2024-09-11T05:24:37.670313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:32.438221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020765789999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":8377,"num_read_kb":25107,"num_write":672,"num_write_kb":13431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"172'633","reported_seq":4787,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315480+0000","last_change":"2024-09-11T05:24:25.459113+0000","last_active":"2024-09-11T05:24:38.315480+0000","last_peered":"2024-09-11T05:24:38.315480+0000","last_clean":"2024-09-11T05:24:38.315480+0000","last_became_active":"2024-09-11T05:24:25.432325+0000","last_became_peered":"2024-09-11T05:24:25.432325+0000","last_unstale":"2024-09-11T05:24:38.315480+0000","last_undegraded":"2024-09-11T05:24:38.315480+0000","last_fullsized":"2024-09-11T05:24:38.315480+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:28.213667+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.024392765,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":4840,"num_read_kb":11502,"num_write":711,"num_write_kb":4822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":477,"num_bytes_recovered":9769435,"num_keys_recovered":57,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'749","reported_seq":6083,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315453+0000","last_change":"2024-09-11T05:24:26.471523+0000","last_active":"2024-09-11T05:24:38.315453+0000","last_peered":"2024-09-11T05:24:38.315453+0000","last_clean":"2024-09-11T05:24:38.315453+0000","last_became_active":"2024-09-11T05:24:26.439136+0000","last_became_peered":"2024-09-11T05:24:26.439136+0000","last_unstale":"2024-09-11T05:24:38.315453+0000","last_undegraded":"2024-09-11T05:24:38.315453+0000","last_fullsized":"2024-09-11T05:24:38.315453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:21.492643+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.029901693999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":6111,"num_read_kb":17930,"num_write":835,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":481,"num_bytes_recovered":10267580,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"163'783","reported_seq":5357,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318870+0000","last_change":"2024-09-11T05:24:26.444002+0000","last_active":"2024-09-11T05:24:38.318870+0000","last_peered":"2024-09-11T05:24:38.318870+0000","last_clean":"2024-09-11T05:24:38.318870+0000","last_became_active":"2024-09-11T05:24:26.442532+0000","last_became_peered":"2024-09-11T05:24:26.442532+0000","last_unstale":"2024-09-11T05:24:38.318870+0000","last_undegraded":"2024-09-11T05:24:38.318870+0000","last_fullsized":"2024-09-11T05:24:38.318870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:30.869953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079803399999999998,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":4582,"num_read_kb":11922,"num_write":924,"num_write_kb":11555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":637,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'307","reported_seq":7021,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315773+0000","last_change":"2024-09-11T05:24:25.441145+0000","last_active":"2024-09-11T05:24:38.315773+0000","last_peered":"2024-09-11T05:24:38.315773+0000","last_clean":"2024-09-11T05:24:38.315773+0000","last_became_active":"2024-09-11T05:24:25.439785+0000","last_became_peered":"2024-09-11T05:24:25.439785+0000","last_unstale":"2024-09-11T05:24:38.315773+0000","last_undegraded":"2024-09-11T05:24:38.315773+0000","last_fullsized":"2024-09-11T05:24:38.315773+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:35.897346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040559979999999999,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5755,"num_read_kb":39037,"num_write":265,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":15189092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'305","reported_seq":3881,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668713+0000","last_change":"2024-09-11T05:24:13.535934+0000","last_active":"2024-09-11T05:24:37.668713+0000","last_peered":"2024-09-11T05:24:37.668713+0000","last_clean":"2024-09-11T05:24:37.668713+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:24:37.668713+0000","last_undegraded":"2024-09-11T05:24:37.668713+0000","last_fullsized":"2024-09-11T05:24:37.668713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:37:15.297384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015515279999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":3067,"num_read_kb":14648,"num_write":273,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"164'847","reported_seq":12059,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670134+0000","last_change":"2024-09-11T05:24:13.535051+0000","last_active":"2024-09-11T05:24:37.670134+0000","last_peered":"2024-09-11T05:24:37.670134+0000","last_clean":"2024-09-11T05:24:37.670134+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:24:37.670134+0000","last_undegraded":"2024-09-11T05:24:37.670134+0000","last_fullsized":"2024-09-11T05:24:37.670134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:45.776994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077435600000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":14340,"num_read_kb":34884,"num_write":1189,"num_write_kb":15897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"169'690","reported_seq":5096,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318554+0000","last_change":"2024-09-11T05:24:24.434881+0000","last_active":"2024-09-11T05:24:38.318554+0000","last_peered":"2024-09-11T05:24:38.318554+0000","last_clean":"2024-09-11T05:24:38.318554+0000","last_became_active":"2024-09-11T05:24:24.433017+0000","last_became_peered":"2024-09-11T05:24:24.433017+0000","last_unstale":"2024-09-11T05:24:38.318554+0000","last_undegraded":"2024-09-11T05:24:38.318554+0000","last_fullsized":"2024-09-11T05:24:38.318554+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:19.680870+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.015034211,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6372,"num_read_kb":20126,"num_write":676,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"169'673","reported_seq":13227,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315386+0000","last_change":"2024-09-11T05:24:22.498729+0000","last_active":"2024-09-11T05:24:38.315386+0000","last_peered":"2024-09-11T05:24:38.315386+0000","last_clean":"2024-09-11T05:24:38.315386+0000","last_became_active":"2024-09-11T05:24:22.433313+0000","last_became_peered":"2024-09-11T05:24:22.433313+0000","last_unstale":"2024-09-11T05:24:38.315386+0000","last_undegraded":"2024-09-11T05:24:38.315386+0000","last_fullsized":"2024-09-11T05:24:38.315386+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:09.112953+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.021913140000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":13534,"num_read_kb":32568,"num_write":829,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'512","reported_seq":4153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667786+0000","last_change":"2024-09-11T05:24:13.549345+0000","last_active":"2024-09-11T05:24:37.667786+0000","last_peered":"2024-09-11T05:24:37.667786+0000","last_clean":"2024-09-11T05:24:37.667786+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:24:37.667786+0000","last_undegraded":"2024-09-11T05:24:37.667786+0000","last_fullsized":"2024-09-11T05:24:37.667786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:21.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042871879999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4537,"num_read_kb":20166,"num_write":454,"num_write_kb":6827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"162'554","reported_seq":5781,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315800+0000","last_change":"2024-09-11T05:24:26.443804+0000","last_active":"2024-09-11T05:24:38.315800+0000","last_peered":"2024-09-11T05:24:38.315800+0000","last_clean":"2024-09-11T05:24:38.315800+0000","last_became_active":"2024-09-11T05:24:26.441181+0000","last_became_peered":"2024-09-11T05:24:26.441181+0000","last_unstale":"2024-09-11T05:24:38.315800+0000","last_undegraded":"2024-09-11T05:24:38.315800+0000","last_fullsized":"2024-09-11T05:24:38.315800+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:06:06.791827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012850680000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5275,"num_read_kb":23266,"num_write":617,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315146+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:24:38.315146+0000","last_peered":"2024-09-11T05:24:38.315146+0000","last_clean":"2024-09-11T05:24:38.315146+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:24:38.315146+0000","last_undegraded":"2024-09-11T05:24:38.315146+0000","last_fullsized":"2024-09-11T05:24:38.315146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"164'723","reported_seq":8111,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318350+0000","last_change":"2024-09-11T05:24:13.541807+0000","last_active":"2024-09-11T05:24:38.318350+0000","last_peered":"2024-09-11T05:24:38.318350+0000","last_clean":"2024-09-11T05:24:38.318350+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:24:38.318350+0000","last_undegraded":"2024-09-11T05:24:38.318350+0000","last_fullsized":"2024-09-11T05:24:38.318350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:16.711331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021736070000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9295,"num_read_kb":23648,"num_write":666,"num_write_kb":13705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":354,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.669122+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:24:37.669122+0000","last_peered":"2024-09-11T05:24:37.669122+0000","last_clean":"2024-09-11T05:24:37.669122+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:24:37.669122+0000","last_undegraded":"2024-09-11T05:24:37.669122+0000","last_fullsized":"2024-09-11T05:24:37.669122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:16.276926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"162'573","reported_seq":4599,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670342+0000","last_change":"2024-09-11T05:24:13.537895+0000","last_active":"2024-09-11T05:24:37.670342+0000","last_peered":"2024-09-11T05:24:37.670342+0000","last_clean":"2024-09-11T05:24:37.670342+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:24:37.670342+0000","last_undegraded":"2024-09-11T05:24:37.670342+0000","last_fullsized":"2024-09-11T05:24:37.670342+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:29.987569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002015902,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5322,"num_read_kb":21543,"num_write":473,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667633+0000","last_change":"2024-09-11T05:24:11.547564+0000","last_active":"2024-09-11T05:24:37.667633+0000","last_peered":"2024-09-11T05:24:37.667633+0000","last_clean":"2024-09-11T05:24:37.667633+0000","last_became_active":"2024-09-11T05:24:11.547223+0000","last_became_peered":"2024-09-11T05:24:11.547223+0000","last_unstale":"2024-09-11T05:24:37.667633+0000","last_undegraded":"2024-09-11T05:24:37.667633+0000","last_fullsized":"2024-09-11T05:24:37.667633+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:46:09.745777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'530","reported_seq":2282,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668874+0000","last_change":"2024-09-11T05:24:13.537881+0000","last_active":"2024-09-11T05:24:37.668874+0000","last_peered":"2024-09-11T05:24:37.668874+0000","last_clean":"2024-09-11T05:24:37.668874+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:24:37.668874+0000","last_undegraded":"2024-09-11T05:24:37.668874+0000","last_fullsized":"2024-09-11T05:24:37.668874+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:50.170435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025491730000000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":2107,"num_read_kb":19783,"num_write":526,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":344,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668962+0000","last_change":"2024-09-11T05:21:34.795640+0000","last_active":"2024-09-11T05:24:37.668962+0000","last_peered":"2024-09-11T05:24:37.668962+0000","last_clean":"2024-09-11T05:24:37.668962+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:24:37.668962+0000","last_undegraded":"2024-09-11T05:24:37.668962+0000","last_fullsized":"2024-09-11T05:24:37.668962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:00.989840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"169'399","reported_seq":5681,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315491+0000","last_change":"2024-09-11T05:24:22.510730+0000","last_active":"2024-09-11T05:24:38.315491+0000","last_peered":"2024-09-11T05:24:38.315491+0000","last_clean":"2024-09-11T05:24:38.315491+0000","last_became_active":"2024-09-11T05:24:22.433696+0000","last_became_peered":"2024-09-11T05:24:22.433696+0000","last_unstale":"2024-09-11T05:24:38.315491+0000","last_undegraded":"2024-09-11T05:24:38.315491+0000","last_fullsized":"2024-09-11T05:24:38.315491+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:45.326247+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024975909000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5377,"num_read_kb":14833,"num_write":328,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"164'668","reported_seq":14116,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315896+0000","last_change":"2024-09-11T05:24:26.446558+0000","last_active":"2024-09-11T05:24:38.315896+0000","last_peered":"2024-09-11T05:24:38.315896+0000","last_clean":"2024-09-11T05:24:38.315896+0000","last_became_active":"2024-09-11T05:24:26.443148+0000","last_became_peered":"2024-09-11T05:24:26.443148+0000","last_unstale":"2024-09-11T05:24:38.315896+0000","last_undegraded":"2024-09-11T05:24:38.315896+0000","last_fullsized":"2024-09-11T05:24:38.315896+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:20:15.090299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017964610000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":13594,"num_read_kb":50789,"num_write":605,"num_write_kb":30482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":230,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315455+0000","last_change":"2024-09-11T05:24:22.435740+0000","last_active":"2024-09-11T05:24:38.315455+0000","last_peered":"2024-09-11T05:24:38.315455+0000","last_clean":"2024-09-11T05:24:38.315455+0000","last_became_active":"2024-09-11T05:24:22.434799+0000","last_became_peered":"2024-09-11T05:24:22.434799+0000","last_unstale":"2024-09-11T05:24:38.315455+0000","last_undegraded":"2024-09-11T05:24:38.315455+0000","last_fullsized":"2024-09-11T05:24:38.315455+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:14.874122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'912","reported_seq":5164,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668600+0000","last_change":"2024-09-11T05:24:13.535651+0000","last_active":"2024-09-11T05:24:37.668600+0000","last_peered":"2024-09-11T05:24:37.668600+0000","last_clean":"2024-09-11T05:24:37.668600+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:24:37.668600+0000","last_undegraded":"2024-09-11T05:24:37.668600+0000","last_fullsized":"2024-09-11T05:24:37.668600+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:56.429502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901449999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":7435,"num_read_kb":34307,"num_write":1162,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":309,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315872+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:24:38.315872+0000","last_peered":"2024-09-11T05:24:38.315872+0000","last_clean":"2024-09-11T05:24:38.315872+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:24:38.315872+0000","last_undegraded":"2024-09-11T05:24:38.315872+0000","last_fullsized":"2024-09-11T05:24:38.315872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:16.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"162'468","reported_seq":9565,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318695+0000","last_change":"2024-09-11T05:24:25.442092+0000","last_active":"2024-09-11T05:24:38.318695+0000","last_peered":"2024-09-11T05:24:38.318695+0000","last_clean":"2024-09-11T05:24:38.318695+0000","last_became_active":"2024-09-11T05:24:25.440625+0000","last_became_peered":"2024-09-11T05:24:25.440625+0000","last_unstale":"2024-09-11T05:24:38.318695+0000","last_undegraded":"2024-09-11T05:24:38.318695+0000","last_fullsized":"2024-09-11T05:24:38.318695+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:15.232006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010588730000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":8562,"num_read_kb":22875,"num_write":429,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":507,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667583+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:24:37.667583+0000","last_peered":"2024-09-11T05:24:37.667583+0000","last_clean":"2024-09-11T05:24:37.667583+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:24:37.667583+0000","last_undegraded":"2024-09-11T05:24:37.667583+0000","last_fullsized":"2024-09-11T05:24:37.667583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"169'796","reported_seq":3042,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670259+0000","last_change":"2024-09-11T05:24:22.489264+0000","last_active":"2024-09-11T05:24:37.670259+0000","last_peered":"2024-09-11T05:24:37.670259+0000","last_clean":"2024-09-11T05:24:37.670259+0000","last_became_active":"2024-09-11T05:24:22.436605+0000","last_became_peered":"2024-09-11T05:24:22.436605+0000","last_unstale":"2024-09-11T05:24:37.670259+0000","last_undegraded":"2024-09-11T05:24:37.670259+0000","last_fullsized":"2024-09-11T05:24:37.670259+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:31.985246+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024085374999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4368,"num_read_kb":14537,"num_write":970,"num_write_kb":6756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":285,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315347+0000","last_change":"2024-09-11T05:24:22.431069+0000","last_active":"2024-09-11T05:24:38.315347+0000","last_peered":"2024-09-11T05:24:38.315347+0000","last_clean":"2024-09-11T05:24:38.315347+0000","last_became_active":"2024-09-11T05:24:22.430596+0000","last_became_peered":"2024-09-11T05:24:22.430596+0000","last_unstale":"2024-09-11T05:24:38.315347+0000","last_undegraded":"2024-09-11T05:24:38.315347+0000","last_fullsized":"2024-09-11T05:24:38.315347+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:56:11.667506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":423,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667578+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:24:37.667578+0000","last_peered":"2024-09-11T05:24:37.667578+0000","last_clean":"2024-09-11T05:24:37.667578+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:24:37.667578+0000","last_undegraded":"2024-09-11T05:24:37.667578+0000","last_fullsized":"2024-09-11T05:24:37.667578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"162'421","reported_seq":5788,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670186+0000","last_change":"2024-09-11T05:24:13.537545+0000","last_active":"2024-09-11T05:24:37.670186+0000","last_peered":"2024-09-11T05:24:37.670186+0000","last_clean":"2024-09-11T05:24:37.670186+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:24:37.670186+0000","last_undegraded":"2024-09-11T05:24:37.670186+0000","last_fullsized":"2024-09-11T05:24:37.670186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:35.277746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018840860000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4982,"num_read_kb":21766,"num_write":373,"num_write_kb":9562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'712","reported_seq":2742,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315622+0000","last_change":"2024-09-11T05:24:25.438536+0000","last_active":"2024-09-11T05:24:38.315622+0000","last_peered":"2024-09-11T05:24:38.315622+0000","last_clean":"2024-09-11T05:24:38.315622+0000","last_became_active":"2024-09-11T05:24:25.435777+0000","last_became_peered":"2024-09-11T05:24:25.435777+0000","last_unstale":"2024-09-11T05:24:38.315622+0000","last_undegraded":"2024-09-11T05:24:38.315622+0000","last_fullsized":"2024-09-11T05:24:38.315622+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:32.898916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00122751,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":2844,"num_read_kb":3973,"num_write":882,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":643,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'673","reported_seq":4517,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315189+0000","last_change":"2024-09-11T05:24:25.436040+0000","last_active":"2024-09-11T05:24:38.315189+0000","last_peered":"2024-09-11T05:24:38.315189+0000","last_clean":"2024-09-11T05:24:38.315189+0000","last_became_active":"2024-09-11T05:24:25.434584+0000","last_became_peered":"2024-09-11T05:24:25.434584+0000","last_unstale":"2024-09-11T05:24:38.315189+0000","last_undegraded":"2024-09-11T05:24:38.315189+0000","last_fullsized":"2024-09-11T05:24:38.315189+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:05.235489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011019910000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":4234,"num_read_kb":17484,"num_write":743,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'644","reported_seq":3524,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670170+0000","last_change":"2024-09-11T05:24:13.537129+0000","last_active":"2024-09-11T05:24:37.670170+0000","last_peered":"2024-09-11T05:24:37.670170+0000","last_clean":"2024-09-11T05:24:37.670170+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:24:37.670170+0000","last_undegraded":"2024-09-11T05:24:37.670170+0000","last_fullsized":"2024-09-11T05:24:37.670170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:29.964662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013836460000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4403,"num_read_kb":10564,"num_write":654,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"169'347","reported_seq":1487,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315604+0000","last_change":"2024-09-11T05:24:22.458771+0000","last_active":"2024-09-11T05:24:38.315604+0000","last_peered":"2024-09-11T05:24:38.315604+0000","last_clean":"2024-09-11T05:24:38.315604+0000","last_became_active":"2024-09-11T05:24:22.431901+0000","last_became_peered":"2024-09-11T05:24:22.431901+0000","last_unstale":"2024-09-11T05:24:38.315604+0000","last_undegraded":"2024-09-11T05:24:38.315604+0000","last_fullsized":"2024-09-11T05:24:38.315604+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:44.514731+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.018393828000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":816,"num_read_kb":10764,"num_write":338,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"169'850","reported_seq":5273,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667819+0000","last_change":"2024-09-11T05:24:22.533001+0000","last_active":"2024-09-11T05:24:37.667819+0000","last_peered":"2024-09-11T05:24:37.667819+0000","last_clean":"2024-09-11T05:24:37.667819+0000","last_became_active":"2024-09-11T05:24:22.437877+0000","last_became_peered":"2024-09-11T05:24:22.437877+0000","last_unstale":"2024-09-11T05:24:37.667819+0000","last_undegraded":"2024-09-11T05:24:37.667819+0000","last_fullsized":"2024-09-11T05:24:37.667819+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:17.940976+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.019759079999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":7315,"num_read_kb":39380,"num_write":944,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'525","reported_seq":4831,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667831+0000","last_change":"2024-09-11T05:24:25.439659+0000","last_active":"2024-09-11T05:24:37.667831+0000","last_peered":"2024-09-11T05:24:37.667831+0000","last_clean":"2024-09-11T05:24:37.667831+0000","last_became_active":"2024-09-11T05:24:25.437899+0000","last_became_peered":"2024-09-11T05:24:25.437899+0000","last_unstale":"2024-09-11T05:24:37.667831+0000","last_undegraded":"2024-09-11T05:24:37.667831+0000","last_fullsized":"2024-09-11T05:24:37.667831+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:26.967470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020611689999999998,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":3727,"num_read_kb":10330,"num_write":542,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"162'806","reported_seq":5017,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667904+0000","last_change":"2024-09-11T05:24:26.445868+0000","last_active":"2024-09-11T05:24:37.667904+0000","last_peered":"2024-09-11T05:24:37.667904+0000","last_clean":"2024-09-11T05:24:37.667904+0000","last_became_active":"2024-09-11T05:24:26.443227+0000","last_became_peered":"2024-09-11T05:24:26.443227+0000","last_unstale":"2024-09-11T05:24:37.667904+0000","last_undegraded":"2024-09-11T05:24:37.667904+0000","last_fullsized":"2024-09-11T05:24:37.667904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:49.198435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040415420000000004,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6010,"num_read_kb":20011,"num_write":960,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"162'658","reported_seq":2584,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315145+0000","last_change":"2024-09-11T05:24:13.588716+0000","last_active":"2024-09-11T05:24:38.315145+0000","last_peered":"2024-09-11T05:24:38.315145+0000","last_clean":"2024-09-11T05:24:38.315145+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:24:38.315145+0000","last_undegraded":"2024-09-11T05:24:38.315145+0000","last_fullsized":"2024-09-11T05:24:38.315145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.995244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010089490000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":3453,"num_read_kb":10043,"num_write":799,"num_write_kb":6150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"163'469","reported_seq":4204,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667711+0000","last_change":"2024-09-11T05:24:26.443799+0000","last_active":"2024-09-11T05:24:37.667711+0000","last_peered":"2024-09-11T05:24:37.667711+0000","last_clean":"2024-09-11T05:24:37.667711+0000","last_became_active":"2024-09-11T05:24:26.441576+0000","last_became_peered":"2024-09-11T05:24:26.441576+0000","last_unstale":"2024-09-11T05:24:37.667711+0000","last_undegraded":"2024-09-11T05:24:37.667711+0000","last_fullsized":"2024-09-11T05:24:37.667711+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:44.192222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027819350000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3620,"num_read_kb":8678,"num_write":401,"num_write_kb":3589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":619,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"163'622","reported_seq":7594,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318084+0000","last_change":"2024-09-11T05:24:24.434766+0000","last_active":"2024-09-11T05:24:38.318084+0000","last_peered":"2024-09-11T05:24:38.318084+0000","last_clean":"2024-09-11T05:24:38.318084+0000","last_became_active":"2024-09-11T05:24:24.433236+0000","last_became_peered":"2024-09-11T05:24:24.433236+0000","last_unstale":"2024-09-11T05:24:38.318084+0000","last_undegraded":"2024-09-11T05:24:38.318084+0000","last_fullsized":"2024-09-11T05:24:38.318084+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:20.967512+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00075108200000000003,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7982,"num_read_kb":29519,"num_write":609,"num_write_kb":13736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'788","reported_seq":4239,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667705+0000","last_change":"2024-09-11T05:24:26.446184+0000","last_active":"2024-09-11T05:24:37.667705+0000","last_peered":"2024-09-11T05:24:37.667705+0000","last_clean":"2024-09-11T05:24:37.667705+0000","last_became_active":"2024-09-11T05:24:26.442736+0000","last_became_peered":"2024-09-11T05:24:26.442736+0000","last_unstale":"2024-09-11T05:24:37.667705+0000","last_undegraded":"2024-09-11T05:24:37.667705+0000","last_fullsized":"2024-09-11T05:24:37.667705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:54.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051100649999999996,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":4954,"num_read_kb":19877,"num_write":1038,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":674,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1183,"num_object_clones":0,"num_object_copies":2366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":1179,"num_read":192556,"num_read_kb":678057,"num_write":21640,"num_write_kb":308752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8811,"num_bytes_recovered":208681536,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23429,"internal_metadata":0},"log_size":20010,"ondisk_log_size":20010,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2195456,"data_stored":1066957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":168,"seq":721554505734,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":2172,"kb_used_omap":30,"kb_used_meta":29089,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":2224128,"data_stored":1078602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31735,"internal_metadata":29787145},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51396,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320444,"statfs":{"total":96636764160,"available":96584134656,"internally_reserved":0,"allocated":2211840,"data_stored":1072789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154775,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38800,"kb_used_data":2168,"kb_used_omap":11,"kb_used_meta":36596,"kb_avail":94333040,"statfs":{"total":96636764160,"available":96597032960,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":37475126},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59736,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312104,"statfs":{"total":96636764160,"available":96575594496,"internally_reserved":0,"allocated":2228224,"data_stored":1078621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47812,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324028,"statfs":{"total":96636764160,"available":96587804672,"internally_reserved":0,"allocated":2801664,"data_stored":1663138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17043,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:24:42.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:24:43.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:43.115 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":184,"fsid":"5fd14db5-8ee9-4e34-bd57-a8040293ab17","created":"2024-09-11T05:21:12.602514+0000","modified":"2024-09-11T05:24:37.661431+0000","last_up_change":"2024-09-11T05:24:21.584312+0000","last_in_change":"2024-09-11T05:24:21.584312+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:21:27.582783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:21:31.353652+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T05:21:41.109530+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":50,"snap_epoch":164,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e628e137-3e68-4084-a084-200022b8da35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6809","nonce":2997410357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6811","nonce":2997410357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6815","nonce":2997410357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2997410357},{"type":"v1","addr":"172.21.15.12:6813","nonce":2997410357}]},"public_addr":"172.21.15.12:6809/2997410357","cluster_addr":"172.21.15.12:6811/2997410357","heartbeat_back_addr":"172.21.15.12:6815/2997410357","heartbeat_front_addr":"172.21.15.12:6813/2997410357","state":["exists","up"]},{"osd":1,"uuid":"26db6fe3-81d0-40ae-a4e1-9a7460fabc2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6817","nonce":852655937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6819","nonce":852655937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6823","nonce":852655937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":852655937},{"type":"v1","addr":"172.21.15.12:6821","nonce":852655937}]},"public_addr":"172.21.15.12:6817/852655937","cluster_addr":"172.21.15.12:6819/852655937","heartbeat_back_addr":"172.21.15.12:6823/852655937","heartbeat_front_addr":"172.21.15.12:6821/852655937","state":["exists","up"]},{"osd":2,"uuid":"00ff2990-a7cb-48a2-ab03-6739942d65d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":70,"up_from":87,"up_thru":170,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6825","nonce":2878270387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6827","nonce":2878270387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6831","nonce":2878270387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2878270387},{"type":"v1","addr":"172.21.15.12:6829","nonce":2878270387}]},"public_addr":"172.21.15.12:6825/2878270387","cluster_addr":"172.21.15.12:6827/2878270387","heartbeat_back_addr":"172.21.15.12:6831/2878270387","heartbeat_front_addr":"172.21.15.12:6829/2878270387","state":["exists","up"]},{"osd":3,"uuid":"d1c858fd-7b66-4e1b-aa18-e3fd567e1417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6801","nonce":2211289880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6803","nonce":2211289880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6807","nonce":2211289880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2211289880},{"type":"v1","addr":"172.21.15.12:6805","nonce":2211289880}]},"public_addr":"172.21.15.12:6801/2211289880","cluster_addr":"172.21.15.12:6803/2211289880","heartbeat_back_addr":"172.21.15.12:6807/2211289880","heartbeat_front_addr":"172.21.15.12:6805/2211289880","state":["exists","up"]},{"osd":4,"uuid":"586534a4-d5e3-4af4-a2e5-aa4ec052b582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6801","nonce":1639325236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6803","nonce":1639325236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6807","nonce":1639325236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1639325236},{"type":"v1","addr":"172.21.15.153:6805","nonce":1639325236}]},"public_addr":"172.21.15.153:6801/1639325236","cluster_addr":"172.21.15.153:6803/1639325236","heartbeat_back_addr":"172.21.15.153:6807/1639325236","heartbeat_front_addr":"172.21.15.153:6805/1639325236","state":["exists","up"]},{"osd":5,"uuid":"801041dc-7a4c-4776-bfbb-68be37655407","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":145,"up_from":168,"up_thru":172,"down_at":146,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6817","nonce":44707044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6819","nonce":44707044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6823","nonce":44707044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":44707044},{"type":"v1","addr":"172.21.15.153:6821","nonce":44707044}]},"public_addr":"172.21.15.153:6817/44707044","cluster_addr":"172.21.15.153:6819/44707044","heartbeat_back_addr":"172.21.15.153:6823/44707044","heartbeat_front_addr":"172.21.15.153:6821/44707044","state":["exists","up"]},{"osd":6,"uuid":"e0820ac1-b43f-486f-9d7b-155b46b33950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6827","nonce":1798055911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6829","nonce":1798055911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6833","nonce":1798055911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":1798055911},{"type":"v1","addr":"172.21.15.153:6831","nonce":1798055911}]},"public_addr":"172.21.15.153:6827/1798055911","cluster_addr":"172.21.15.153:6829/1798055911","heartbeat_back_addr":"172.21.15.153:6833/1798055911","heartbeat_front_addr":"172.21.15.153:6831/1798055911","state":["exists","up"]},{"osd":7,"uuid":"e22fdfda-9a13-42f2-be4f-f7c6e0ffd324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6809","nonce":1122624549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6811","nonce":1122624549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6815","nonce":1122624549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1122624549},{"type":"v1","addr":"172.21.15.153:6813","nonce":1122624549}]},"public_addr":"172.21.15.153:6809/1122624549","cluster_addr":"172.21.15.153:6811/1122624549","heartbeat_back_addr":"172.21.15.153:6815/1122624549","heartbeat_front_addr":"172.21.15.153:6813/1122624549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.912439+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.788769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.857319+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.926699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.752975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.222079+0000","dead_epoch":146},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:22.095040+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:21:21.860946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:24:44.128 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T05:24:44.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:44.269 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:44.269 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:24:44.269 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:44.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T05:24:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T05:24:44.585 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T05:24:44.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:44.720 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:44.720 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:24:44.720 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:44.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T05:24:45.020 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T05:24:45.033 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T05:24:45.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:45.160 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:24:45.160 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:45.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T05:24:45.464 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T05:24:45.477 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T05:24:45.478 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:45.604 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:24:45.604 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:45.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T05:24:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T05:24:45.922 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T05:24:45.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:46.050 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:24:46.051 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:46.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T05:24:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T05:24:46.365 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T05:24:46.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:46.503 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:46.503 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-11T05:24:46.503 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:46.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T05:24:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T05:24:46.821 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T05:24:46.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:46.956 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:46.956 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:24:46.956 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:46.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T05:24:47.257 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T05:24:47.270 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T05:24:47.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:24:47.398 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T05:24:47.398 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:24:47.398 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T05:24:47.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T05:24:47.712 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T05:24:47.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:24:48.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:24:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:24:48.046 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-11T05:24:47.572741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1187,"num_object_clones":0,"num_object_copies":2374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":1179,"num_read":192672,"num_read_kb":678157,"num_write":21801,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8815,"num_bytes_recovered":209862272,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20269,"ondisk_log_size":20269,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":404672,"kb_used_data":18520,"kb_used_omap":51,"kb_used_meta":385932,"kb_avail":754570048,"statfs":{"total":773094113280,"available":772679729152,"internally_reserved":0,"allocated":18964480,"data_stored":9809476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52761,"internal_metadata":395194855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002334"},"pg_stats":[{"pgid":"3.1f","version":"184'784","reported_seq":4352,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:45.651525+0000","last_change":"2024-09-11T05:24:45.651559+0000","last_active":"2024-09-11T05:24:45.651525+0000","last_peered":"2024-09-11T05:24:45.651525+0000","last_clean":"2024-09-11T05:24:45.651525+0000","last_became_active":"2024-09-11T05:24:22.436523+0000","last_became_peered":"2024-09-11T05:24:22.436523+0000","last_unstale":"2024-09-11T05:24:45.651525+0000","last_undegraded":"2024-09-11T05:24:45.651525+0000","last_fullsized":"2024-09-11T05:24:45.651525+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'784","last_scrub_stamp":"2024-09-11T05:24:45.651447+0000","last_deep_scrub":"184'784","last_deep_scrub_stamp":"2024-09-11T05:24:45.651447+0000","last_clean_scrub_stamp":"2024-09-11T05:24:45.651447+0000","objects_scrubbed":32,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:48.984764+0000","scrub_duration":23,"objects_trimmed":18,"snaptrim_duration":0.027684375000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":5366,"num_read_kb":22197,"num_write":753,"num_write_kb":10362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'621","reported_seq":7379,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670361+0000","last_change":"2024-09-11T05:24:13.538318+0000","last_active":"2024-09-11T05:24:37.670361+0000","last_peered":"2024-09-11T05:24:37.670361+0000","last_clean":"2024-09-11T05:24:37.670361+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:24:37.670361+0000","last_undegraded":"2024-09-11T05:24:37.670361+0000","last_fullsized":"2024-09-11T05:24:37.670361+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020765789999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":8377,"num_read_kb":25107,"num_write":672,"num_write_kb":13431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"172'633","reported_seq":4787,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315480+0000","last_change":"2024-09-11T05:24:25.459113+0000","last_active":"2024-09-11T05:24:38.315480+0000","last_peered":"2024-09-11T05:24:38.315480+0000","last_clean":"2024-09-11T05:24:38.315480+0000","last_became_active":"2024-09-11T05:24:25.432325+0000","last_became_peered":"2024-09-11T05:24:25.432325+0000","last_unstale":"2024-09-11T05:24:38.315480+0000","last_undegraded":"2024-09-11T05:24:38.315480+0000","last_fullsized":"2024-09-11T05:24:38.315480+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:28.213667+0000","scrub_duration":0,"objects_trimmed":12,"snaptrim_duration":0.024392765,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":4840,"num_read_kb":11502,"num_write":711,"num_write_kb":4822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":477,"num_bytes_recovered":9769435,"num_keys_recovered":57,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"173'749","reported_seq":6083,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315453+0000","last_change":"2024-09-11T05:24:26.471523+0000","last_active":"2024-09-11T05:24:38.315453+0000","last_peered":"2024-09-11T05:24:38.315453+0000","last_clean":"2024-09-11T05:24:38.315453+0000","last_became_active":"2024-09-11T05:24:26.439136+0000","last_became_peered":"2024-09-11T05:24:26.439136+0000","last_unstale":"2024-09-11T05:24:38.315453+0000","last_undegraded":"2024-09-11T05:24:38.315453+0000","last_fullsized":"2024-09-11T05:24:38.315453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:21.492643+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.029901693999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":6111,"num_read_kb":17930,"num_write":835,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":481,"num_bytes_recovered":10267580,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"163'783","reported_seq":5358,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318913+0000","last_change":"2024-09-11T05:24:26.444002+0000","last_active":"2024-09-11T05:24:38.318913+0000","last_peered":"2024-09-11T05:24:38.318913+0000","last_clean":"2024-09-11T05:24:38.318913+0000","last_became_active":"2024-09-11T05:24:26.442532+0000","last_became_peered":"2024-09-11T05:24:26.442532+0000","last_unstale":"2024-09-11T05:24:38.318913+0000","last_undegraded":"2024-09-11T05:24:38.318913+0000","last_fullsized":"2024-09-11T05:24:38.318913+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079803399999999998,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":4582,"num_read_kb":11922,"num_write":924,"num_write_kb":11555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":637,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'307","reported_seq":7022,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315821+0000","last_change":"2024-09-11T05:24:25.441145+0000","last_active":"2024-09-11T05:24:38.315821+0000","last_peered":"2024-09-11T05:24:38.315821+0000","last_clean":"2024-09-11T05:24:38.315821+0000","last_became_active":"2024-09-11T05:24:25.439785+0000","last_became_peered":"2024-09-11T05:24:25.439785+0000","last_unstale":"2024-09-11T05:24:38.315821+0000","last_undegraded":"2024-09-11T05:24:38.315821+0000","last_fullsized":"2024-09-11T05:24:38.315821+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040559979999999999,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5755,"num_read_kb":39037,"num_write":265,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":15189092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"184'341","reported_seq":3927,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:46.504552+0000","last_change":"2024-09-11T05:24:46.504615+0000","last_active":"2024-09-11T05:24:46.504552+0000","last_peered":"2024-09-11T05:24:46.504552+0000","last_clean":"2024-09-11T05:24:46.504552+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:24:46.504552+0000","last_undegraded":"2024-09-11T05:24:46.504552+0000","last_fullsized":"2024-09-11T05:24:46.504552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'341","last_scrub_stamp":"2024-09-11T05:24:46.504458+0000","last_deep_scrub":"184'341","last_deep_scrub_stamp":"2024-09-11T05:24:46.504458+0000","last_clean_scrub_stamp":"2024-09-11T05:24:46.504458+0000","objects_scrubbed":36,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:06.132093+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.0015515279999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":3067,"num_read_kb":14648,"num_write":273,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"164'847","reported_seq":12060,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670194+0000","last_change":"2024-09-11T05:24:13.535051+0000","last_active":"2024-09-11T05:24:37.670194+0000","last_peered":"2024-09-11T05:24:37.670194+0000","last_clean":"2024-09-11T05:24:37.670194+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:24:37.670194+0000","last_undegraded":"2024-09-11T05:24:37.670194+0000","last_fullsized":"2024-09-11T05:24:37.670194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077435600000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":14340,"num_read_kb":34884,"num_write":1189,"num_write_kb":15897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"169'690","reported_seq":5097,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318596+0000","last_change":"2024-09-11T05:24:24.434881+0000","last_active":"2024-09-11T05:24:38.318596+0000","last_peered":"2024-09-11T05:24:38.318596+0000","last_clean":"2024-09-11T05:24:38.318596+0000","last_became_active":"2024-09-11T05:24:24.433017+0000","last_became_peered":"2024-09-11T05:24:24.433017+0000","last_unstale":"2024-09-11T05:24:38.318596+0000","last_undegraded":"2024-09-11T05:24:38.318596+0000","last_fullsized":"2024-09-11T05:24:38.318596+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.015034211,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6372,"num_read_kb":20126,"num_write":676,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"169'673","reported_seq":13227,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315386+0000","last_change":"2024-09-11T05:24:22.498729+0000","last_active":"2024-09-11T05:24:38.315386+0000","last_peered":"2024-09-11T05:24:38.315386+0000","last_clean":"2024-09-11T05:24:38.315386+0000","last_became_active":"2024-09-11T05:24:22.433313+0000","last_became_peered":"2024-09-11T05:24:22.433313+0000","last_unstale":"2024-09-11T05:24:38.315386+0000","last_undegraded":"2024-09-11T05:24:38.315386+0000","last_fullsized":"2024-09-11T05:24:38.315386+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:09.112953+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.021913140000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":13534,"num_read_kb":32568,"num_write":829,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'512","reported_seq":4153,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667786+0000","last_change":"2024-09-11T05:24:13.549345+0000","last_active":"2024-09-11T05:24:37.667786+0000","last_peered":"2024-09-11T05:24:37.667786+0000","last_clean":"2024-09-11T05:24:37.667786+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:24:37.667786+0000","last_undegraded":"2024-09-11T05:24:37.667786+0000","last_fullsized":"2024-09-11T05:24:37.667786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:21.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042871879999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4537,"num_read_kb":20166,"num_write":454,"num_write_kb":6827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"162'554","reported_seq":5782,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315866+0000","last_change":"2024-09-11T05:24:26.443804+0000","last_active":"2024-09-11T05:24:38.315866+0000","last_peered":"2024-09-11T05:24:38.315866+0000","last_clean":"2024-09-11T05:24:38.315866+0000","last_became_active":"2024-09-11T05:24:26.441181+0000","last_became_peered":"2024-09-11T05:24:26.441181+0000","last_unstale":"2024-09-11T05:24:38.315866+0000","last_undegraded":"2024-09-11T05:24:38.315866+0000","last_fullsized":"2024-09-11T05:24:38.315866+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012850680000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5275,"num_read_kb":23266,"num_write":617,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315146+0000","last_change":"2024-09-11T05:23:07.413525+0000","last_active":"2024-09-11T05:24:38.315146+0000","last_peered":"2024-09-11T05:24:38.315146+0000","last_clean":"2024-09-11T05:24:38.315146+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:24:38.315146+0000","last_undegraded":"2024-09-11T05:24:38.315146+0000","last_fullsized":"2024-09-11T05:24:38.315146+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:51.850676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"184'764","reported_seq":8162,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:44.686128+0000","last_change":"2024-09-11T05:24:44.686206+0000","last_active":"2024-09-11T05:24:44.686128+0000","last_peered":"2024-09-11T05:24:44.686128+0000","last_clean":"2024-09-11T05:24:44.686128+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:24:44.686128+0000","last_undegraded":"2024-09-11T05:24:44.686128+0000","last_fullsized":"2024-09-11T05:24:44.686128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'764","last_scrub_stamp":"2024-09-11T05:24:44.686034+0000","last_deep_scrub":"184'764","last_deep_scrub_stamp":"2024-09-11T05:24:44.686034+0000","last_clean_scrub_stamp":"2024-09-11T05:24:44.686034+0000","objects_scrubbed":41,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:09.728385+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0.0021736070000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9295,"num_read_kb":23648,"num_write":666,"num_write_kb":13705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":355,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.669168+0000","last_change":"2024-09-11T05:22:07.404446+0000","last_active":"2024-09-11T05:24:37.669168+0000","last_peered":"2024-09-11T05:24:37.669168+0000","last_clean":"2024-09-11T05:24:37.669168+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:24:37.669168+0000","last_undegraded":"2024-09-11T05:24:37.669168+0000","last_fullsized":"2024-09-11T05:24:37.669168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"162'573","reported_seq":4600,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670397+0000","last_change":"2024-09-11T05:24:13.537895+0000","last_active":"2024-09-11T05:24:37.670397+0000","last_peered":"2024-09-11T05:24:37.670397+0000","last_clean":"2024-09-11T05:24:37.670397+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:24:37.670397+0000","last_undegraded":"2024-09-11T05:24:37.670397+0000","last_fullsized":"2024-09-11T05:24:37.670397+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002015902,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5322,"num_read_kb":21543,"num_write":473,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667633+0000","last_change":"2024-09-11T05:24:11.547564+0000","last_active":"2024-09-11T05:24:37.667633+0000","last_peered":"2024-09-11T05:24:37.667633+0000","last_clean":"2024-09-11T05:24:37.667633+0000","last_became_active":"2024-09-11T05:24:11.547223+0000","last_became_peered":"2024-09-11T05:24:11.547223+0000","last_unstale":"2024-09-11T05:24:37.667633+0000","last_undegraded":"2024-09-11T05:24:37.667633+0000","last_fullsized":"2024-09-11T05:24:37.667633+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:46:09.745777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'530","reported_seq":2283,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668924+0000","last_change":"2024-09-11T05:24:13.537881+0000","last_active":"2024-09-11T05:24:37.668924+0000","last_peered":"2024-09-11T05:24:37.668924+0000","last_clean":"2024-09-11T05:24:37.668924+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:24:37.668924+0000","last_undegraded":"2024-09-11T05:24:37.668924+0000","last_fullsized":"2024-09-11T05:24:37.668924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025491730000000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":2107,"num_read_kb":19783,"num_write":526,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":353,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:45.463450+0000","last_change":"2024-09-11T05:24:45.463468+0000","last_active":"2024-09-11T05:24:45.463450+0000","last_peered":"2024-09-11T05:24:45.463450+0000","last_clean":"2024-09-11T05:24:45.463450+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:24:45.463450+0000","last_undegraded":"2024-09-11T05:24:45.463450+0000","last_fullsized":"2024-09-11T05:24:45.463450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:24:45.463374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:24:45.463374+0000","last_clean_scrub_stamp":"2024-09-11T05:24:45.463374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:48:01.285658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"169'399","reported_seq":5681,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315491+0000","last_change":"2024-09-11T05:24:22.510730+0000","last_active":"2024-09-11T05:24:38.315491+0000","last_peered":"2024-09-11T05:24:38.315491+0000","last_clean":"2024-09-11T05:24:38.315491+0000","last_became_active":"2024-09-11T05:24:22.433696+0000","last_became_peered":"2024-09-11T05:24:22.433696+0000","last_unstale":"2024-09-11T05:24:38.315491+0000","last_undegraded":"2024-09-11T05:24:38.315491+0000","last_fullsized":"2024-09-11T05:24:38.315491+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:45.326247+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024975909000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5377,"num_read_kb":14833,"num_write":328,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"164'668","reported_seq":14117,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315938+0000","last_change":"2024-09-11T05:24:26.446558+0000","last_active":"2024-09-11T05:24:38.315938+0000","last_peered":"2024-09-11T05:24:38.315938+0000","last_clean":"2024-09-11T05:24:38.315938+0000","last_became_active":"2024-09-11T05:24:26.443148+0000","last_became_peered":"2024-09-11T05:24:26.443148+0000","last_unstale":"2024-09-11T05:24:38.315938+0000","last_undegraded":"2024-09-11T05:24:38.315938+0000","last_fullsized":"2024-09-11T05:24:38.315938+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017964610000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":13594,"num_read_kb":50789,"num_write":605,"num_write_kb":30482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":230,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315455+0000","last_change":"2024-09-11T05:24:22.435740+0000","last_active":"2024-09-11T05:24:38.315455+0000","last_peered":"2024-09-11T05:24:38.315455+0000","last_clean":"2024-09-11T05:24:38.315455+0000","last_became_active":"2024-09-11T05:24:22.434799+0000","last_became_peered":"2024-09-11T05:24:22.434799+0000","last_unstale":"2024-09-11T05:24:38.315455+0000","last_undegraded":"2024-09-11T05:24:38.315455+0000","last_fullsized":"2024-09-11T05:24:38.315455+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:14.874122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"162'912","reported_seq":5165,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.668675+0000","last_change":"2024-09-11T05:24:13.535651+0000","last_active":"2024-09-11T05:24:37.668675+0000","last_peered":"2024-09-11T05:24:37.668675+0000","last_clean":"2024-09-11T05:24:37.668675+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:24:37.668675+0000","last_undegraded":"2024-09-11T05:24:37.668675+0000","last_fullsized":"2024-09-11T05:24:37.668675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901449999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":7435,"num_read_kb":34307,"num_write":1162,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":310,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315926+0000","last_change":"2024-09-11T05:22:57.411575+0000","last_active":"2024-09-11T05:24:38.315926+0000","last_peered":"2024-09-11T05:24:38.315926+0000","last_clean":"2024-09-11T05:24:38.315926+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:24:38.315926+0000","last_undegraded":"2024-09-11T05:24:38.315926+0000","last_fullsized":"2024-09-11T05:24:38.315926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"162'468","reported_seq":9566,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.318739+0000","last_change":"2024-09-11T05:24:25.442092+0000","last_active":"2024-09-11T05:24:38.318739+0000","last_peered":"2024-09-11T05:24:38.318739+0000","last_clean":"2024-09-11T05:24:38.318739+0000","last_became_active":"2024-09-11T05:24:25.440625+0000","last_became_peered":"2024-09-11T05:24:25.440625+0000","last_unstale":"2024-09-11T05:24:38.318739+0000","last_undegraded":"2024-09-11T05:24:38.318739+0000","last_fullsized":"2024-09-11T05:24:38.318739+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010588730000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":8562,"num_read_kb":22875,"num_write":429,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":507,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667583+0000","last_change":"2024-09-11T05:23:07.420329+0000","last_active":"2024-09-11T05:24:37.667583+0000","last_peered":"2024-09-11T05:24:37.667583+0000","last_clean":"2024-09-11T05:24:37.667583+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:24:37.667583+0000","last_undegraded":"2024-09-11T05:24:37.667583+0000","last_fullsized":"2024-09-11T05:24:37.667583+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:05.522485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"169'796","reported_seq":3043,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670330+0000","last_change":"2024-09-11T05:24:22.489264+0000","last_active":"2024-09-11T05:24:37.670330+0000","last_peered":"2024-09-11T05:24:37.670330+0000","last_clean":"2024-09-11T05:24:37.670330+0000","last_became_active":"2024-09-11T05:24:22.436605+0000","last_became_peered":"2024-09-11T05:24:22.436605+0000","last_unstale":"2024-09-11T05:24:37.670330+0000","last_undegraded":"2024-09-11T05:24:37.670330+0000","last_fullsized":"2024-09-11T05:24:37.670330+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.024085374999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4368,"num_read_kb":14537,"num_write":970,"num_write_kb":6756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":285,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315347+0000","last_change":"2024-09-11T05:24:22.431069+0000","last_active":"2024-09-11T05:24:38.315347+0000","last_peered":"2024-09-11T05:24:38.315347+0000","last_clean":"2024-09-11T05:24:38.315347+0000","last_became_active":"2024-09-11T05:24:22.430596+0000","last_became_peered":"2024-09-11T05:24:22.430596+0000","last_unstale":"2024-09-11T05:24:38.315347+0000","last_undegraded":"2024-09-11T05:24:38.315347+0000","last_fullsized":"2024-09-11T05:24:38.315347+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:31.754289+0000","last_clean_scrub_stamp":"2024-09-11T05:21:31.754289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:56:11.667506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":423,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667578+0000","last_change":"2024-09-11T05:23:10.601849+0000","last_active":"2024-09-11T05:24:37.667578+0000","last_peered":"2024-09-11T05:24:37.667578+0000","last_clean":"2024-09-11T05:24:37.667578+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:24:37.667578+0000","last_undegraded":"2024-09-11T05:24:37.667578+0000","last_fullsized":"2024-09-11T05:24:37.667578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:27.735118+0000","last_clean_scrub_stamp":"2024-09-11T05:21:27.735118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:57.371519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"162'421","reported_seq":5789,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670405+0000","last_change":"2024-09-11T05:24:13.537545+0000","last_active":"2024-09-11T05:24:37.670405+0000","last_peered":"2024-09-11T05:24:37.670405+0000","last_clean":"2024-09-11T05:24:37.670405+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:24:37.670405+0000","last_undegraded":"2024-09-11T05:24:37.670405+0000","last_fullsized":"2024-09-11T05:24:37.670405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018840860000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4982,"num_read_kb":21766,"num_write":373,"num_write_kb":9562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'712","reported_seq":2743,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315676+0000","last_change":"2024-09-11T05:24:25.438536+0000","last_active":"2024-09-11T05:24:38.315676+0000","last_peered":"2024-09-11T05:24:38.315676+0000","last_clean":"2024-09-11T05:24:38.315676+0000","last_became_active":"2024-09-11T05:24:25.435777+0000","last_became_peered":"2024-09-11T05:24:25.435777+0000","last_unstale":"2024-09-11T05:24:38.315676+0000","last_undegraded":"2024-09-11T05:24:38.315676+0000","last_fullsized":"2024-09-11T05:24:38.315676+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00122751,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":2844,"num_read_kb":3973,"num_write":882,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":643,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'673","reported_seq":4517,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315189+0000","last_change":"2024-09-11T05:24:25.436040+0000","last_active":"2024-09-11T05:24:38.315189+0000","last_peered":"2024-09-11T05:24:38.315189+0000","last_clean":"2024-09-11T05:24:38.315189+0000","last_became_active":"2024-09-11T05:24:25.434584+0000","last_became_peered":"2024-09-11T05:24:25.434584+0000","last_unstale":"2024-09-11T05:24:38.315189+0000","last_undegraded":"2024-09-11T05:24:38.315189+0000","last_fullsized":"2024-09-11T05:24:38.315189+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:05.235489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011019910000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":4234,"num_read_kb":17484,"num_write":743,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'644","reported_seq":3525,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.670222+0000","last_change":"2024-09-11T05:24:13.537129+0000","last_active":"2024-09-11T05:24:37.670222+0000","last_peered":"2024-09-11T05:24:37.670222+0000","last_clean":"2024-09-11T05:24:37.670222+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:24:37.670222+0000","last_undegraded":"2024-09-11T05:24:37.670222+0000","last_fullsized":"2024-09-11T05:24:37.670222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013836460000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4403,"num_read_kb":10564,"num_write":654,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"169'347","reported_seq":1487,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315604+0000","last_change":"2024-09-11T05:24:22.458771+0000","last_active":"2024-09-11T05:24:38.315604+0000","last_peered":"2024-09-11T05:24:38.315604+0000","last_clean":"2024-09-11T05:24:38.315604+0000","last_became_active":"2024-09-11T05:24:22.431901+0000","last_became_peered":"2024-09-11T05:24:22.431901+0000","last_unstale":"2024-09-11T05:24:38.315604+0000","last_undegraded":"2024-09-11T05:24:38.315604+0000","last_fullsized":"2024-09-11T05:24:38.315604+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:44.514731+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.018393828000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":816,"num_read_kb":10764,"num_write":338,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"169'850","reported_seq":5273,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667819+0000","last_change":"2024-09-11T05:24:22.533001+0000","last_active":"2024-09-11T05:24:37.667819+0000","last_peered":"2024-09-11T05:24:37.667819+0000","last_clean":"2024-09-11T05:24:37.667819+0000","last_became_active":"2024-09-11T05:24:22.437877+0000","last_became_peered":"2024-09-11T05:24:22.437877+0000","last_unstale":"2024-09-11T05:24:37.667819+0000","last_undegraded":"2024-09-11T05:24:37.667819+0000","last_fullsized":"2024-09-11T05:24:37.667819+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:17.940976+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.019759079999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":7315,"num_read_kb":39380,"num_write":944,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'525","reported_seq":4831,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667831+0000","last_change":"2024-09-11T05:24:25.439659+0000","last_active":"2024-09-11T05:24:37.667831+0000","last_peered":"2024-09-11T05:24:37.667831+0000","last_clean":"2024-09-11T05:24:37.667831+0000","last_became_active":"2024-09-11T05:24:25.437899+0000","last_became_peered":"2024-09-11T05:24:25.437899+0000","last_unstale":"2024-09-11T05:24:37.667831+0000","last_undegraded":"2024-09-11T05:24:37.667831+0000","last_fullsized":"2024-09-11T05:24:37.667831+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:26.967470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020611689999999998,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":3727,"num_read_kb":10330,"num_write":542,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"162'806","reported_seq":5017,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667904+0000","last_change":"2024-09-11T05:24:26.445868+0000","last_active":"2024-09-11T05:24:37.667904+0000","last_peered":"2024-09-11T05:24:37.667904+0000","last_clean":"2024-09-11T05:24:37.667904+0000","last_became_active":"2024-09-11T05:24:26.443227+0000","last_became_peered":"2024-09-11T05:24:26.443227+0000","last_unstale":"2024-09-11T05:24:37.667904+0000","last_undegraded":"2024-09-11T05:24:37.667904+0000","last_fullsized":"2024-09-11T05:24:37.667904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:49.198435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040415420000000004,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6010,"num_read_kb":20011,"num_write":960,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"162'658","reported_seq":2584,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:38.315145+0000","last_change":"2024-09-11T05:24:13.588716+0000","last_active":"2024-09-11T05:24:38.315145+0000","last_peered":"2024-09-11T05:24:38.315145+0000","last_clean":"2024-09-11T05:24:38.315145+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:24:38.315145+0000","last_undegraded":"2024-09-11T05:24:38.315145+0000","last_fullsized":"2024-09-11T05:24:38.315145+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.995244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010089490000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":3453,"num_read_kb":10043,"num_write":799,"num_write_kb":6150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"163'469","reported_seq":4204,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667711+0000","last_change":"2024-09-11T05:24:26.443799+0000","last_active":"2024-09-11T05:24:37.667711+0000","last_peered":"2024-09-11T05:24:37.667711+0000","last_clean":"2024-09-11T05:24:37.667711+0000","last_became_active":"2024-09-11T05:24:26.441576+0000","last_became_peered":"2024-09-11T05:24:26.441576+0000","last_unstale":"2024-09-11T05:24:37.667711+0000","last_undegraded":"2024-09-11T05:24:37.667711+0000","last_fullsized":"2024-09-11T05:24:37.667711+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:44.192222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027819350000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3620,"num_read_kb":8678,"num_write":401,"num_write_kb":3589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":619,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"184'652","reported_seq":7634,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:46.655726+0000","last_change":"2024-09-11T05:24:46.655753+0000","last_active":"2024-09-11T05:24:46.655726+0000","last_peered":"2024-09-11T05:24:46.655726+0000","last_clean":"2024-09-11T05:24:46.655726+0000","last_became_active":"2024-09-11T05:24:24.433236+0000","last_became_peered":"2024-09-11T05:24:24.433236+0000","last_unstale":"2024-09-11T05:24:46.655726+0000","last_undegraded":"2024-09-11T05:24:46.655726+0000","last_fullsized":"2024-09-11T05:24:46.655726+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'652","last_scrub_stamp":"2024-09-11T05:24:46.655658+0000","last_deep_scrub":"184'652","last_deep_scrub_stamp":"2024-09-11T05:24:46.655658+0000","last_clean_scrub_stamp":"2024-09-11T05:24:46.655658+0000","objects_scrubbed":30,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:35:41.566307+0000","scrub_duration":18,"objects_trimmed":2,"snaptrim_duration":0.00075108200000000003,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7982,"num_read_kb":29519,"num_write":609,"num_write_kb":13736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'788","reported_seq":4239,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:37.667705+0000","last_change":"2024-09-11T05:24:26.446184+0000","last_active":"2024-09-11T05:24:37.667705+0000","last_peered":"2024-09-11T05:24:37.667705+0000","last_clean":"2024-09-11T05:24:37.667705+0000","last_became_active":"2024-09-11T05:24:26.442736+0000","last_became_peered":"2024-09-11T05:24:26.442736+0000","last_unstale":"2024-09-11T05:24:37.667705+0000","last_undegraded":"2024-09-11T05:24:37.667705+0000","last_fullsized":"2024-09-11T05:24:37.667705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:21:41.804093+0000","last_clean_scrub_stamp":"2024-09-11T05:21:41.804093+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:54.239456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051100649999999996,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":4954,"num_read_kb":19877,"num_write":1038,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":674,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1183,"num_object_clones":0,"num_object_copies":2366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":1179,"num_read":192556,"num_read_kb":678057,"num_write":21640,"num_write_kb":308752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8811,"num_bytes_recovered":208681536,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23429,"internal_metadata":0},"log_size":20149,"ondisk_log_size":20149,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":168,"seq":721554505735,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":2172,"kb_used_omap":30,"kb_used_meta":29089,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":2224128,"data_stored":1078602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31735,"internal_metadata":29787145},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51412,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320428,"statfs":{"total":96636764160,"available":96584118272,"internally_reserved":0,"allocated":2224128,"data_stored":1078602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154776,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38800,"kb_used_data":2168,"kb_used_omap":11,"kb_used_meta":36596,"kb_avail":94333040,"statfs":{"total":96636764160,"available":96597032960,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":37475126},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2228224,"data_stored":1078621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51980,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319860,"statfs":{"total":96636764160,"available":96583536640,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17043,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:24:48.052 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.052 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.052 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.052 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.052 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.052 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T05:21:31.754289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T05:21:31.754289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.053 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T05:21:31.754289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T05:21:31.754289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T05:21:31.754289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.054 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T05:21:31.754289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T05:21:31.754289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T05:21:27.735118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.055 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.056 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.056 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.056 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.056 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.056 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.056 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T05:21:41.804093+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=21, tm_sec=41, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=24, tm_sec=43, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:24:48.056 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T05:25:08.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:25:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T05:25:08.366 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T05:25:08.378 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-11T05:25:07.577387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1187,"num_object_clones":0,"num_object_copies":2374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":1179,"num_read":192672,"num_read_kb":678157,"num_write":21801,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8815,"num_bytes_recovered":209862272,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21317,"ondisk_log_size":21317,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":421272,"kb_used_data":18520,"kb_used_omap":51,"kb_used_meta":402572,"kb_avail":754553448,"statfs":{"total":773094113280,"available":772662730752,"internally_reserved":0,"allocated":18964480,"data_stored":9809476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52761,"internal_metadata":412234215},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002826"},"pg_stats":[{"pgid":"3.1f","version":"184'784","reported_seq":4352,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:45.651525+0000","last_change":"2024-09-11T05:24:45.651559+0000","last_active":"2024-09-11T05:24:45.651525+0000","last_peered":"2024-09-11T05:24:45.651525+0000","last_clean":"2024-09-11T05:24:45.651525+0000","last_became_active":"2024-09-11T05:24:22.436523+0000","last_became_peered":"2024-09-11T05:24:22.436523+0000","last_unstale":"2024-09-11T05:24:45.651525+0000","last_undegraded":"2024-09-11T05:24:45.651525+0000","last_fullsized":"2024-09-11T05:24:45.651525+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'784","last_scrub_stamp":"2024-09-11T05:24:45.651447+0000","last_deep_scrub":"184'784","last_deep_scrub_stamp":"2024-09-11T05:24:45.651447+0000","last_clean_scrub_stamp":"2024-09-11T05:24:45.651447+0000","objects_scrubbed":32,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:48.984764+0000","scrub_duration":23,"objects_trimmed":18,"snaptrim_duration":0.027684375000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":5366,"num_read_kb":22197,"num_write":753,"num_write_kb":10362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"184'652","reported_seq":7419,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:49.985215+0000","last_change":"2024-09-11T05:24:49.985247+0000","last_active":"2024-09-11T05:24:49.985215+0000","last_peered":"2024-09-11T05:24:49.985215+0000","last_clean":"2024-09-11T05:24:49.985215+0000","last_became_active":"2024-09-11T05:22:10.531660+0000","last_became_peered":"2024-09-11T05:22:10.531660+0000","last_unstale":"2024-09-11T05:24:49.985215+0000","last_undegraded":"2024-09-11T05:24:49.985215+0000","last_fullsized":"2024-09-11T05:24:49.985215+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'652","last_scrub_stamp":"2024-09-11T05:24:49.985129+0000","last_deep_scrub":"184'652","last_deep_scrub_stamp":"2024-09-11T05:24:49.985129+0000","last_clean_scrub_stamp":"2024-09-11T05:24:49.985129+0000","objects_scrubbed":31,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:56.009072+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.0020765789999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":8377,"num_read_kb":25107,"num_write":672,"num_write_kb":13431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":2448244,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"184'671","reported_seq":4835,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:52.650728+0000","last_change":"2024-09-11T05:24:52.650778+0000","last_active":"2024-09-11T05:24:52.650728+0000","last_peered":"2024-09-11T05:24:52.650728+0000","last_clean":"2024-09-11T05:24:52.650728+0000","last_became_active":"2024-09-11T05:24:25.432325+0000","last_became_peered":"2024-09-11T05:24:25.432325+0000","last_unstale":"2024-09-11T05:24:52.650728+0000","last_undegraded":"2024-09-11T05:24:52.650728+0000","last_fullsized":"2024-09-11T05:24:52.650728+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'671","last_scrub_stamp":"2024-09-11T05:24:52.650631+0000","last_deep_scrub":"184'671","last_deep_scrub_stamp":"2024-09-11T05:24:52.650631+0000","last_clean_scrub_stamp":"2024-09-11T05:24:52.650631+0000","objects_scrubbed":38,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:31.420802+0000","scrub_duration":28,"objects_trimmed":12,"snaptrim_duration":0.024392765,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":4840,"num_read_kb":11502,"num_write":711,"num_write_kb":4822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":477,"num_bytes_recovered":9769435,"num_keys_recovered":57,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"184'781","reported_seq":6125,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:53.668263+0000","last_change":"2024-09-11T05:24:53.668313+0000","last_active":"2024-09-11T05:24:53.668263+0000","last_peered":"2024-09-11T05:24:53.668263+0000","last_clean":"2024-09-11T05:24:53.668263+0000","last_became_active":"2024-09-11T05:24:26.439136+0000","last_became_peered":"2024-09-11T05:24:26.439136+0000","last_unstale":"2024-09-11T05:24:53.668263+0000","last_undegraded":"2024-09-11T05:24:53.668263+0000","last_fullsized":"2024-09-11T05:24:53.668263+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'781","last_scrub_stamp":"2024-09-11T05:24:53.668162+0000","last_deep_scrub":"184'781","last_deep_scrub_stamp":"2024-09-11T05:24:53.668162+0000","last_clean_scrub_stamp":"2024-09-11T05:24:53.668162+0000","objects_scrubbed":32,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.746444+0000","scrub_duration":27,"objects_trimmed":20,"snaptrim_duration":0.029901693999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":6111,"num_read_kb":17930,"num_write":835,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":481,"num_bytes_recovered":10267580,"num_keys_recovered":284,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"184'820","reported_seq":5404,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:49.618912+0000","last_change":"2024-09-11T05:24:49.618948+0000","last_active":"2024-09-11T05:24:49.618912+0000","last_peered":"2024-09-11T05:24:49.618912+0000","last_clean":"2024-09-11T05:24:49.618912+0000","last_became_active":"2024-09-11T05:24:26.442532+0000","last_became_peered":"2024-09-11T05:24:26.442532+0000","last_unstale":"2024-09-11T05:24:49.618912+0000","last_undegraded":"2024-09-11T05:24:49.618912+0000","last_fullsized":"2024-09-11T05:24:49.618912+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'820","last_scrub_stamp":"2024-09-11T05:24:49.618833+0000","last_deep_scrub":"184'820","last_deep_scrub_stamp":"2024-09-11T05:24:49.618833+0000","last_clean_scrub_stamp":"2024-09-11T05:24:49.618833+0000","objects_scrubbed":37,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:04.351610+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0.00079803399999999998,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":4582,"num_read_kb":11922,"num_write":924,"num_write_kb":11555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":637,"num_bytes_recovered":7770313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"184'339","reported_seq":7063,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:48.129155+0000","last_change":"2024-09-11T05:24:48.129191+0000","last_active":"2024-09-11T05:24:48.129155+0000","last_peered":"2024-09-11T05:24:48.129155+0000","last_clean":"2024-09-11T05:24:48.129155+0000","last_became_active":"2024-09-11T05:24:25.439785+0000","last_became_peered":"2024-09-11T05:24:25.439785+0000","last_unstale":"2024-09-11T05:24:48.129155+0000","last_undegraded":"2024-09-11T05:24:48.129155+0000","last_fullsized":"2024-09-11T05:24:48.129155+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'339","last_scrub_stamp":"2024-09-11T05:24:48.129057+0000","last_deep_scrub":"184'339","last_deep_scrub_stamp":"2024-09-11T05:24:48.129057+0000","last_clean_scrub_stamp":"2024-09-11T05:24:48.129057+0000","objects_scrubbed":32,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:46:49.228790+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.0040559979999999999,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":5755,"num_read_kb":39037,"num_write":265,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":15189092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"184'341","reported_seq":3927,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:46.504552+0000","last_change":"2024-09-11T05:24:46.504615+0000","last_active":"2024-09-11T05:24:46.504552+0000","last_peered":"2024-09-11T05:24:46.504552+0000","last_clean":"2024-09-11T05:24:46.504552+0000","last_became_active":"2024-09-11T05:21:42.401115+0000","last_became_peered":"2024-09-11T05:21:42.401115+0000","last_unstale":"2024-09-11T05:24:46.504552+0000","last_undegraded":"2024-09-11T05:24:46.504552+0000","last_fullsized":"2024-09-11T05:24:46.504552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'341","last_scrub_stamp":"2024-09-11T05:24:46.504458+0000","last_deep_scrub":"184'341","last_deep_scrub_stamp":"2024-09-11T05:24:46.504458+0000","last_clean_scrub_stamp":"2024-09-11T05:24:46.504458+0000","objects_scrubbed":36,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:54:06.132093+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.0015515279999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":3067,"num_read_kb":14648,"num_write":273,"num_write_kb":7353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"184'885","reported_seq":12107,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:48.999933+0000","last_change":"2024-09-11T05:24:48.999974+0000","last_active":"2024-09-11T05:24:48.999933+0000","last_peered":"2024-09-11T05:24:48.999933+0000","last_clean":"2024-09-11T05:24:48.999933+0000","last_became_active":"2024-09-11T05:21:42.407284+0000","last_became_peered":"2024-09-11T05:21:42.407284+0000","last_unstale":"2024-09-11T05:24:48.999933+0000","last_undegraded":"2024-09-11T05:24:48.999933+0000","last_fullsized":"2024-09-11T05:24:48.999933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'885","last_scrub_stamp":"2024-09-11T05:24:48.999844+0000","last_deep_scrub":"184'885","last_deep_scrub_stamp":"2024-09-11T05:24:48.999844+0000","last_clean_scrub_stamp":"2024-09-11T05:24:48.999844+0000","objects_scrubbed":38,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:44.238376+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.00077435600000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":14340,"num_read_kb":34884,"num_write":1189,"num_write_kb":15897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"184'732","reported_seq":5148,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:47.619591+0000","last_change":"2024-09-11T05:24:47.619630+0000","last_active":"2024-09-11T05:24:47.619591+0000","last_peered":"2024-09-11T05:24:47.619591+0000","last_clean":"2024-09-11T05:24:47.619591+0000","last_became_active":"2024-09-11T05:24:24.433017+0000","last_became_peered":"2024-09-11T05:24:24.433017+0000","last_unstale":"2024-09-11T05:24:47.619591+0000","last_undegraded":"2024-09-11T05:24:47.619591+0000","last_fullsized":"2024-09-11T05:24:47.619591+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'732","last_scrub_stamp":"2024-09-11T05:24:47.619517+0000","last_deep_scrub":"184'732","last_deep_scrub_stamp":"2024-09-11T05:24:47.619517+0000","last_clean_scrub_stamp":"2024-09-11T05:24:47.619517+0000","objects_scrubbed":42,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:33.024114+0000","scrub_duration":25,"objects_trimmed":16,"snaptrim_duration":0.015034211,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6372,"num_read_kb":20126,"num_write":676,"num_write_kb":7964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"184'712","reported_seq":13276,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:50.690838+0000","last_change":"2024-09-11T05:24:50.690915+0000","last_active":"2024-09-11T05:24:50.690838+0000","last_peered":"2024-09-11T05:24:50.690838+0000","last_clean":"2024-09-11T05:24:50.690838+0000","last_became_active":"2024-09-11T05:24:22.433313+0000","last_became_peered":"2024-09-11T05:24:22.433313+0000","last_unstale":"2024-09-11T05:24:50.690838+0000","last_undegraded":"2024-09-11T05:24:50.690838+0000","last_fullsized":"2024-09-11T05:24:50.690838+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'712","last_scrub_stamp":"2024-09-11T05:24:50.690673+0000","last_deep_scrub":"184'712","last_deep_scrub_stamp":"2024-09-11T05:24:50.690673+0000","last_clean_scrub_stamp":"2024-09-11T05:24:50.690673+0000","objects_scrubbed":39,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:12.278164+0000","scrub_duration":32,"objects_trimmed":10,"snaptrim_duration":0.021913140000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":13534,"num_read_kb":32568,"num_write":829,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":16617452,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"184'553","reported_seq":4204,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:50.702241+0000","last_change":"2024-09-11T05:24:50.702304+0000","last_active":"2024-09-11T05:24:50.702241+0000","last_peered":"2024-09-11T05:24:50.702241+0000","last_clean":"2024-09-11T05:24:50.702241+0000","last_became_active":"2024-09-11T05:23:12.607908+0000","last_became_peered":"2024-09-11T05:23:12.607908+0000","last_unstale":"2024-09-11T05:24:50.702241+0000","last_undegraded":"2024-09-11T05:24:50.702241+0000","last_fullsized":"2024-09-11T05:24:50.702241+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'553","last_scrub_stamp":"2024-09-11T05:24:50.702143+0000","last_deep_scrub":"184'553","last_deep_scrub_stamp":"2024-09-11T05:24:50.702143+0000","last_clean_scrub_stamp":"2024-09-11T05:24:50.702143+0000","objects_scrubbed":41,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:03:02.524708+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.0042871879999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4537,"num_read_kb":20166,"num_write":454,"num_write_kb":6827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":10058865,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"184'591","reported_seq":5828,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:49.148798+0000","last_change":"2024-09-11T05:24:49.148842+0000","last_active":"2024-09-11T05:24:49.148798+0000","last_peered":"2024-09-11T05:24:49.148798+0000","last_clean":"2024-09-11T05:24:49.148798+0000","last_became_active":"2024-09-11T05:24:26.441181+0000","last_became_peered":"2024-09-11T05:24:26.441181+0000","last_unstale":"2024-09-11T05:24:49.148798+0000","last_undegraded":"2024-09-11T05:24:49.148798+0000","last_fullsized":"2024-09-11T05:24:49.148798+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'591","last_scrub_stamp":"2024-09-11T05:24:49.148715+0000","last_deep_scrub":"184'591","last_deep_scrub_stamp":"2024-09-11T05:24:49.148715+0000","last_clean_scrub_stamp":"2024-09-11T05:24:49.148715+0000","objects_scrubbed":37,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:03:37.493107+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0.0012850680000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5275,"num_read_kb":23266,"num_write":617,"num_write_kb":15660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":20944104,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":317,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:48.849374+0000","last_change":"2024-09-11T05:24:48.849405+0000","last_active":"2024-09-11T05:24:48.849374+0000","last_peered":"2024-09-11T05:24:48.849374+0000","last_clean":"2024-09-11T05:24:48.849374+0000","last_became_active":"2024-09-11T05:23:07.413241+0000","last_became_peered":"2024-09-11T05:23:07.413241+0000","last_unstale":"2024-09-11T05:24:48.849374+0000","last_undegraded":"2024-09-11T05:24:48.849374+0000","last_fullsized":"2024-09-11T05:24:48.849374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:24:48.849278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:24:48.849278+0000","last_clean_scrub_stamp":"2024-09-11T05:24:48.849278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:19.057507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"184'764","reported_seq":8162,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:44.686128+0000","last_change":"2024-09-11T05:24:44.686206+0000","last_active":"2024-09-11T05:24:44.686128+0000","last_peered":"2024-09-11T05:24:44.686128+0000","last_clean":"2024-09-11T05:24:44.686128+0000","last_became_active":"2024-09-11T05:21:42.406202+0000","last_became_peered":"2024-09-11T05:21:42.406202+0000","last_unstale":"2024-09-11T05:24:44.686128+0000","last_undegraded":"2024-09-11T05:24:44.686128+0000","last_fullsized":"2024-09-11T05:24:44.686128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'764","last_scrub_stamp":"2024-09-11T05:24:44.686034+0000","last_deep_scrub":"184'764","last_deep_scrub_stamp":"2024-09-11T05:24:44.686034+0000","last_clean_scrub_stamp":"2024-09-11T05:24:44.686034+0000","objects_scrubbed":41,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:09.728385+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0.0021736070000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9295,"num_read_kb":23648,"num_write":666,"num_write_kb":13705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":363,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:47.442864+0000","last_change":"2024-09-11T05:24:47.442883+0000","last_active":"2024-09-11T05:24:47.442864+0000","last_peered":"2024-09-11T05:24:47.442864+0000","last_clean":"2024-09-11T05:24:47.442864+0000","last_became_active":"2024-09-11T05:22:07.404183+0000","last_became_peered":"2024-09-11T05:22:07.404183+0000","last_unstale":"2024-09-11T05:24:47.442864+0000","last_undegraded":"2024-09-11T05:24:47.442864+0000","last_fullsized":"2024-09-11T05:24:47.442864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:24:47.442797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:24:47.442797+0000","last_clean_scrub_stamp":"2024-09-11T05:24:47.442797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:30.399082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052389799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"184'610","reported_seq":4646,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:50.943784+0000","last_change":"2024-09-11T05:24:50.943838+0000","last_active":"2024-09-11T05:24:50.943784+0000","last_peered":"2024-09-11T05:24:50.943784+0000","last_clean":"2024-09-11T05:24:50.943784+0000","last_became_active":"2024-09-11T05:23:10.602046+0000","last_became_peered":"2024-09-11T05:23:10.602046+0000","last_unstale":"2024-09-11T05:24:50.943784+0000","last_undegraded":"2024-09-11T05:24:50.943784+0000","last_fullsized":"2024-09-11T05:24:50.943784+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'610","last_scrub_stamp":"2024-09-11T05:24:50.943696+0000","last_deep_scrub":"184'610","last_deep_scrub_stamp":"2024-09-11T05:24:50.943696+0000","last_clean_scrub_stamp":"2024-09-11T05:24:50.943696+0000","objects_scrubbed":37,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:43:17.761981+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0.002015902,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5322,"num_read_kb":21543,"num_write":473,"num_write_kb":11277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":8824500,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:51.674473+0000","last_change":"2024-09-11T05:24:51.674507+0000","last_active":"2024-09-11T05:24:51.674473+0000","last_peered":"2024-09-11T05:24:51.674473+0000","last_clean":"2024-09-11T05:24:51.674473+0000","last_became_active":"2024-09-11T05:24:11.547223+0000","last_became_peered":"2024-09-11T05:24:11.547223+0000","last_unstale":"2024-09-11T05:24:51.674473+0000","last_undegraded":"2024-09-11T05:24:51.674473+0000","last_fullsized":"2024-09-11T05:24:51.674473+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:24:51.674387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:24:51.674387+0000","last_clean_scrub_stamp":"2024-09-11T05:24:51.674387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:49.626402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"184'574","reported_seq":2336,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:49.524493+0000","last_change":"2024-09-11T05:24:49.524547+0000","last_active":"2024-09-11T05:24:49.524493+0000","last_peered":"2024-09-11T05:24:49.524493+0000","last_clean":"2024-09-11T05:24:49.524493+0000","last_became_active":"2024-09-11T05:22:57.415239+0000","last_became_peered":"2024-09-11T05:22:57.415239+0000","last_unstale":"2024-09-11T05:24:49.524493+0000","last_undegraded":"2024-09-11T05:24:49.524493+0000","last_fullsized":"2024-09-11T05:24:49.524493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'574","last_scrub_stamp":"2024-09-11T05:24:49.524397+0000","last_deep_scrub":"184'574","last_deep_scrub_stamp":"2024-09-11T05:24:49.524397+0000","last_clean_scrub_stamp":"2024-09-11T05:24:49.524397+0000","objects_scrubbed":44,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:58:43.641379+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0025491730000000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":2107,"num_read_kb":19783,"num_write":526,"num_write_kb":10428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":4866600,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":353,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:45.463450+0000","last_change":"2024-09-11T05:24:45.463468+0000","last_active":"2024-09-11T05:24:45.463450+0000","last_peered":"2024-09-11T05:24:45.463450+0000","last_clean":"2024-09-11T05:24:45.463450+0000","last_became_active":"2024-09-11T05:21:32.794905+0000","last_became_peered":"2024-09-11T05:21:32.794905+0000","last_unstale":"2024-09-11T05:24:45.463450+0000","last_undegraded":"2024-09-11T05:24:45.463450+0000","last_fullsized":"2024-09-11T05:24:45.463450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:24:45.463374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:24:45.463374+0000","last_clean_scrub_stamp":"2024-09-11T05:24:45.463374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:48:01.285658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049370200000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"184'428","reported_seq":5720,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:51.671868+0000","last_change":"2024-09-11T05:24:51.671902+0000","last_active":"2024-09-11T05:24:51.671868+0000","last_peered":"2024-09-11T05:24:51.671868+0000","last_clean":"2024-09-11T05:24:51.671868+0000","last_became_active":"2024-09-11T05:24:22.433696+0000","last_became_peered":"2024-09-11T05:24:22.433696+0000","last_unstale":"2024-09-11T05:24:51.671868+0000","last_undegraded":"2024-09-11T05:24:51.671868+0000","last_fullsized":"2024-09-11T05:24:51.671868+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'428","last_scrub_stamp":"2024-09-11T05:24:51.671765+0000","last_deep_scrub":"184'428","last_deep_scrub_stamp":"2024-09-11T05:24:51.671765+0000","last_clean_scrub_stamp":"2024-09-11T05:24:51.671765+0000","objects_scrubbed":29,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:48.581450+0000","scrub_duration":19,"objects_trimmed":14,"snaptrim_duration":0.024975909000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5377,"num_read_kb":14833,"num_write":328,"num_write_kb":9085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"184'699","reported_seq":14157,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:50.113656+0000","last_change":"2024-09-11T05:24:50.113691+0000","last_active":"2024-09-11T05:24:50.113656+0000","last_peered":"2024-09-11T05:24:50.113656+0000","last_clean":"2024-09-11T05:24:50.113656+0000","last_became_active":"2024-09-11T05:24:26.443148+0000","last_became_peered":"2024-09-11T05:24:26.443148+0000","last_unstale":"2024-09-11T05:24:50.113656+0000","last_undegraded":"2024-09-11T05:24:50.113656+0000","last_fullsized":"2024-09-11T05:24:50.113656+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'699","last_scrub_stamp":"2024-09-11T05:24:50.113563+0000","last_deep_scrub":"184'699","last_deep_scrub_stamp":"2024-09-11T05:24:50.113563+0000","last_clean_scrub_stamp":"2024-09-11T05:24:50.113563+0000","objects_scrubbed":31,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:34.641010+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.0017964610000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":13594,"num_read_kb":50789,"num_write":605,"num_write_kb":30482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36155246,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"184'3","reported_seq":240,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:48.706504+0000","last_change":"2024-09-11T05:24:48.706534+0000","last_active":"2024-09-11T05:24:48.706504+0000","last_peered":"2024-09-11T05:24:48.706504+0000","last_clean":"2024-09-11T05:24:48.706504+0000","last_became_active":"2024-09-11T05:24:22.434799+0000","last_became_peered":"2024-09-11T05:24:22.434799+0000","last_unstale":"2024-09-11T05:24:48.706504+0000","last_undegraded":"2024-09-11T05:24:48.706504+0000","last_fullsized":"2024-09-11T05:24:48.706504+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'3","last_scrub_stamp":"2024-09-11T05:24:48.706411+0000","last_deep_scrub":"184'3","last_deep_scrub_stamp":"2024-09-11T05:24:48.706411+0000","last_clean_scrub_stamp":"2024-09-11T05:24:48.706411+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:48.498085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"184'948","reported_seq":5210,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:48.485324+0000","last_change":"2024-09-11T05:24:48.485359+0000","last_active":"2024-09-11T05:24:48.485324+0000","last_peered":"2024-09-11T05:24:48.485324+0000","last_clean":"2024-09-11T05:24:48.485324+0000","last_became_active":"2024-09-11T05:22:57.414230+0000","last_became_peered":"2024-09-11T05:22:57.414230+0000","last_unstale":"2024-09-11T05:24:48.485324+0000","last_undegraded":"2024-09-11T05:24:48.485324+0000","last_fullsized":"2024-09-11T05:24:48.485324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'948","last_scrub_stamp":"2024-09-11T05:24:48.485239+0000","last_deep_scrub":"184'948","last_deep_scrub_stamp":"2024-09-11T05:24:48.485239+0000","last_clean_scrub_stamp":"2024-09-11T05:24:48.485239+0000","objects_scrubbed":36,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:58.194285+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.0012901449999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":7435,"num_read_kb":34307,"num_write":1162,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":505687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":319,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:46.040883+0000","last_change":"2024-09-11T05:24:46.040883+0000","last_active":"2024-09-11T05:24:46.040883+0000","last_peered":"2024-09-11T05:24:46.040883+0000","last_clean":"2024-09-11T05:24:46.040883+0000","last_became_active":"2024-09-11T05:22:57.411295+0000","last_became_peered":"2024-09-11T05:22:57.411295+0000","last_unstale":"2024-09-11T05:24:46.040883+0000","last_undegraded":"2024-09-11T05:24:46.040883+0000","last_fullsized":"2024-09-11T05:24:46.040883+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:24:46.040773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:24:46.040773+0000","last_clean_scrub_stamp":"2024-09-11T05:24:46.040773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:02.622994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"184'501","reported_seq":9608,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:48.825131+0000","last_change":"2024-09-11T05:24:48.825166+0000","last_active":"2024-09-11T05:24:48.825131+0000","last_peered":"2024-09-11T05:24:48.825131+0000","last_clean":"2024-09-11T05:24:48.825131+0000","last_became_active":"2024-09-11T05:24:25.440625+0000","last_became_peered":"2024-09-11T05:24:25.440625+0000","last_unstale":"2024-09-11T05:24:48.825131+0000","last_undegraded":"2024-09-11T05:24:48.825131+0000","last_fullsized":"2024-09-11T05:24:48.825131+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'501","last_scrub_stamp":"2024-09-11T05:24:48.825057+0000","last_deep_scrub":"184'501","last_deep_scrub_stamp":"2024-09-11T05:24:48.825057+0000","last_clean_scrub_stamp":"2024-09-11T05:24:48.825057+0000","objects_scrubbed":33,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:46.384752+0000","scrub_duration":219,"objects_trimmed":0,"snaptrim_duration":0.0010588730000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":8562,"num_read_kb":22875,"num_write":429,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":507,"num_bytes_recovered":8473457,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:48.666847+0000","last_change":"2024-09-11T05:24:48.666847+0000","last_active":"2024-09-11T05:24:48.666847+0000","last_peered":"2024-09-11T05:24:48.666847+0000","last_clean":"2024-09-11T05:24:48.666847+0000","last_became_active":"2024-09-11T05:23:07.420105+0000","last_became_peered":"2024-09-11T05:23:07.420105+0000","last_unstale":"2024-09-11T05:24:48.666847+0000","last_undegraded":"2024-09-11T05:24:48.666847+0000","last_fullsized":"2024-09-11T05:24:48.666847+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:24:48.666645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:24:48.666645+0000","last_clean_scrub_stamp":"2024-09-11T05:24:48.666645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:36:19.876547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"184'842","reported_seq":3098,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:51.982869+0000","last_change":"2024-09-11T05:24:51.982925+0000","last_active":"2024-09-11T05:24:51.982869+0000","last_peered":"2024-09-11T05:24:51.982869+0000","last_clean":"2024-09-11T05:24:51.982869+0000","last_became_active":"2024-09-11T05:24:22.436605+0000","last_became_peered":"2024-09-11T05:24:22.436605+0000","last_unstale":"2024-09-11T05:24:51.982869+0000","last_undegraded":"2024-09-11T05:24:51.982869+0000","last_fullsized":"2024-09-11T05:24:51.982869+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'842","last_scrub_stamp":"2024-09-11T05:24:51.982781+0000","last_deep_scrub":"184'842","last_deep_scrub_stamp":"2024-09-11T05:24:51.982781+0000","last_clean_scrub_stamp":"2024-09-11T05:24:51.982781+0000","objects_scrubbed":46,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:23.115920+0000","scrub_duration":37,"objects_trimmed":14,"snaptrim_duration":0.024085374999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4368,"num_read_kb":14537,"num_write":970,"num_write_kb":6756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"184'2","reported_seq":295,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:47.661516+0000","last_change":"2024-09-11T05:24:47.661546+0000","last_active":"2024-09-11T05:24:47.661516+0000","last_peered":"2024-09-11T05:24:47.661516+0000","last_clean":"2024-09-11T05:24:47.661516+0000","last_became_active":"2024-09-11T05:24:22.430596+0000","last_became_peered":"2024-09-11T05:24:22.430596+0000","last_unstale":"2024-09-11T05:24:47.661516+0000","last_undegraded":"2024-09-11T05:24:47.661516+0000","last_fullsized":"2024-09-11T05:24:47.661516+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'2","last_scrub_stamp":"2024-09-11T05:24:47.661423+0000","last_deep_scrub":"184'2","last_deep_scrub_stamp":"2024-09-11T05:24:47.661423+0000","last_clean_scrub_stamp":"2024-09-11T05:24:47.661423+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:23.082483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"184'119","reported_seq":435,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:49.666362+0000","last_change":"2024-09-11T05:24:49.666362+0000","last_active":"2024-09-11T05:24:49.666362+0000","last_peered":"2024-09-11T05:24:49.666362+0000","last_clean":"2024-09-11T05:24:49.666362+0000","last_became_active":"2024-09-11T05:23:10.601094+0000","last_became_peered":"2024-09-11T05:23:10.601094+0000","last_unstale":"2024-09-11T05:24:49.666362+0000","last_undegraded":"2024-09-11T05:24:49.666362+0000","last_fullsized":"2024-09-11T05:24:49.666362+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'119","last_scrub_stamp":"2024-09-11T05:24:49.666189+0000","last_deep_scrub":"184'119","last_deep_scrub_stamp":"2024-09-11T05:24:49.666189+0000","last_clean_scrub_stamp":"2024-09-11T05:24:49.666189+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:55.455163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"184'461","reported_seq":5838,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:46.945342+0000","last_change":"2024-09-11T05:24:46.945390+0000","last_active":"2024-09-11T05:24:46.945342+0000","last_peered":"2024-09-11T05:24:46.945342+0000","last_clean":"2024-09-11T05:24:46.945342+0000","last_became_active":"2024-09-11T05:21:42.401389+0000","last_became_peered":"2024-09-11T05:21:42.401389+0000","last_unstale":"2024-09-11T05:24:46.945342+0000","last_undegraded":"2024-09-11T05:24:46.945342+0000","last_fullsized":"2024-09-11T05:24:46.945342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'461","last_scrub_stamp":"2024-09-11T05:24:46.945265+0000","last_deep_scrub":"184'461","last_deep_scrub_stamp":"2024-09-11T05:24:46.945265+0000","last_clean_scrub_stamp":"2024-09-11T05:24:46.945265+0000","objects_scrubbed":40,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:33.511051+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0.0018840860000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4982,"num_read_kb":21766,"num_write":373,"num_write_kb":9562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"184'748","reported_seq":2788,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:47.145601+0000","last_change":"2024-09-11T05:24:47.145638+0000","last_active":"2024-09-11T05:24:47.145601+0000","last_peered":"2024-09-11T05:24:47.145601+0000","last_clean":"2024-09-11T05:24:47.145601+0000","last_became_active":"2024-09-11T05:24:25.435777+0000","last_became_peered":"2024-09-11T05:24:25.435777+0000","last_unstale":"2024-09-11T05:24:47.145601+0000","last_undegraded":"2024-09-11T05:24:47.145601+0000","last_fullsized":"2024-09-11T05:24:47.145601+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'748","last_scrub_stamp":"2024-09-11T05:24:47.145502+0000","last_deep_scrub":"184'748","last_deep_scrub_stamp":"2024-09-11T05:24:47.145502+0000","last_clean_scrub_stamp":"2024-09-11T05:24:47.145502+0000","objects_scrubbed":36,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:50.976916+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0.00122751,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":2844,"num_read_kb":3973,"num_write":882,"num_write_kb":6851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":643,"num_bytes_recovered":4229438,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"184'714","reported_seq":4568,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:49.880658+0000","last_change":"2024-09-11T05:24:49.880718+0000","last_active":"2024-09-11T05:24:49.880658+0000","last_peered":"2024-09-11T05:24:49.880658+0000","last_clean":"2024-09-11T05:24:49.880658+0000","last_became_active":"2024-09-11T05:24:25.434584+0000","last_became_peered":"2024-09-11T05:24:25.434584+0000","last_unstale":"2024-09-11T05:24:49.880658+0000","last_undegraded":"2024-09-11T05:24:49.880658+0000","last_fullsized":"2024-09-11T05:24:49.880658+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'714","last_scrub_stamp":"2024-09-11T05:24:49.880567+0000","last_deep_scrub":"184'714","last_deep_scrub_stamp":"2024-09-11T05:24:49.880567+0000","last_clean_scrub_stamp":"2024-09-11T05:24:49.880567+0000","objects_scrubbed":41,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:04:50.478388+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0.0011019910000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":40,"num_read":4234,"num_read_kb":17484,"num_write":743,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":537,"num_bytes_recovered":6335615,"num_keys_recovered":139,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"184'690","reported_seq":3580,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:47.988652+0000","last_change":"2024-09-11T05:24:47.988725+0000","last_active":"2024-09-11T05:24:47.988652+0000","last_peered":"2024-09-11T05:24:47.988652+0000","last_clean":"2024-09-11T05:24:47.988652+0000","last_became_active":"2024-09-11T05:21:42.406505+0000","last_became_peered":"2024-09-11T05:21:42.406505+0000","last_unstale":"2024-09-11T05:24:47.988652+0000","last_undegraded":"2024-09-11T05:24:47.988652+0000","last_fullsized":"2024-09-11T05:24:47.988652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'690","last_scrub_stamp":"2024-09-11T05:24:47.988567+0000","last_deep_scrub":"184'690","last_deep_scrub_stamp":"2024-09-11T05:24:47.988567+0000","last_clean_scrub_stamp":"2024-09-11T05:24:47.988567+0000","objects_scrubbed":46,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:15.059850+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0013836460000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":4403,"num_read_kb":10564,"num_write":654,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"184'375","reported_seq":1525,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:49.725257+0000","last_change":"2024-09-11T05:24:49.725292+0000","last_active":"2024-09-11T05:24:49.725257+0000","last_peered":"2024-09-11T05:24:49.725257+0000","last_clean":"2024-09-11T05:24:49.725257+0000","last_became_active":"2024-09-11T05:24:22.431901+0000","last_became_peered":"2024-09-11T05:24:22.431901+0000","last_unstale":"2024-09-11T05:24:49.725257+0000","last_undegraded":"2024-09-11T05:24:49.725257+0000","last_fullsized":"2024-09-11T05:24:49.725257+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'375","last_scrub_stamp":"2024-09-11T05:24:49.725181+0000","last_deep_scrub":"184'375","last_deep_scrub_stamp":"2024-09-11T05:24:49.725181+0000","last_clean_scrub_stamp":"2024-09-11T05:24:49.725181+0000","objects_scrubbed":28,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:00.162366+0000","scrub_duration":19,"objects_trimmed":8,"snaptrim_duration":0.018393828000000001,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":816,"num_read_kb":10764,"num_write":338,"num_write_kb":8797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"184'888","reported_seq":5321,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:52.704264+0000","last_change":"2024-09-11T05:24:52.704324+0000","last_active":"2024-09-11T05:24:52.704264+0000","last_peered":"2024-09-11T05:24:52.704264+0000","last_clean":"2024-09-11T05:24:52.704264+0000","last_became_active":"2024-09-11T05:24:22.437877+0000","last_became_peered":"2024-09-11T05:24:22.437877+0000","last_unstale":"2024-09-11T05:24:52.704264+0000","last_undegraded":"2024-09-11T05:24:52.704264+0000","last_fullsized":"2024-09-11T05:24:52.704264+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'888","last_scrub_stamp":"2024-09-11T05:24:52.704158+0000","last_deep_scrub":"184'888","last_deep_scrub_stamp":"2024-09-11T05:24:52.704158+0000","last_clean_scrub_stamp":"2024-09-11T05:24:52.704158+0000","objects_scrubbed":38,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:40:55.872484+0000","scrub_duration":30,"objects_trimmed":8,"snaptrim_duration":0.019759079999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":7315,"num_read_kb":39380,"num_write":944,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":10765140,"num_keys_recovered":69,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"184'555","reported_seq":4871,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:53.682053+0000","last_change":"2024-09-11T05:24:53.682103+0000","last_active":"2024-09-11T05:24:53.682053+0000","last_peered":"2024-09-11T05:24:53.682053+0000","last_clean":"2024-09-11T05:24:53.682053+0000","last_became_active":"2024-09-11T05:24:25.437899+0000","last_became_peered":"2024-09-11T05:24:25.437899+0000","last_unstale":"2024-09-11T05:24:53.682053+0000","last_undegraded":"2024-09-11T05:24:53.682053+0000","last_fullsized":"2024-09-11T05:24:53.682053+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'555","last_scrub_stamp":"2024-09-11T05:24:53.681943+0000","last_deep_scrub":"184'555","last_deep_scrub_stamp":"2024-09-11T05:24:53.681943+0000","last_clean_scrub_stamp":"2024-09-11T05:24:53.681943+0000","objects_scrubbed":30,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:52:11.866913+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0.0020611689999999998,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":3727,"num_read_kb":10330,"num_write":542,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":6471613,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"184'849","reported_seq":5070,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:55.680216+0000","last_change":"2024-09-11T05:24:55.680268+0000","last_active":"2024-09-11T05:24:55.680216+0000","last_peered":"2024-09-11T05:24:55.680216+0000","last_clean":"2024-09-11T05:24:55.680216+0000","last_became_active":"2024-09-11T05:24:26.443227+0000","last_became_peered":"2024-09-11T05:24:26.443227+0000","last_unstale":"2024-09-11T05:24:55.680216+0000","last_undegraded":"2024-09-11T05:24:55.680216+0000","last_fullsized":"2024-09-11T05:24:55.680216+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'849","last_scrub_stamp":"2024-09-11T05:24:55.680128+0000","last_deep_scrub":"184'849","last_deep_scrub_stamp":"2024-09-11T05:24:55.680128+0000","last_clean_scrub_stamp":"2024-09-11T05:24:55.680128+0000","objects_scrubbed":43,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:21.047358+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.0040415420000000004,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6010,"num_read_kb":20011,"num_write":960,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":738,"num_bytes_recovered":6995413,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"184'704","reported_seq":2640,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:47.835333+0000","last_change":"2024-09-11T05:24:47.835383+0000","last_active":"2024-09-11T05:24:47.835333+0000","last_peered":"2024-09-11T05:24:47.835333+0000","last_clean":"2024-09-11T05:24:47.835333+0000","last_became_active":"2024-09-11T05:22:10.534001+0000","last_became_peered":"2024-09-11T05:22:10.534001+0000","last_unstale":"2024-09-11T05:24:47.835333+0000","last_undegraded":"2024-09-11T05:24:47.835333+0000","last_fullsized":"2024-09-11T05:24:47.835333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'704","last_scrub_stamp":"2024-09-11T05:24:47.835222+0000","last_deep_scrub":"184'704","last_deep_scrub_stamp":"2024-09-11T05:24:47.835222+0000","last_clean_scrub_stamp":"2024-09-11T05:24:47.835222+0000","objects_scrubbed":46,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:21:10.352792+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.0010089490000000001,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":3453,"num_read_kb":10043,"num_write":799,"num_write_kb":6150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":1840074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"184'500","reported_seq":4245,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:54.697830+0000","last_change":"2024-09-11T05:24:54.697869+0000","last_active":"2024-09-11T05:24:54.697830+0000","last_peered":"2024-09-11T05:24:54.697830+0000","last_clean":"2024-09-11T05:24:54.697830+0000","last_became_active":"2024-09-11T05:24:26.441576+0000","last_became_peered":"2024-09-11T05:24:26.441576+0000","last_unstale":"2024-09-11T05:24:54.697830+0000","last_undegraded":"2024-09-11T05:24:54.697830+0000","last_fullsized":"2024-09-11T05:24:54.697830+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'500","last_scrub_stamp":"2024-09-11T05:24:54.697738+0000","last_deep_scrub":"184'500","last_deep_scrub_stamp":"2024-09-11T05:24:54.697738+0000","last_clean_scrub_stamp":"2024-09-11T05:24:54.697738+0000","objects_scrubbed":31,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:29.052779+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.0027819350000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3620,"num_read_kb":8678,"num_write":401,"num_write_kb":3589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":619,"num_bytes_recovered":6802158,"num_keys_recovered":110,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"184'652","reported_seq":7634,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:46.655726+0000","last_change":"2024-09-11T05:24:46.655753+0000","last_active":"2024-09-11T05:24:46.655726+0000","last_peered":"2024-09-11T05:24:46.655726+0000","last_clean":"2024-09-11T05:24:46.655726+0000","last_became_active":"2024-09-11T05:24:24.433236+0000","last_became_peered":"2024-09-11T05:24:24.433236+0000","last_unstale":"2024-09-11T05:24:46.655726+0000","last_undegraded":"2024-09-11T05:24:46.655726+0000","last_fullsized":"2024-09-11T05:24:46.655726+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'652","last_scrub_stamp":"2024-09-11T05:24:46.655658+0000","last_deep_scrub":"184'652","last_deep_scrub_stamp":"2024-09-11T05:24:46.655658+0000","last_clean_scrub_stamp":"2024-09-11T05:24:46.655658+0000","objects_scrubbed":30,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:35:41.566307+0000","scrub_duration":18,"objects_trimmed":2,"snaptrim_duration":0.00075108200000000003,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":7982,"num_read_kb":29519,"num_write":609,"num_write_kb":13736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":3834132,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"184'830","reported_seq":4291,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-11T05:24:56.660559+0000","last_change":"2024-09-11T05:24:56.660606+0000","last_active":"2024-09-11T05:24:56.660559+0000","last_peered":"2024-09-11T05:24:56.660559+0000","last_clean":"2024-09-11T05:24:56.660559+0000","last_became_active":"2024-09-11T05:24:26.442736+0000","last_became_peered":"2024-09-11T05:24:26.442736+0000","last_unstale":"2024-09-11T05:24:56.660559+0000","last_undegraded":"2024-09-11T05:24:56.660559+0000","last_fullsized":"2024-09-11T05:24:56.660559+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'830","last_scrub_stamp":"2024-09-11T05:24:56.660477+0000","last_deep_scrub":"184'830","last_deep_scrub_stamp":"2024-09-11T05:24:56.660477+0000","last_clean_scrub_stamp":"2024-09-11T05:24:56.660477+0000","objects_scrubbed":42,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:39.266743+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0051100649999999996,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":4954,"num_read_kb":19877,"num_write":1038,"num_write_kb":7646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":674,"num_bytes_recovered":9517378,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1183,"num_object_clones":0,"num_object_copies":2366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":1179,"num_read":192556,"num_read_kb":678057,"num_write":21640,"num_write_kb":308752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8811,"num_bytes_recovered":208681536,"num_keys_recovered":1059,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23429,"internal_metadata":0},"log_size":21193,"ondisk_log_size":21193,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64460,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307380,"statfs":{"total":96636764160,"available":96570757120,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55560,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316280,"statfs":{"total":96636764160,"available":96579870720,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":168,"seq":721554505739,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35468,"kb_used_data":2172,"kb_used_omap":30,"kb_used_meta":33249,"kb_avail":94336372,"statfs":{"total":96636764160,"available":96600444928,"internally_reserved":0,"allocated":2224128,"data_stored":1078602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31735,"internal_metadata":34046985},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55564,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316276,"statfs":{"total":96636764160,"available":96579866624,"internally_reserved":0,"allocated":2224128,"data_stored":1078602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":87,"seq":373662154780,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38792,"kb_used_data":2168,"kb_used_omap":11,"kb_used_meta":36596,"kb_avail":94333048,"statfs":{"total":96636764160,"available":96597041152,"internally_reserved":0,"allocated":2220032,"data_stored":1078583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11466,"internal_metadata":37475126},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2228224,"data_stored":1078621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51980,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319860,"statfs":{"total":96636764160,"available":96583536640,"internally_reserved":0,"allocated":2813952,"data_stored":1668951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6386,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17043,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:25:08.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T05:25:08.690 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T05:25:08.690 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T05:25:08.690 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T05:25:08.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:08.732 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T05:25:08.733 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T05:25:08.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:08.771 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T05:25:08.771 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T05:25:08.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:08.848 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T05:25:08.848 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T05:25:08.848 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:08.918 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T05:25:08.919 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T05:25:08.919 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:08.971 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T05:25:08.971 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T05:25:08.971 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.018 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T05:25:09.018 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T05:25:09.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.063 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T05:25:09.064 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T05:25:09.064 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.095 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T05:25:09.095 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T05:25:09.095 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T05:25:09.095 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.120 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T05:25:09.120 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T05:25:09.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.164 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T05:25:09.164 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T05:25:09.165 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T05:25:09.165 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.176 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T05:25:09.177 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T05:25:09.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.229 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T05:25:09.229 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T05:25:09.229 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:25:09.241 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T05:25:09.242 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T05:25:09.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-11T05:25:09.310 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:25:09.311 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T05:25:09.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:25:09.574 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T05:25:09.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:25:09.664 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T05:25:09.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:25:09.715 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T05:25:09.772 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:25:09.772 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T05:25:10.107 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:25:10.108 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T05:25:10.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:25:10.170 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T05:25:10.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:25:10.226 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T05:25:10.286 INFO:tasks.ceph:Archiving mon data... 2024-09-11T05:25:10.287 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/data/mon.a.tgz 2024-09-11T05:25:10.287 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-11T05:25:10.304 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.0gA4KEqChQ 2024-09-11T05:25:10.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0gA4KEqChQ 2024-09-11T05:25:10.464 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.0gA4KEqChQ 2024-09-11T05:25:10.549 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.0gA4KEqChQ is 418KB 2024-09-11T05:25:10.647 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.0gA4KEqChQ 2024-09-11T05:25:10.663 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/data/mon.c.tgz 2024-09-11T05:25:10.663 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-11T05:25:10.719 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.qnsD8qmYt0 2024-09-11T05:25:10.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qnsD8qmYt0 2024-09-11T05:25:10.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.qnsD8qmYt0 2024-09-11T05:25:10.990 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.qnsD8qmYt0 is 554KB 2024-09-11T05:25:11.088 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.qnsD8qmYt0 2024-09-11T05:25:11.104 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/data/mon.b.tgz 2024-09-11T05:25:11.104 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-11T05:25:11.122 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.3XNRBmdsIo 2024-09-11T05:25:11.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.3XNRBmdsIo 2024-09-11T05:25:11.319 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.3XNRBmdsIo 2024-09-11T05:25:11.402 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.3XNRBmdsIo is 554KB 2024-09-11T05:25:11.501 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.3XNRBmdsIo 2024-09-11T05:25:11.516 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T05:25:11.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T05:25:11.519 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T05:25:11.601 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T05:25:11.637 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T05:25:11.637 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T05:25:11.638 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/remote/smithi012/crash 2024-09-11T05:25:11.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T05:25:11.668 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/remote/smithi153/crash 2024-09-11T05:25:11.669 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T05:25:11.701 INFO:tasks.ceph:Compressing logs... 2024-09-11T05:25:11.702 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T05:25:11.712 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T05:25:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T05:25:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-09-11T05:25:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.42493.log 2024-09-11T05:25:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57768.log 2024-09-11T05:25:11.746 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-09-11T05:25:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63977.log 2024-09-11T05:25:11.746 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57768.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.48067.log 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57768.log.gz 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53545.log 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63977.log.gz 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/objectstore_tool.48067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42173.log 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53545.log.gz 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62549.log 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42173.log.gz 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56320.log 2024-09-11T05:25:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27165.log/var/log/ceph/ceph-client.admin.62549.log: 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62549.log.gz 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56320.log.gz 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45769.log 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.27165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63809.log 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27165.log.gz 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45769.log.gz 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43312.log 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63809.log.gz 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43312.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.48885.log 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43312.log.gz 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63109.log 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2024-09-11T05:25:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/objectstore_tool.48885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51215.log 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64271.log 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63109.log.gz 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61030.log 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51215.log.gz 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64271.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.44806.log 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64271.log.gz 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46385.log 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61030.log.gz 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63344.log 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44806.log.gz 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr: 95.2% -- replaced with /var/log/ceph/objectstore_tool.48067.log.gz 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42039.log 2024-09-11T05:25:11.749 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46385.log.gz 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61877.log 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63344.log.gz 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42039.log.gz 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46629.log 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54584.log 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61877.log.gz 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60494.log 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46629.log.gz 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40257.log 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54584.log.gz 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60494.log.gz 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57605.log 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40257.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T05:25:11.750 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40257.log.gz 2024-09-11T05:25:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44689.log 2024-09-11T05:25:11.751 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57605.log.gz 2024-09-11T05:25:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2024-09-11T05:25:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44689.log.gz 2024-09-11T05:25:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63893.log 2024-09-11T05:25:11.792 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33007.log 2024-09-11T05:25:11.792 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.50143.log 2024-09-11T05:25:11.792 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33007.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.49243.log 2024-09-11T05:25:11.792 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33007.log.gz 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/objectstore_tool.50143.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/objectstore_tool.49243.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32716.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.48303.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32756.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32716.log.gz 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/objectstore_tool.48303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32836.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32756.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32756.log.gz 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32836.log.gz 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T05:25:11.793 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32876.log 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr: 94.9% -- replaced with /var/log/ceph/objectstore_tool.50143.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32876.log: 94.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32876.log.gz -- replaced with /var/log/ceph/objectstore_tool.49243.log.gz 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.47481.log 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32796.log 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/objectstore_tool.47481.log: 95.1% -- replaced with /var/log/ceph/objectstore_tool.48303.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32927.log 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32796.log.gz 2024-09-11T05:25:11.794 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T05:25:11.795 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32927.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32967.log 2024-09-11T05:25:11.795 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-11T05:25:11.795 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.47481.log.gz 2024-09-11T05:25:11.795 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32967.log.gz 2024-09-11T05:25:11.841 INFO:teuthology.orchestra.run.smithi153.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63104.log 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.48885.log.gz 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61307.log 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63893.log.gz 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63106.log 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63104.log.gz 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61307.log.gz 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40708.log 2024-09-11T05:25:11.856 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63106.log.gz 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55821.log 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40708.log.gz 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62129.log 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55023.log 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55821.log.gz 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62129.log.gz 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40299.log 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55023.log.gz 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45151.log 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40711.log 2024-09-11T05:25:11.857 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40299.log.gz 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44089.log 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45151.log.gz 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56100.log 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40711.log.gz 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44131.log 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44089.log.gz 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63851.log 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56100.log.gz 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41050.log 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44131.log.gz 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43113.log 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63851.log.gz 2024-09-11T05:25:11.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53327.log 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41050.log.gz 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40624.log 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43113.log.gz 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64481.log 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53327.log.gz 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.40624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39712.log 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64481.log.gz 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39207.log 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.0.40624.log.gz 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62087.log 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39712.log.gz 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58273.log 2024-09-11T05:25:11.859 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39207.log.gz 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52987.log 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62087.log.gz 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61349.log 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58273.log.gz 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55159.log 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52987.log.gz 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42894.log 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61349.log.gz 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53786.log 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55159.log.gz 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57987.log 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42894.log.gz 2024-09-11T05:25:11.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39388.log 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53786.log.gz 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39385.log 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57987.log.gz 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46547.log 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39388.log.gz 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39385.log.gz 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56602.log 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46547.log.gz 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60948.log 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56602.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56602.log.gz -5 2024-09-11T05:25:11.861 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63468.log 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38991.log 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60948.log.gz 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40341.log 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63468.log.gz 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62171.log 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38991.log.gz 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54162.log 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40341.log.gz 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40060.log 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62171.log.gz 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46030.log 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54162.log.gz 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40060.log.gz 2024-09-11T05:25:11.862 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62766.log 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60157.log 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46030.log.gz 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64187.log 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62766.log.gz 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60157.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.60157.log.gz --verbose 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.62771.log 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.64187.log: /var/log/ceph/ceph-client.admin.46249.log 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64187.log.gz 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62771.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.64103.log -- replaced with /var/log/ceph/ceph-client.admin.62771.log.gz 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39384.log 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2024-09-11T05:25:11.863 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64103.log.gz 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64689.log 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39384.log.gz 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63099.log 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64689.log.gz 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58890.log 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61788.log 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63099.log.gz 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51564.log 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58890.log.gz 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51354.log 2024-09-11T05:25:11.864 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61788.log.gz 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62045.log 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51564.log.gz 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63683.log 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62045.log.gz 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50321.log 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63683.log.gz 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59820.log 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64649.log 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50321.log.gz 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45430.log 2024-09-11T05:25:11.865 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59820.log.gz 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59032.log 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64649.log.gz 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62003.log 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45430.log.gz 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60831.log 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59032.log.gz 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40509.log 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62003.log.gz 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54344.log 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60831.log.gz 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64397.log 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40509.log.gz 2024-09-11T05:25:11.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54862.log 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54344.log.gz 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62255.log 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64397.log.gz 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39702.log 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54862.log.gz 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62255.log.gz 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39723.log 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39702.log.gz 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63400.log 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39723.log.gz 2024-09-11T05:25:11.867 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44470.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63305.log 0.0% 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63400.log.gz 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62297.log 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63305.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63305.log.gz 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41575.log 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62297.log.gz 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39123.log 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41575.log.gz 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63345.log 2024-09-11T05:25:11.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39123.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39123.log.gz -5 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57180.log 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60319.log 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63345.log.gz 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54543.log 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57180.log.gz 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62465.log 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60319.log.gz 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54543.log.gz 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62423.log 2024-09-11T05:25:11.869 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62465.log.gz 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55363.log 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62423.log.gz 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39719.log 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.55363.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55420.log 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55363.log.gz 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62591.log 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39719.log.gz 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63107.log 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr: 29.1% -- replaced with /var/log/ceph/ceph-client.admin.55420.log.gz 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50903.log 2024-09-11T05:25:11.870 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62591.log.gz 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46827.log 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63107.log.gz 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54939.log 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50903.log.gz 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40055.log 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46827.log.gz 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39710.log 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54939.log.gz 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61961.log 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40055.log.gz 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63407.log 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39710.log.gz 2024-09-11T05:25:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61961.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.40051.log -- replaced with /var/log/ceph/ceph-client.admin.61961.log.gz 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39072.log 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63407.log.gz 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64061.log 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40051.log.gz 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33001.log 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39072.log.gz 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64061.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64061.log.gz 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57142.log 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33001.log.gz 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40059.log 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60535.log 2024-09-11T05:25:11.872 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57142.log.gz 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40059.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.61830.log 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40059.log.gz 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59765.log 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60535.log.gz 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51160.log 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61830.log.gz 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43387.log 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59765.log.gz 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39047.log 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51160.log.gz 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43387.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.49819.log 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43387.log.gz 2024-09-11T05:25:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42893.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39047.log.gz 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/objectstore_tool.49819.log: /var/log/ceph/ceph-client.admin.42893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57664.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42893.log.gz 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57100.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64607.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57664.log.gz 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59428.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57100.log.gz 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64607.log.gz 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59428.log: /var/log/ceph/ceph-client.admin.60878.log 2024-09-11T05:25:11.874 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59428.log.gz 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43750.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gz 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63406.log 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60878.log.gz 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55608.log 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56962.log 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63406.log.gz 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55608.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55608.log.gz 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56962.log: /var/log/ceph/objectstore_tool.47058.log 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56962.log.gz 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58274.log 2024-09-11T05:25:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/objectstore_tool.47058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62768.log 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58274.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62987.log 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62768.log.gz 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41532.log 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40425.log 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62987.log.gz 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41532.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.49819.log.gz 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41532.log.gz 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40052.log 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53902.log 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40425.log: /var/log/ceph/ceph-client.admin.40052.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40425.log.gz 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40052.log.gz 2024-09-11T05:25:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62770.log 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53902.log.gz 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51611.log 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62770.log: /var/log/ceph/ceph-client.admin.44511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62770.log.gz 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63725.log 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51611.log.gz 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62507.log 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63725.log.gz 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62213.log 2024-09-11T05:25:11.877 INFO:teuthology.orchestra.run.smithi012.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.47058.log.gz 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57565.log 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62507.log: /var/log/ceph/ceph-client.admin.62213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39721.log 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62507.log.gz 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62213.log.gz 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57565.log.gz 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57684.log 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39721.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57684.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58573.log 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57684.log.gz 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41776.log 2024-09-11T05:25:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44992.log 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58573.log.gz 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41776.log.gzgzip 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62381.log 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52673.log 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62381.log.gz 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39389.log 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52673.log.gz 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63108.log 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39389.log.gz 2024-09-11T05:25:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64355.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57868.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63108.log.gz 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64355.log.gz 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39165.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52653.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57868.log: /var/log/ceph/ceph-client.admin.39165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43892.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39165.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57868.log.gz 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52653.log.gz 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58149.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56341.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43892.log: /var/log/ceph/ceph-client.admin.58149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59528.log 2024-09-11T05:25:11.880 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43892.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58149.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57383.log 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56341.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63463.log 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59528.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57383.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57182.log 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63463.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63767.log 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57182.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57182.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64229.log 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63767.log.gz 2024-09-11T05:25:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54981.log 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64229.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64229.log.gz 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56460.log 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54981.log.gz 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42695.log 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56460.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56460.log.gz 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44950.log 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42695.log.gz 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41449.log 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44950.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62772.log 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41449.log.gz 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39921.log 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62772.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62772.log.gz 2024-09-11T05:25:11.882 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.56704.log 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39921.log.gz 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50037.log 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56704.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56704.log.gz 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62773.log 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50037.log.gz 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61110.log 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.62773.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62773.log.gz 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr: /var/log/ceph/ceph-client.admin.50883.log 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61110.log.gz 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40383.log 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50883.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50883.log.gz 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44908.log 2024-09-11T05:25:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40383.log.gz 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58574.log 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44908.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44908.log.gz 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62339.log 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58574.log.gz 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39383.log 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62339.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62339.log.gz 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46767.log 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39383.log.gz 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64523.log 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46767.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46767.log.gz 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40571.log 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64523.log.gz 2024-09-11T05:25:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62769.log 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40571.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40571.log.gz 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64439.log 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62769.log.gz 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64145.log 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64439.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64439.log.gz 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55801.log 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64145.log.gz 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56841.log 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40710.log 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55801.log.gz 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61686.log 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56841.log.gz 2024-09-11T05:25:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62989.log 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40710.log: gzip -5/var/log/ceph/ceph-client.admin.61686.log: --verbose -- /var/log/ceph/ceph-client.admin.62767.log 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61686.log.gz 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40710.log.gz 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62989.log.gz 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45353.log 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62767.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62767.log.gz 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41655.log 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45353.log.gz 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58212.log 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41655.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41655.log.gz 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56197.log 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58212.log.gz 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39725.log 2024-09-11T05:25:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56197.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56197.log.gz 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63641.log 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39725.log.gz 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39382.log 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63641.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63641.log.gz 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39382.log.gz 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60082.log 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63935.log 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48829.log: /var/log/ceph/ceph-client.admin.60082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58129.log 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60082.log.gz 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63935.log.gz 2024-09-11T05:25:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38613.log 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33303.log 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58129.log.gz 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39387.log 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38613.log.gz 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55540.log 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33303.log: gzip/var/log/ceph/ceph-client.admin.39387.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39387.log.gz 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr: /var/log/ceph/ceph-client.admin.54105.log 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33303.log.gz 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55540.log.gz 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59129.log 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54105.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54105.log.gz 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58753.log 2024-09-11T05:25:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59129.log.gz 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42436.log 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58753.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58753.log.gz 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59311.log 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42436.log.gz 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40467.log 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59311.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59311.log.gz 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41938.log 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40467.log.gz 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64019.log 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41938.log.gz 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47316.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2024-09-11T05:25:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61919.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64019.log.gz 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43194.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64565.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61919.log: /var/log/ceph/ceph-client.admin.43194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61919.log.gz 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43194.log.gz 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41332.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54284.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64565.log.gz 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41332.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39386.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41332.log.gz 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61624.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54284.log.gz 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39386.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52870.log 2024-09-11T05:25:11.890 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39386.log.gz 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56239.log 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61624.log.gz 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64313.log 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52870.log.gz 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39724.log 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56239.log.gz 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64313.log.gz 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40061.log 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39724.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33402.log 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39724.log.gz 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53723.log 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33402.log: /var/log/ceph/ceph-client.admin.40061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33402.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40061.log.gz 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T05:25:11.891 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53723.log.gz 2024-09-11T05:25:11.923 INFO:teuthology.orchestra.run.smithi153.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T05:25:11.941 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T05:25:12.168 INFO:teuthology.orchestra.run.smithi012.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T05:25:12.681 INFO:teuthology.orchestra.run.smithi012.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T05:25:13.562 INFO:teuthology.orchestra.run.smithi153.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T05:25:14.141 INFO:teuthology.orchestra.run.smithi012.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T05:25:14.268 INFO:teuthology.orchestra.run.smithi153.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T05:25:14.373 INFO:teuthology.orchestra.run.smithi153.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T05:25:15.373 INFO:teuthology.orchestra.run.smithi153.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T05:25:15.375 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-11T05:25:15.376 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m3.610s 2024-09-11T05:25:15.376 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m10.315s 2024-09-11T05:25:15.376 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.384s 2024-09-11T05:25:15.943 INFO:teuthology.orchestra.run.smithi012.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T05:25:17.134 INFO:teuthology.orchestra.run.smithi012.stderr: 95.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T05:25:17.136 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T05:25:17.136 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m5.411s 2024-09-11T05:25:17.137 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m12.987s 2024-09-11T05:25:17.137 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.597s 2024-09-11T05:25:17.140 INFO:tasks.ceph:Archiving logs... 2024-09-11T05:25:17.140 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/remote/smithi012/log 2024-09-11T05:25:17.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T05:25:18.926 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/remote/smithi153/log 2024-09-11T05:25:18.927 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T05:25:20.400 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T05:25:20.414 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T05:25:20.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T05:25:20.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T05:25:20.492 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T05:25:20.502 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T05:25:20.502 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:25:20.505 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:25:20.520 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:25:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:25:20.524 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:25:20.524 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-11T05:25:20.524 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +212us[ +211us] +/- 39ms 2024-09-11T05:25:20.525 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -1182us[-1183us] +/- 71ms 2024-09-11T05:25:20.525 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +938us[ +938us] +/- 83ms 2024-09-11T05:25:20.525 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:25:20.526 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:25:20.526 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-11T05:25:20.526 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +216us[ +221us] +/- 39ms 2024-09-11T05:25:20.526 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -1171us[-1166us] +/- 71ms 2024-09-11T05:25:20.526 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +943us[ +948us] +/- 83ms 2024-09-11T05:25:20.526 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:25:20.527 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T05:25:20.536 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T05:25:20.536 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T05:25:20.544 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T05:25:20.652 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T05:25:20.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:25:20.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:25:20.758 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:25:20.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:25:20.787 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T05:25:20.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T05:25:20.805 INFO:teuthology.task.internal:Duration was 673.997231 seconds 2024-09-11T05:25:20.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T05:25:20.816 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T05:25:20.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T05:25:20.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T05:25:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:25:20.867 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:25:21.189 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T05:25:21.189 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T05:25:21.189 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T05:25:21.253 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-11T05:25:21.253 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T05:25:21.284 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T05:25:21.284 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T05:25:21.296 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T05:25:21.351 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T05:25:21.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T05:25:21.366 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T05:25:21.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T05:25:21.518 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T05:25:21.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T05:25:21.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T05:25:21.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T05:25:21.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:25:21.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:25:21.609 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-11T05:25:21.633 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-11T05:25:21.672 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:25:21.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:25:21.689 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:25:21.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:25:21.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T05:25:21.737 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T05:25:21.738 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/remote/smithi012 2024-09-11T05:25:21.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T05:25:21.778 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900547/remote/smithi153 2024-09-11T05:25:21.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T05:25:21.812 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T05:25:21.813 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T05:25:21.815 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T05:25:21.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T05:25:21.871 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T05:25:21.872 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T05:25:21.881 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T05:25:21.881 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T05:25:21.884 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T05:25:21.897 INFO:teuthology.orchestra.run.smithi012.stdout: 262173 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 05:25 /home/ubuntu/cephtest 2024-09-11T05:25:21.917 INFO:teuthology.orchestra.run.smithi153.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 05:25 /home/ubuntu/cephtest 2024-09-11T05:25:21.918 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T05:25:21.928 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T05:25:21.951 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} duration: 673.9972310066223 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T05:25:21.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T05:25:22.031 INFO:teuthology.run:pass